AMD Ryzen 7 PRO 5850U testing with a HP 8A78 (F.04 BIOS) and AMD Cezanne 512MB on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2208132-PTS-HPDEVONE31 hp dev one mnn ncnn - Phoronix Test Suite hp dev one mnn ncnn AMD Ryzen 7 PRO 5850U testing with a HP 8A78 (F.04 BIOS) and AMD Cezanne 512MB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2208132-PTS-HPDEVONE31&sro&grr .
hp dev one mnn ncnn Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution A B C AMD Ryzen 7 PRO 5850U @ 1.90GHz (8 Cores / 16 Threads) HP 8A78 (F.04 BIOS) AMD Renoir/Cezanne 16GB 1024GB SK hynix PC711 HFS001TDE9X073N AMD Cezanne 512MB (2000/400MHz) AMD Renoir Radeon HD Audio Realtek RTL8822CE 802.11ac PCIe Ubuntu 22.04 5.19.0-051900rc7-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.47) 1.3.204 GCC 11.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa50000c Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
hp dev one mnn ncnn ncnn: Vulkan GPU - FastestDet ncnn: Vulkan GPU - vision_transformer ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU - mobilenet ncnn: CPU - FastestDet ncnn: CPU - vision_transformer ncnn: CPU - regnety_400m ncnn: CPU - squeezenet_ssd ncnn: CPU - yolov4-tiny ncnn: CPU - resnet50 ncnn: CPU - alexnet ncnn: CPU - resnet18 ncnn: CPU - vgg16 ncnn: CPU - googlenet ncnn: CPU - blazeface ncnn: CPU - efficientnet-b0 ncnn: CPU - mnasnet ncnn: CPU - shufflenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU - mobilenet mnn: inception-v3 mnn: mobilenet-v1-1.0 mnn: MobileNetV2_224 mnn: SqueezeNetV1.0 mnn: resnet-v2-50 mnn: squeezenetv1.1 mnn: mobilenetV3 A B C 4.01 588.87 5.05 15.72 18.84 13.00 6.72 5.95 27.07 8.20 1.82 10.30 3.45 2.63 3.80 3.56 11.09 3.26 230.00 8.29 18.50 25.73 22.25 9.80 11.63 61.29 12.77 0.91 6.52 3.25 2.65 3.32 4.11 15.76 35.851 2.916 3.030 6.071 26.186 3.110 1.540 4.14 589.03 4.87 15.68 19.16 12.74 6.82 5.62 27.11 8.58 1.88 10.23 3.48 2.65 3.77 3.44 10.88 3.21 231.45 8.32 18.40 25.50 22.23 9.78 11.36 61.56 12.69 0.91 6.56 3.30 2.73 3.30 4.16 15.83 36.012 2.931 3.057 6.115 26.236 3.140 1.555 3.95 592.19 5.03 15.73 18.93 13.31 6.88 5.92 27.23 8.94 1.87 10.39 3.54 2.62 3.78 3.53 10.99 3.27 231.24 8.31 18.37 25.41 22.49 9.87 11.64 61.42 12.94 0.96 6.63 3.49 2.64 3.41 4.29 15.30 36.062 2.918 3.009 6.095 26.310 3.113 1.546 OpenBenchmarking.org
NCNN Target: Vulkan GPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: FastestDet A B C 0.9315 1.863 2.7945 3.726 4.6575 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 4.01 4.14 3.95 MIN: 3.29 / MAX: 5.05 MIN: 3.37 / MAX: 5.59 MIN: 3.26 / MAX: 4.84 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: vision_transformer A B C 130 260 390 520 650 SE +/- 4.55, N = 3 SE +/- 0.70, N = 3 SE +/- 1.96, N = 3 588.87 589.03 592.19 MIN: 565.59 / MAX: 626.82 MIN: 567.34 / MAX: 640.15 MIN: 563.63 / MAX: 634.26 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: regnety_400m A B C 1.1363 2.2726 3.4089 4.5452 5.6815 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 5.05 4.87 5.03 MIN: 4.51 / MAX: 6.86 MIN: 4.51 / MAX: 5.84 MIN: 4.67 / MAX: 6.21 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: squeezenet_ssd A B C 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 15.72 15.68 15.73 MIN: 13.56 / MAX: 20.72 MIN: 13.43 / MAX: 20.03 MIN: 13.51 / MAX: 19.66 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: yolov4-tiny A B C 5 10 15 20 25 SE +/- 0.11, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 18.84 19.16 18.93 MIN: 17.57 / MAX: 20.77 MIN: 17.74 / MAX: 28.41 MIN: 17.55 / MAX: 22.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: resnet50 A B C 3 6 9 12 15 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 13.00 12.74 13.31 MIN: 11.71 / MAX: 14.71 MIN: 11.52 / MAX: 14.22 MIN: 11.85 / MAX: 14.63 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: alexnet A B C 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 6.72 6.82 6.88 MIN: 6.2 / MAX: 8.38 MIN: 6.24 / MAX: 8.8 MIN: 6.26 / MAX: 8.63 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: resnet18 A B C 1.3388 2.6776 4.0164 5.3552 6.694 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 5.95 5.62 5.92 MIN: 5.4 / MAX: 7.62 MIN: 5.3 / MAX: 7.12 MIN: 5.41 / MAX: 7.89 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: vgg16 A B C 6 12 18 24 30 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 27.07 27.11 27.23 MIN: 26.11 / MAX: 28.41 MIN: 26.36 / MAX: 30.16 MIN: 26.26 / MAX: 30.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: googlenet A B C 2 4 6 8 10 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.43, N = 3 8.20 8.58 8.94 MIN: 7.41 / MAX: 9.84 MIN: 7.48 / MAX: 10.45 MIN: 7.46 / MAX: 10.68 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: blazeface A B C 0.423 0.846 1.269 1.692 2.115 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 1.82 1.88 1.87 MIN: 1.53 / MAX: 4.96 MIN: 1.51 / MAX: 5.28 MIN: 1.59 / MAX: 2.83 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: efficientnet-b0 A B C 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 10.30 10.23 10.39 MIN: 8.57 / MAX: 11.57 MIN: 8.83 / MAX: 11.69 MIN: 8.61 / MAX: 11.63 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: mnasnet A B C 0.7965 1.593 2.3895 3.186 3.9825 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 2 3.45 3.48 3.54 MIN: 3.33 / MAX: 4.15 MIN: 3.31 / MAX: 4.17 MIN: 3.23 / MAX: 4.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: shufflenet-v2 A B C 0.5963 1.1926 1.7889 2.3852 2.9815 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 2.63 2.65 2.62 MIN: 2.26 / MAX: 3.32 MIN: 2.26 / MAX: 3.64 MIN: 2.26 / MAX: 4.19 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 A B C 0.855 1.71 2.565 3.42 4.275 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.80 3.77 3.78 MIN: 3.55 / MAX: 4.58 MIN: 3.59 / MAX: 4.31 MIN: 3.51 / MAX: 4.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 A B C 0.801 1.602 2.403 3.204 4.005 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 3.56 3.44 3.53 MIN: 3.26 / MAX: 4.22 MIN: 3.23 / MAX: 4.24 MIN: 3.23 / MAX: 4.06 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: Vulkan GPU - Model: mobilenet A B C 3 6 9 12 15 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 11.09 10.88 10.99 MIN: 9.84 / MAX: 15.36 MIN: 9.71 / MAX: 14.4 MIN: 9.97 / MAX: 13.7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: FastestDet A B C 0.7358 1.4716 2.2074 2.9432 3.679 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 3.26 3.21 3.27 MIN: 3.01 / MAX: 6.48 MIN: 2.96 / MAX: 14.96 MIN: 3.02 / MAX: 7.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer A B C 50 100 150 200 250 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 230.00 231.45 231.24 MIN: 225.46 / MAX: 242.01 MIN: 227.44 / MAX: 242.39 MIN: 227.39 / MAX: 240.54 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: regnety_400m A B C 2 4 6 8 10 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 8.29 8.32 8.31 MIN: 7.9 / MAX: 12.53 MIN: 7.93 / MAX: 12.94 MIN: 7.95 / MAX: 12.9 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: squeezenet_ssd A B C 5 10 15 20 25 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 18.50 18.40 18.37 MIN: 17.72 / MAX: 28.95 MIN: 17.67 / MAX: 23.76 MIN: 17.58 / MAX: 26.71 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: yolov4-tiny A B C 6 12 18 24 30 SE +/- 0.10, N = 3 SE +/- 0.20, N = 3 SE +/- 0.18, N = 3 25.73 25.50 25.41 MIN: 24.27 / MAX: 39.93 MIN: 23.9 / MAX: 38.15 MIN: 24.26 / MAX: 34.99 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet50 A B C 5 10 15 20 25 SE +/- 0.32, N = 3 SE +/- 0.21, N = 3 SE +/- 0.11, N = 3 22.25 22.23 22.49 MIN: 20.96 / MAX: 36.19 MIN: 21.17 / MAX: 35.71 MIN: 21.31 / MAX: 40.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: alexnet A B C 3 6 9 12 15 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 9.80 9.78 9.87 MIN: 9.26 / MAX: 20.43 MIN: 9.27 / MAX: 14.54 MIN: 9.25 / MAX: 20.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet18 A B C 3 6 9 12 15 SE +/- 0.20, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 11.63 11.36 11.64 MIN: 10.95 / MAX: 24.9 MIN: 10.95 / MAX: 26.08 MIN: 10.94 / MAX: 22.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vgg16 A B C 14 28 42 56 70 SE +/- 0.19, N = 3 SE +/- 0.21, N = 3 SE +/- 0.29, N = 3 61.29 61.56 61.42 MIN: 59.89 / MAX: 74.13 MIN: 59.87 / MAX: 74.67 MIN: 59.85 / MAX: 80.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: googlenet A B C 3 6 9 12 15 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.25, N = 3 12.77 12.69 12.94 MIN: 12.19 / MAX: 20.18 MIN: 12.16 / MAX: 24.09 MIN: 12.16 / MAX: 25.91 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: blazeface A B C 0.216 0.432 0.648 0.864 1.08 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 0.91 0.91 0.96 MIN: 0.86 / MAX: 5.42 MIN: 0.86 / MAX: 4.21 MIN: 0.86 / MAX: 4.14 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: efficientnet-b0 A B C 2 4 6 8 10 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.17, N = 3 6.52 6.56 6.63 MIN: 6.26 / MAX: 16.65 MIN: 6.27 / MAX: 20.14 MIN: 6.28 / MAX: 10.73 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mnasnet A B C 0.7853 1.5706 2.3559 3.1412 3.9265 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.21, N = 2 3.25 3.30 3.49 MIN: 2.96 / MAX: 8.17 MIN: 2.96 / MAX: 11.21 MIN: 3 / MAX: 7.61 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: shufflenet-v2 A B C 0.6143 1.2286 1.8429 2.4572 3.0715 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 2.65 2.73 2.64 MIN: 2.47 / MAX: 6.83 MIN: 2.58 / MAX: 6.79 MIN: 2.48 / MAX: 6.54 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 A B C 0.7673 1.5346 2.3019 3.0692 3.8365 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 3.32 3.30 3.41 MIN: 3.11 / MAX: 7.73 MIN: 3.12 / MAX: 7.89 MIN: 3.12 / MAX: 7.92 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 A B C 0.9653 1.9306 2.8959 3.8612 4.8265 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 4.11 4.16 4.29 MIN: 3.88 / MAX: 8.26 MIN: 3.88 / MAX: 15.77 MIN: 3.89 / MAX: 8.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mobilenet A B C 4 8 12 16 20 SE +/- 0.15, N = 3 SE +/- 0.23, N = 3 SE +/- 0.17, N = 3 15.76 15.83 15.30 MIN: 14.75 / MAX: 28.99 MIN: 14.55 / MAX: 27.15 MIN: 14.41 / MAX: 26.95 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.0 Model: inception-v3 A B C 8 16 24 32 40 SE +/- 0.24, N = 3 SE +/- 0.25, N = 3 SE +/- 0.18, N = 3 35.85 36.01 36.06 MIN: 32.74 / MAX: 51.07 MIN: 32.7 / MAX: 53.04 MIN: 33.17 / MAX: 55.19 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.0 Model: mobilenet-v1-1.0 A B C 0.6595 1.319 1.9785 2.638 3.2975 SE +/- 0.010, N = 3 SE +/- 0.016, N = 3 SE +/- 0.004, N = 3 2.916 2.931 2.918 MIN: 2.73 / MAX: 19.55 MIN: 2.77 / MAX: 19.44 MIN: 2.79 / MAX: 11.13 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.0 Model: MobileNetV2_224 A B C 0.6878 1.3756 2.0634 2.7512 3.439 SE +/- 0.045, N = 3 SE +/- 0.029, N = 3 SE +/- 0.011, N = 3 3.030 3.057 3.009 MIN: 2.83 / MAX: 19.33 MIN: 2.87 / MAX: 19.5 MIN: 2.85 / MAX: 12.58 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.0 Model: SqueezeNetV1.0 A B C 2 4 6 8 10 SE +/- 0.014, N = 3 SE +/- 0.038, N = 3 SE +/- 0.016, N = 3 6.071 6.115 6.095 MIN: 5.75 / MAX: 22.06 MIN: 5.83 / MAX: 10.78 MIN: 5.85 / MAX: 21.05 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.0 Model: resnet-v2-50 A B C 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 26.19 26.24 26.31 MIN: 25.22 / MAX: 41.46 MIN: 25.21 / MAX: 40.76 MIN: 25.35 / MAX: 41.29 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.0 Model: squeezenetv1.1 A B C 0.7065 1.413 2.1195 2.826 3.5325 SE +/- 0.046, N = 3 SE +/- 0.053, N = 3 SE +/- 0.037, N = 3 3.110 3.140 3.113 MIN: 2.82 / MAX: 7.63 MIN: 2.8 / MAX: 7.78 MIN: 2.83 / MAX: 17.36 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.0 Model: mobilenetV3 A B C 0.3499 0.6998 1.0497 1.3996 1.7495 SE +/- 0.013, N = 3 SE +/- 0.008, N = 3 SE +/- 0.001, N = 3 1.540 1.555 1.546 MIN: 1.47 / MAX: 6.46 MIN: 1.49 / MAX: 17.85 MIN: 1.48 / MAX: 16.32 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Phoronix Test Suite v10.8.4