Core i5 7600K NCNN

Intel Core i5-7600K testing with a Gigabyte Z270M-D3H-CF (F8d BIOS) and Gigabyte Intel HD 630 3GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2012186-HA-COREI576010&gru&sro.

Core i5 7600K NCNNProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1234Intel Core i5-7600K @ 4.20GHz (4 Cores)Gigabyte Z270M-D3H-CF (F8d BIOS)Intel Xeon E3-1200 v6/7th + Z2708GB250GB Samsung SSD 850Gigabyte Intel HD 630 3GB (1150MHz)Realtek ALC892DELL S2409WIntel I219-VUbuntu 20.045.9.0-050900rc7daily20200928-generic (x86_64) 20200927GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 20.0.81.2.131GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xde - Thermald 1.9.1Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT disabled + mds: Mitigation of Clear buffers; SMT disabled + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of Clear buffers; SMT disabled

Core i5 7600K NCNNncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m123437.239.888.068.737.4913.292.1427.69152.6232.2326.8562.5353.5946.1414.4337.159.888.058.697.4513.232.1327.68152.9132.2426.8462.5353.3946.0214.4637.179.858.048.727.4713.282.1527.67153.0532.1926.9162.4653.4546.1714.4337.199.868.048.727.4613.292.1427.68153.3732.2526.8462.3853.5646.1214.4437.149.858.058.717.4713.252.1427.62153.3232.2726.8662.5453.4646.2714.4337.299.868.088.717.4613.322.1427.61153.2132.1726.8362.4153.4846.1914.4537.229.878.078.737.4713.262.1327.71153.2232.3126.8662.5953.5746.2114.4437.279.898.078.707.4713.292.1427.67152.9732.1826.8462.4553.4646.0614.46OpenBenchmarking.org

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet1234918273645SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 337.2337.1737.1437.22MIN: 36.92 / MAX: 39.42MIN: 36.94 / MAX: 38.46MIN: 36.9 / MAX: 39.3MIN: 37.01 / MAX: 39.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v212343691215SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 39.889.859.859.87MIN: 9.76 / MAX: 17.75MIN: 9.71 / MAX: 11.37MIN: 9.71 / MAX: 11.68MIN: 9.74 / MAX: 11.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v31234246810SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 38.068.048.058.07MIN: 7.94 / MAX: 9.84MIN: 7.91 / MAX: 9.61MIN: 7.94 / MAX: 9.69MIN: 7.98 / MAX: 9.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v21234246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 38.738.728.718.73MIN: 8.66 / MAX: 11MIN: 8.67 / MAX: 9.45MIN: 8.68 / MAX: 9.01MIN: 8.67 / MAX: 9.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet1234246810SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.497.477.477.47MIN: 7.4 / MAX: 7.66MIN: 7.42 / MAX: 7.68MIN: 7.39 / MAX: 9.78MIN: 7.41 / MAX: 7.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b012343691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 313.2913.2813.2513.26MIN: 13.21 / MAX: 16.05MIN: 13.17 / MAX: 22.23MIN: 13.18 / MAX: 14.06MIN: 13.18 / MAX: 13.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface12340.48380.96761.45141.93522.419SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.142.152.142.13MIN: 2.12 / MAX: 2.94MIN: 2.11 / MAX: 2.21MIN: 2.12 / MAX: 2.3MIN: 2.11 / MAX: 2.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet1234714212835SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 327.6927.6727.6227.71MIN: 27.52 / MAX: 36.99MIN: 27.54 / MAX: 29.95MIN: 27.45 / MAX: 29MIN: 27.59 / MAX: 29.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg161234306090120150SE +/- 0.32, N = 3SE +/- 0.38, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3152.62153.05153.32153.22MIN: 151.6 / MAX: 162.07MIN: 152.01 / MAX: 163.38MIN: 152.53 / MAX: 162.91MIN: 152.47 / MAX: 161.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet181234816243240SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 332.2332.1932.2732.31MIN: 32.05 / MAX: 33.73MIN: 32.01 / MAX: 33.89MIN: 32.05 / MAX: 34.57MIN: 32.02 / MAX: 35.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet1234612182430SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 326.8526.9126.8626.86MIN: 26.66 / MAX: 28.04MIN: 26.7 / MAX: 60.35MIN: 26.71 / MAX: 28.27MIN: 26.71 / MAX: 30.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet5012341428425670SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 362.5362.4662.5462.59MIN: 62.16 / MAX: 72.37MIN: 62.1 / MAX: 63.95MIN: 62.24 / MAX: 71.97MIN: 62.22 / MAX: 72.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny12341224364860SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 353.5953.4553.4653.57MIN: 53.22 / MAX: 63.24MIN: 53.13 / MAX: 62.94MIN: 53.21 / MAX: 55.97MIN: 53.26 / MAX: 61.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd12341020304050SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 346.1446.1746.2746.21MIN: 45.85 / MAX: 49.51MIN: 45.9 / MAX: 47.99MIN: 45.98 / MAX: 76.22MIN: 45.94 / MAX: 78.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m123448121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 314.4314.4314.4314.44MIN: 14.32 / MAX: 15.67MIN: 14.32 / MAX: 16.63MIN: 14.33 / MAX: 24.12MIN: 14.31 / MAX: 24.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet1234918273645SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 337.1537.1937.2937.27MIN: 36.86 / MAX: 38.04MIN: 36.98 / MAX: 39.44MIN: 37.06 / MAX: 47.19MIN: 37.03 / MAX: 46.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212343691215SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.889.869.869.89MIN: 9.69 / MAX: 11.52MIN: 9.72 / MAX: 11.28MIN: 9.71 / MAX: 11.14MIN: 9.72 / MAX: 11.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31234246810SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.058.048.088.07MIN: 7.93 / MAX: 17.96MIN: 7.93 / MAX: 9.28MIN: 7.97 / MAX: 10.22MIN: 7.95 / MAX: 10.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v21234246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.698.728.718.70MIN: 8.66 / MAX: 8.99MIN: 8.67 / MAX: 10.33MIN: 8.66 / MAX: 9.47MIN: 8.67 / MAX: 9.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet1234246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.457.467.467.47MIN: 7.38 / MAX: 8.87MIN: 7.4 / MAX: 8.12MIN: 7.4 / MAX: 8.09MIN: 7.41 / MAX: 8.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012343691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 313.2313.2913.3213.29MIN: 13.14 / MAX: 13.57MIN: 13.21 / MAX: 23.14MIN: 13.24 / MAX: 14.64MIN: 13.19 / MAX: 13.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface12340.48150.9631.44451.9262.4075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 32.132.142.142.14MIN: 2.11 / MAX: 2.18MIN: 2.12 / MAX: 2.33MIN: 2.11 / MAX: 2.22MIN: 2.11 / MAX: 2.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet1234714212835SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 327.6827.6827.6127.67MIN: 27.55 / MAX: 37.34MIN: 27.46 / MAX: 29.79MIN: 27.46 / MAX: 37.47MIN: 27.53 / MAX: 30.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg161234306090120150SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3152.91153.37153.21152.97MIN: 152.11 / MAX: 172.84MIN: 152.67 / MAX: 162.73MIN: 152.52 / MAX: 195.92MIN: 152.37 / MAX: 162.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet181234714212835SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 332.2432.2532.1732.18MIN: 32.01 / MAX: 33.9MIN: 32.02 / MAX: 41.15MIN: 31.95 / MAX: 33.02MIN: 32.03 / MAX: 32.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet1234612182430SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 326.8426.8426.8326.84MIN: 26.71 / MAX: 27.58MIN: 26.69 / MAX: 27.51MIN: 26.69 / MAX: 28.31MIN: 26.69 / MAX: 28.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet5012341428425670SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 362.5362.3862.4162.45MIN: 62.17 / MAX: 72.36MIN: 62.08 / MAX: 72.11MIN: 62.09 / MAX: 72.17MIN: 62.1 / MAX: 74.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny12341224364860SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 353.3953.5653.4853.46MIN: 53.18 / MAX: 62.88MIN: 53.2 / MAX: 55.47MIN: 53.24 / MAX: 55.7MIN: 53.23 / MAX: 55.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd12341020304050SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 346.0246.1246.1946.06MIN: 45.82 / MAX: 46.68MIN: 45.92 / MAX: 55.25MIN: 45.9 / MAX: 48.23MIN: 45.89 / MAX: 47.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m123448121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 314.4614.4414.4514.46MIN: 14.34 / MAX: 16.81MIN: 14.35 / MAX: 15.27MIN: 14.35 / MAX: 16.04MIN: 14.35 / MAX: 23.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread


Phoronix Test Suite v10.8.4