icelake ncnn cassandra

Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 3GB on Ubuntu 21.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2107288-IB-ICELAKENC02&grw&rdt.

icelake ncnn cassandraProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolution123Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads)Dell 06CDVY (1.0.9 BIOS)Intel Ice Lake-LP DRAM16GBToshiba KBG40ZPZ512G NVMe 512GBIntel Iris Plus ICL GT2 3GB (1100MHz)Realtek ALC289Intel Killer Wi-Fi 6 AX1650i 160MHzUbuntu 21.045.13.0-051300-generic (x86_64)GNOME Shell 3.38.4X Server + Wayland4.6 Mesa 21.2.0-devel (git-4698755 2021-07-03 hirsute-oibaf-ppa)1.2.182GCC 10.3.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xa6 - Thermald 2.4.3Java Details- OpenJDK Runtime Environment (build 11.0.11+9-Ubuntu-0ubuntu2)Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

icelake ncnn cassandrancnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mcassandra: Readscassandra: Writescassandra: Mixed 1:1cassandra: Mixed 1:312328.196.205.925.646.2010.032.3322.5672.8521.3719.1243.4839.5335.8613.2021.4512.4815.4513.7312.8716.704.4816.9479.4415.6716.2732.6239.8221.4816.002359327648218722076628.786.336.105.736.2310.182.2521.6971.5321.1918.5441.8841.5835.2312.7921.3712.2815.3413.8413.1116.664.3717.2479.6015.7016.3032.6940.6021.4816.102365627257220492121028.267.156.365.966.4810.452.4323.4074.1321.7519.0042.8240.8536.2413.5221.5213.1515.5713.9213.5616.654.6416.8179.5615.6716.3232.6738.8520.4116.3924281287452219421438OpenBenchmarking.org

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet123714212835SE +/- 0.50, N = 15SE +/- 0.22, N = 3SE +/- 0.48, N = 1228.1928.7828.26MIN: 22.05 / MAX: 45.97MIN: 27 / MAX: 40.58MIN: 22.31 / MAX: 44.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v2123246810SE +/- 0.12, N = 15SE +/- 0.38, N = 3SE +/- 0.27, N = 126.206.337.15MIN: 5.34 / MAX: 20.3MIN: 5.37 / MAX: 19.7MIN: 5.05 / MAX: 21.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v3123246810SE +/- 0.21, N = 14SE +/- 0.60, N = 3SE +/- 0.22, N = 125.926.106.36MIN: 4.75 / MAX: 19.39MIN: 4.75 / MAX: 20.76MIN: 4.46 / MAX: 19.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v21231.3412.6824.0235.3646.705SE +/- 0.22, N = 15SE +/- 0.63, N = 3SE +/- 0.20, N = 125.645.735.96MIN: 4.29 / MAX: 19.1MIN: 4.3 / MAX: 20.93MIN: 4.14 / MAX: 21.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet123246810SE +/- 0.23, N = 15SE +/- 0.63, N = 3SE +/- 0.23, N = 126.206.236.48MIN: 4.83 / MAX: 23.26MIN: 4.82 / MAX: 19.18MIN: 4.49 / MAX: 23.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b01233691215SE +/- 0.34, N = 15SE +/- 1.02, N = 3SE +/- 0.38, N = 1210.0310.1810.45MIN: 7.81 / MAX: 24.03MIN: 7.84 / MAX: 23.27MIN: 7.33 / MAX: 27.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface1230.54681.09361.64042.18722.734SE +/- 0.06, N = 15SE +/- 0.23, N = 3SE +/- 0.07, N = 122.332.252.43MIN: 1.77 / MAX: 14.3MIN: 1.72 / MAX: 14.34MIN: 1.64 / MAX: 14.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet123612182430SE +/- 0.65, N = 15SE +/- 2.48, N = 3SE +/- 0.75, N = 1222.5621.6923.40MIN: 16.83 / MAX: 46.01MIN: 16.25 / MAX: 36.41MIN: 15.64 / MAX: 40.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg161231632486480SE +/- 1.21, N = 15SE +/- 4.10, N = 3SE +/- 0.96, N = 1272.8571.5374.13MIN: 60.72 / MAX: 179.67MIN: 59.49 / MAX: 87.88MIN: 58.27 / MAX: 91.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet18123510152025SE +/- 0.62, N = 15SE +/- 2.29, N = 3SE +/- 0.73, N = 1221.3721.1921.75MIN: 16.45 / MAX: 39.78MIN: 16.22 / MAX: 35.58MIN: 15.46 / MAX: 39.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet123510152025SE +/- 0.41, N = 15SE +/- 1.61, N = 3SE +/- 0.49, N = 1219.1218.5419.00MIN: 15.18 / MAX: 33.13MIN: 14.92 / MAX: 31.05MIN: 14.8 / MAX: 32.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet501231020304050SE +/- 0.76, N = 15SE +/- 2.83, N = 3SE +/- 0.99, N = 1243.4841.8842.82MIN: 31.82 / MAX: 62.09MIN: 34.21 / MAX: 60.92MIN: 34.18 / MAX: 64.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny123918273645SE +/- 0.79, N = 15SE +/- 0.21, N = 3SE +/- 0.68, N = 1239.5341.5840.85MIN: 31.81 / MAX: 63.67MIN: 39.14 / MAX: 55.45MIN: 32.55 / MAX: 62.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd123816243240SE +/- 0.59, N = 15SE +/- 1.88, N = 3SE +/- 0.63, N = 1235.8635.2336.24MIN: 28.46 / MAX: 153.47MIN: 28.88 / MAX: 52.05MIN: 29 / MAX: 53.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m1233691215SE +/- 0.26, N = 15SE +/- 0.99, N = 3SE +/- 0.33, N = 1213.2012.7913.52MIN: 10.44 / MAX: 51MIN: 10.39 / MAX: 25.33MIN: 9.5 / MAX: 30.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mobilenet123510152025SE +/- 0.27, N = 12SE +/- 0.20, N = 3SE +/- 0.24, N = 521.4521.3721.52MIN: 18.93 / MAX: 33.09MIN: 18.97 / MAX: 26.87MIN: 18.79 / MAX: 29.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21233691215SE +/- 0.22, N = 12SE +/- 0.31, N = 3SE +/- 0.29, N = 512.4812.2813.15MIN: 7 / MAX: 15.85MIN: 10.89 / MAX: 13.33MIN: 10.79 / MAX: 15.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v3-v3 - Model: mobilenet-v312348121620SE +/- 0.05, N = 12SE +/- 0.04, N = 3SE +/- 0.05, N = 515.4515.3415.57MIN: 13.93 / MAX: 17.14MIN: 14.66 / MAX: 16.6MIN: 14.65 / MAX: 181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: shufflenet-v212348121620SE +/- 0.25, N = 12SE +/- 0.80, N = 3SE +/- 0.16, N = 513.7313.8413.92MIN: 11.32 / MAX: 15.75MIN: 11.69 / MAX: 15.76MIN: 10.67 / MAX: 15.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mnasnet1233691215SE +/- 0.16, N = 12SE +/- 0.34, N = 3SE +/- 0.36, N = 512.8713.1113.56MIN: 10.9 / MAX: 16.03MIN: 11.84 / MAX: 15.92MIN: 10.76 / MAX: 16.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: efficientnet-b012348121620SE +/- 0.05, N = 12SE +/- 0.04, N = 3SE +/- 0.03, N = 516.7016.6616.65MIN: 15.68 / MAX: 21.16MIN: 16.21 / MAX: 20.41MIN: 15.91 / MAX: 20.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: blazeface1231.0442.0883.1324.1765.22SE +/- 0.09, N = 12SE +/- 0.07, N = 3SE +/- 0.09, N = 54.484.374.64MIN: 3.14 / MAX: 9.77MIN: 3.36 / MAX: 5.48MIN: 3.16 / MAX: 10.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: googlenet12348121620SE +/- 0.04, N = 12SE +/- 0.41, N = 3SE +/- 0.02, N = 516.9417.2416.81MIN: 16.22 / MAX: 20.55MIN: 16.27 / MAX: 20.43MIN: 15.9 / MAX: 20.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: vgg1612320406080100SE +/- 0.03, N = 12SE +/- 0.12, N = 3SE +/- 0.07, N = 579.4479.6079.56MIN: 76.46 / MAX: 85.97MIN: 76.97 / MAX: 81.14MIN: 77.23 / MAX: 80.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet1812348121620SE +/- 0.01, N = 12SE +/- 0.03, N = 3SE +/- 0.04, N = 515.6715.7015.67MIN: 14.92 / MAX: 17.78MIN: 15.22 / MAX: 17.27MIN: 15.14 / MAX: 16.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: alexnet12348121620SE +/- 0.01, N = 12SE +/- 0.04, N = 3SE +/- 0.01, N = 516.2716.3016.32MIN: 15.5 / MAX: 17.41MIN: 15.15 / MAX: 16.85MIN: 15.65 / MAX: 16.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet50123816243240SE +/- 0.01, N = 12SE +/- 0.05, N = 3SE +/- 0.04, N = 532.6232.6932.67MIN: 32.08 / MAX: 33.63MIN: 32.07 / MAX: 33.82MIN: 31.75 / MAX: 33.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: yolov4-tiny123918273645SE +/- 0.31, N = 12SE +/- 0.39, N = 3SE +/- 0.86, N = 539.8240.6038.85MIN: 28.95 / MAX: 62.59MIN: 29.55 / MAX: 68.37MIN: 28.81 / MAX: 55.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: squeezenet_ssd123510152025SE +/- 0.01, N = 12SE +/- 0.01, N = 3SE +/- 0.02, N = 521.4821.4820.41MIN: 20.91 / MAX: 29.64MIN: 20.92 / MAX: 26.24MIN: 19.98 / MAX: 28.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: regnety_400m12348121620SE +/- 0.13, N = 11SE +/- 0.29, N = 3SE +/- 0.01, N = 516.0016.1016.39MIN: 13.92 / MAX: 18.26MIN: 14.75 / MAX: 18.22MIN: 15.92 / MAX: 17.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Apache Cassandra

Test: Reads

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads1235K10K15K20K25KSE +/- 638.89, N = 12SE +/- 726.45, N = 12SE +/- 635.86, N = 12235932365624281

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes1236K12K18K24K30KSE +/- 227.31, N = 9SE +/- 191.38, N = 12SE +/- 371.39, N = 3276482725728745

Apache Cassandra

Test: Mixed 1:1

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:11235K10K15K20K25KSE +/- 230.65, N = 12SE +/- 263.07, N = 12SE +/- 265.83, N = 12218722204922194

Apache Cassandra

Test: Mixed 1:3

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:31235K10K15K20K25KSE +/- 385.43, N = 12SE +/- 359.53, N = 12SE +/- 391.39, N = 12207662121021438

Phoronix Test Suite v10.8.5