tigerlake ncnn cassandra

Intel Core i7-1165G7 testing with a Dell 0GG9PT (3.0.3 BIOS) and Intel Xe TGL GT2 3GB on Ubuntu 21.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2107284-IB-TIGERLAKE93&grs.

tigerlake ncnn cassandraProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolution1234Intel Core i7-1165G7 @ 4.70GHz (4 Cores / 8 Threads)Dell 0GG9PT (3.0.3 BIOS)Intel Tiger Lake-LP16GBKioxia KBG40ZNS256G NVMe 256GBIntel Xe TGL GT2 3GB (1300MHz)Realtek ALC289Intel Wi-Fi 6 AX201Ubuntu 21.045.13.0-051300-generic (x86_64)GNOME Shell 3.38.4X Server + Wayland4.6 Mesa 21.2.0-devel (git-dd98918 2021-07-12 hirsute-oibaf-ppa)1.2.182GCC 10.3.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x88 - Thermald 2.4.3Java Details- OpenJDK Runtime Environment (build 11.0.11+9-Ubuntu-0ubuntu2)Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

tigerlake ncnn cassandrancnn: CPU - blazefacencnn: CPU - regnety_400mncnn: CPU - efficientnet-b0ncnn: CPU - googlenetncnn: CPU - resnet18ncnn: CPU - squeezenet_ssdncnn: CPU - alexnetncnn: CPU - yolov4-tinyncnn: CPU - mobilenetncnn: CPU - resnet50cassandra: Writesncnn: CPU - vgg16ncnn: Vulkan GPU - googlenetncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - resnet50cassandra: Mixed 1:1cassandra: Mixed 1:3ncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU - vgg16cassandra: Readsncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - shufflenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU-v2-v2 - mobilenet-v212341.589.586.8714.6614.1925.8513.0229.4120.7630.184790654.816.4312.8419.5816.4215.7711.9345.9911.2415.5115.27339083340711.6236.7236312123.0114.124.384.424.215.161.589.546.9314.6914.2325.5513.0529.2620.7329.834873254.9317.4512.7321.1816.3415.5311.9342.6311.1314.7215.21329323265011.4936.783860414.892.9911.474.394.424.165.12.3513.649.6420.3718.7633.2816.7636.6025.8337.104041165.7316.0012.2120.4316.7015.3311.7642.7811.4515.7315.5711.6636.793172513.282.9912.145.755.785.366.412.3213.659.7020.4318.7733.1716.7836.2325.6136.8865.7915.3911.5821.7115.2014.3710.9143.9811.9115.0015.7011.4436.8614.153.079.616.336.325.626.48OpenBenchmarking.org

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface12340.52881.05761.58642.11522.644SE +/- 0.01, N = 3SE +/- 0.02, N = 31.581.582.352.32MIN: 1.55 / MAX: 1.81MIN: 1.55 / MAX: 1.82MIN: 2.27 / MAX: 11.55MIN: 2.24 / MAX: 8.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m123448121620SE +/- 0.00, N = 3SE +/- 0.01, N = 39.589.5413.6413.65MIN: 9.41 / MAX: 21.37MIN: 9.39 / MAX: 22.14MIN: 13.29 / MAX: 25.27MIN: 13.33 / MAX: 25.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b012343691215SE +/- 0.03, N = 3SE +/- 0.04, N = 36.876.939.649.70MIN: 6.78 / MAX: 10.6MIN: 6.81 / MAX: 17.97MIN: 9.24 / MAX: 21.07MIN: 9.37 / MAX: 21.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet1234510152025SE +/- 0.04, N = 3SE +/- 0.04, N = 314.6614.6920.3720.43MIN: 14.52 / MAX: 26.1MIN: 14.46 / MAX: 25.44MIN: 19.94 / MAX: 32.31MIN: 19.79 / MAX: 37.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet181234510152025SE +/- 0.02, N = 3SE +/- 0.03, N = 314.1914.2318.7618.77MIN: 13.87 / MAX: 25.18MIN: 13.85 / MAX: 25.47MIN: 18.3 / MAX: 30.77MIN: 18.35 / MAX: 31.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd1234816243240SE +/- 0.15, N = 3SE +/- 0.07, N = 325.8525.5533.2833.17MIN: 25.11 / MAX: 35.16MIN: 24.94 / MAX: 37.73MIN: 32.43 / MAX: 44.71MIN: 32.55 / MAX: 51.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet123448121620SE +/- 0.05, N = 3SE +/- 0.03, N = 313.0213.0516.7616.78MIN: 12.74 / MAX: 16.73MIN: 12.71 / MAX: 22.09MIN: 16.36 / MAX: 28.34MIN: 16.43 / MAX: 27.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny1234816243240SE +/- 0.27, N = 3SE +/- 0.08, N = 329.4129.2636.6036.23MIN: 28.58 / MAX: 41.83MIN: 28.32 / MAX: 40.02MIN: 35.29 / MAX: 48.79MIN: 35.39 / MAX: 49.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet1234612182430SE +/- 0.25, N = 3SE +/- 0.06, N = 320.7620.7325.8325.61MIN: 20.21 / MAX: 31.73MIN: 20.16 / MAX: 31.55MIN: 24.93 / MAX: 39.44MIN: 24.96 / MAX: 39.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet501234918273645SE +/- 0.23, N = 3SE +/- 0.03, N = 330.1829.8337.1036.88MIN: 28.19 / MAX: 42.88MIN: 27.81 / MAX: 41.79MIN: 36.02 / MAX: 90.9MIN: 36.04 / MAX: 52.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes12310K20K30K40K50KSE +/- 108.17, N = 3479064873240411

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg1612341530456075SE +/- 0.31, N = 3SE +/- 0.02, N = 354.8054.9365.7365.79MIN: 53.87 / MAX: 66.81MIN: 54.22 / MAX: 65.37MIN: 63.4 / MAX: 82.52MIN: 63.74 / MAX: 172.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: googlenet123448121620SE +/- 0.22, N = 3SE +/- 0.14, N = 316.4317.4516.0015.39MIN: 16.08 / MAX: 17.64MIN: 17.24 / MAX: 18.17MIN: 15.05 / MAX: 18.21MIN: 14.17 / MAX: 18.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet1812343691215SE +/- 0.31, N = 3SE +/- 0.22, N = 312.8412.7312.2111.58MIN: 12.38 / MAX: 13.09MIN: 11.03 / MAX: 15.29MIN: 11.12 / MAX: 13.08MIN: 10.83 / MAX: 12.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mobilenet1234510152025SE +/- 0.12, N = 3SE +/- 0.23, N = 319.5821.1820.4321.71MIN: 17.39 / MAX: 27.41MIN: 17.49 / MAX: 31.49MIN: 16.5 / MAX: 30.15MIN: 17.43 / MAX: 37.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: efficientnet-b0123448121620SE +/- 0.28, N = 3SE +/- 0.25, N = 316.4216.3416.7015.20MIN: 16.16 / MAX: 18.42MIN: 15.22 / MAX: 18.97MIN: 15.67 / MAX: 19.67MIN: 13.79 / MAX: 19.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3123448121620SE +/- 0.30, N = 3SE +/- 0.43, N = 315.7715.5315.3314.37MIN: 14.57 / MAX: 16.84MIN: 14.5 / MAX: 16.15MIN: 14.22 / MAX: 16.99MIN: 12.6 / MAX: 16.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mnasnet12343691215SE +/- 0.09, N = 3SE +/- 0.06, N = 311.9311.9311.7610.91MIN: 11.57 / MAX: 12.12MIN: 11.63 / MAX: 12.39MIN: 10.37 / MAX: 13.13MIN: 10.29 / MAX: 12.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: yolov4-tiny12341020304050SE +/- 0.71, N = 3SE +/- 0.10, N = 345.9942.6342.7843.98MIN: 30 / MAX: 62.2MIN: 27.86 / MAX: 56.53MIN: 27.08 / MAX: 63.78MIN: 28.09 / MAX: 72.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: alexnet12343691215SE +/- 0.09, N = 3SE +/- 0.38, N = 311.2411.1311.4511.91MIN: 10.22 / MAX: 15.13MIN: 10.17 / MAX: 14.29MIN: 10.23 / MAX: 15.09MIN: 10.69 / MAX: 14.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: regnety_400m123448121620SE +/- 0.34, N = 3SE +/- 0.30, N = 315.5114.7215.7315.00MIN: 14.64 / MAX: 16.49MIN: 14.07 / MAX: 14.92MIN: 14.39 / MAX: 17.03MIN: 13.17 / MAX: 16.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet50123448121620SE +/- 0.12, N = 2SE +/- 0.05, N = 315.2715.2115.5715.70MIN: 14.66 / MAX: 15.6MIN: 14.33 / MAX: 15.56MIN: 14.83 / MAX: 16.09MIN: 14.71 / MAX: 16.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Apache Cassandra

Test: Mixed 1:1

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:1127K14K21K28K35K3390832932

Apache Cassandra

Test: Mixed 1:3

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:3127K14K21K28K35K3340732650

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212343691215SE +/- 0.06, N = 3SE +/- 0.07, N = 311.6211.4911.6611.44MIN: 10.36 / MAX: 13.31MIN: 10.23 / MAX: 15.56MIN: 10.25 / MAX: 13.43MIN: 10.04 / MAX: 12.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: vgg161234816243240SE +/- 0.05, N = 3SE +/- 0.01, N = 336.7236.7836.7936.86MIN: 36 / MAX: 37.31MIN: 36.33 / MAX: 37.58MIN: 35.93 / MAX: 37.31MIN: 36.04 / MAX: 37.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Apache Cassandra

Test: Reads

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads1238K16K24K32K40KSE +/- 804.65, N = 12363123860431725

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: squeezenet_ssd123448121620SE +/- 0.80, N = 3SE +/- 1.01, N = 312.0014.8913.2814.15MIN: 11.4 / MAX: 12.65MIN: 13.1 / MAX: 25.87MIN: 11.64 / MAX: 15.59MIN: 11.78 / MAX: 17.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: blazeface12340.69081.38162.07242.76323.454SE +/- 0.23, N = 3SE +/- 0.18, N = 33.012.992.993.07MIN: 2.39 / MAX: 4.02MIN: 2.37 / MAX: 4.31MIN: 2.38 / MAX: 7.68MIN: 2.37 / MAX: 4.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: shufflenet-v2123448121620SE +/- 1.25, N = 3SE +/- 0.62, N = 314.1211.4712.149.61MIN: 13.69 / MAX: 16.12MIN: 7.66 / MAX: 19.94MIN: 8.42 / MAX: 18.12MIN: 7.62 / MAX: 14.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet1234246810SE +/- 0.66, N = 3SE +/- 0.04, N = 24.384.395.756.33MIN: 4.24 / MAX: 15.06MIN: 4.29 / MAX: 12.65MIN: 4.27 / MAX: 18.15MIN: 5.9 / MAX: 16.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v21234246810SE +/- 0.64, N = 3SE +/- 0.02, N = 34.424.425.786.32MIN: 4.32 / MAX: 7.16MIN: 4.3 / MAX: 7.83MIN: 4.33 / MAX: 17.73MIN: 5.92 / MAX: 17.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v312341.26452.5293.79355.0586.3225SE +/- 0.56, N = 3SE +/- 0.33, N = 34.214.165.365.62MIN: 4.1 / MAX: 11.21MIN: 4.09 / MAX: 8.27MIN: 4.11 / MAX: 17.33MIN: 4.13 / MAX: 16.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v21234246810SE +/- 0.62, N = 3SE +/- 0.61, N = 35.165.106.416.48MIN: 5.07 / MAX: 13.41MIN: 5 / MAX: 8.58MIN: 5.06 / MAX: 19.58MIN: 5.07 / MAX: 17.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Phoronix Test Suite v10.8.4