ncnn cassandra 5950X AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3601 BIOS) and AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2107275-PTS-NCNNCASS52&rdt&gru .
ncnn cassandra 5950X Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution 1 2 3 AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads) ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3601 BIOS) AMD Starship/Matisse 32GB 500GB Western Digital WDS500G3X0C-00SJG0 AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB (2100/875MHz) AMD Navi 10 HDMI Audio ASUS MG28U Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 20.04 5.14.0-rc1-clang-lto (x86_64) 20210717 GNOME Shell 3.36.9 X Server 1.20.9 4.6 Mesa 20.2.6 (LLVM 11.0.0) 1.2.131 GCC 9.3.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016 Java Details - OpenJDK Runtime Environment (build 11.0.11+9-Ubuntu-0ubuntu2.20.04) Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
ncnn cassandra 5950X cassandra: Reads cassandra: Writes cassandra: Mixed 1:1 cassandra: Mixed 1:3 ncnn: CPU - mobilenet ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU - shufflenet-v2 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - vgg16 ncnn: CPU - resnet18 ncnn: CPU - alexnet ncnn: CPU - resnet50 ncnn: CPU - yolov4-tiny ncnn: CPU - squeezenet_ssd ncnn: CPU - regnety_400m ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m 1 2 3 175683 190756 173084 166364 14.63 5.21 4.3 4.32 4.52 6.23 1.96 15.15 63.82 16.9 13.5 27.16 24.23 16.52 10.85 7.18 2.71 3.33 2.4 2.66 6.86 1.65 4.7 13.49 2.47 5.49 5.67 8.48 5.2 3.89 175052 193125 167904 165148 14.36 4.48 3.99 4.34 4.16 5.75 1.93 15.85 63.42 17.26 13.48 26.93 25.17 17.02 10.78 7.26 2.54 3.45 2.37 2.59 6.9 1.59 4.56 13.2 2.32 5.56 5.33 8.29 5.05 3.79 198730 188324 163427 168006 13.87 4.95 4.37 4.58 4.39 5.92 2.04 16.01 64.36 17.5 13.77 29.01 24.22 17.19 11.56 6.99 2.5 3.24 2.3 2.58 6.64 1.63 4.53 13.26 2.32 5.48 5.58 8.14 4.93 3.87 OpenBenchmarking.org
Apache Cassandra Test: Reads OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.0 Test: Reads 1 2 3 40K 80K 120K 160K 200K 175683 175052 198730
Apache Cassandra Test: Writes OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.0 Test: Writes 1 2 3 40K 80K 120K 160K 200K 190756 193125 188324
Apache Cassandra Test: Mixed 1:1 OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.0 Test: Mixed 1:1 1 2 3 40K 80K 120K 160K 200K 173084 167904 163427
Apache Cassandra Test: Mixed 1:3 OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.0 Test: Mixed 1:3 1 2 3 40K 80K 120K 160K 200K 166364 165148 168006
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: mobilenet 1 2 3 4 8 12 16 20 14.63 14.36 13.87 MIN: 12.93 / MAX: 54.4 MIN: 12.85 / MAX: 38.62 MIN: 12.35 / MAX: 30.23 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU-v2-v2 - Model: mobilenet-v2 1 2 3 1.1723 2.3446 3.5169 4.6892 5.8615 5.21 4.48 4.95 MIN: 4.24 / MAX: 109.78 MIN: 4.16 / MAX: 13.75 MIN: 4.27 / MAX: 21.38 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU-v3-v3 - Model: mobilenet-v3 1 2 3 0.9833 1.9666 2.9499 3.9332 4.9165 4.30 3.99 4.37 MIN: 3.84 / MAX: 16.16 MIN: 3.77 / MAX: 9.69 MIN: 3.87 / MAX: 26.03 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: shufflenet-v2 1 2 3 1.0305 2.061 3.0915 4.122 5.1525 4.32 4.34 4.58 MIN: 3.93 / MAX: 15.73 MIN: 4.1 / MAX: 10.19 MIN: 4.09 / MAX: 15.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: mnasnet 1 2 3 1.017 2.034 3.051 4.068 5.085 4.52 4.16 4.39 MIN: 3.9 / MAX: 22.01 MIN: 3.8 / MAX: 10.33 MIN: 3.79 / MAX: 13.9 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: efficientnet-b0 1 2 3 2 4 6 8 10 6.23 5.75 5.92 MIN: 5.34 / MAX: 72.99 MIN: 5.38 / MAX: 12.25 MIN: 5.35 / MAX: 18.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: blazeface 1 2 3 0.459 0.918 1.377 1.836 2.295 1.96 1.93 2.04 MIN: 1.81 / MAX: 5.95 MIN: 1.76 / MAX: 8.25 MIN: 1.8 / MAX: 10.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: googlenet 1 2 3 4 8 12 16 20 15.15 15.85 16.01 MIN: 12.78 / MAX: 112.25 MIN: 13.8 / MAX: 70.73 MIN: 13.52 / MAX: 64.94 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: vgg16 1 2 3 14 28 42 56 70 63.82 63.42 64.36 MIN: 56.83 / MAX: 105.85 MIN: 57.85 / MAX: 93.89 MIN: 58 / MAX: 84.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: resnet18 1 2 3 4 8 12 16 20 16.90 17.26 17.50 MIN: 15.02 / MAX: 39.07 MIN: 15.5 / MAX: 49.27 MIN: 15.64 / MAX: 39.17 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: alexnet 1 2 3 4 8 12 16 20 13.50 13.48 13.77 MIN: 12.05 / MAX: 67.43 MIN: 12.27 / MAX: 31.16 MIN: 11.87 / MAX: 31.19 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: resnet50 1 2 3 7 14 21 28 35 27.16 26.93 29.01 MIN: 23.86 / MAX: 54.88 MIN: 23.97 / MAX: 66.16 MIN: 25.32 / MAX: 110.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: yolov4-tiny 1 2 3 6 12 18 24 30 24.23 25.17 24.22 MIN: 20.95 / MAX: 87.12 MIN: 22.33 / MAX: 87.85 MIN: 21.89 / MAX: 40.45 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: squeezenet_ssd 1 2 3 4 8 12 16 20 16.52 17.02 17.19 MIN: 14.46 / MAX: 40.12 MIN: 14.16 / MAX: 75.75 MIN: 14.78 / MAX: 93.94 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: CPU - Model: regnety_400m 1 2 3 3 6 9 12 15 10.85 10.78 11.56 MIN: 9.97 / MAX: 23.43 MIN: 9.75 / MAX: 57.9 MIN: 9.81 / MAX: 105.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet 1 2 3 2 4 6 8 10 7.18 7.26 6.99 MIN: 6.41 / MAX: 21.11 MIN: 6.4 / MAX: 35.57 MIN: 6.42 / MAX: 22.29 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 1 2 3 0.6098 1.2196 1.8294 2.4392 3.049 2.71 2.54 2.50 MIN: 2.31 / MAX: 11.66 MIN: 2.41 / MAX: 4.31 MIN: 2.33 / MAX: 5.56 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 1 2 3 0.7763 1.5526 2.3289 3.1052 3.8815 3.33 3.45 3.24 MIN: 3.13 / MAX: 7.6 MIN: 3.14 / MAX: 18.86 MIN: 3.15 / MAX: 5.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 1 2 3 0.54 1.08 1.62 2.16 2.7 2.40 2.37 2.30 MIN: 2.07 / MAX: 9.74 MIN: 2.07 / MAX: 9.46 MIN: 2.09 / MAX: 7.29 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet 1 2 3 0.5985 1.197 1.7955 2.394 2.9925 2.66 2.59 2.58 MIN: 2.41 / MAX: 8.76 MIN: 2.42 / MAX: 6.96 MIN: 2.43 / MAX: 6.72 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 1 2 3 2 4 6 8 10 6.86 6.90 6.64 MIN: 6.34 / MAX: 15.78 MIN: 6.34 / MAX: 18.25 MIN: 6.33 / MAX: 10.96 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface 1 2 3 0.3713 0.7426 1.1139 1.4852 1.8565 1.65 1.59 1.63 MIN: 1.51 / MAX: 11.55 MIN: 1.5 / MAX: 8.92 MIN: 1.52 / MAX: 7.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet 1 2 3 1.0575 2.115 3.1725 4.23 5.2875 4.70 4.56 4.53 MIN: 4.2 / MAX: 12.82 MIN: 4.2 / MAX: 16.8 MIN: 4.21 / MAX: 18.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 1 2 3 3 6 9 12 15 13.49 13.20 13.26 MIN: 12.61 / MAX: 26.03 MIN: 12.55 / MAX: 20.38 MIN: 12.59 / MAX: 24.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 1 2 3 0.5558 1.1116 1.6674 2.2232 2.779 2.47 2.32 2.32 MIN: 1.94 / MAX: 16.53 MIN: 1.93 / MAX: 11.99 MIN: 1.93 / MAX: 13.14 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet 1 2 3 1.251 2.502 3.753 5.004 6.255 5.49 5.56 5.48 MIN: 4.95 / MAX: 15.59 MIN: 4.9 / MAX: 13.49 MIN: 4.95 / MAX: 13.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 1 2 3 1.2758 2.5516 3.8274 5.1032 6.379 5.67 5.33 5.58 MIN: 4.75 / MAX: 21.14 MIN: 4.74 / MAX: 17.6 MIN: 4.75 / MAX: 20.01 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny 1 2 3 2 4 6 8 10 8.48 8.29 8.14 MIN: 7.5 / MAX: 36.82 MIN: 7.46 / MAX: 39.31 MIN: 7.49 / MAX: 20.22 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd 1 2 3 1.17 2.34 3.51 4.68 5.85 5.20 5.05 4.93 MIN: 3.89 / MAX: 21.83 MIN: 3.89 / MAX: 13.39 MIN: 3.89 / MAX: 17.64 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m 1 2 3 0.8753 1.7506 2.6259 3.5012 4.3765 3.89 3.79 3.87 MIN: 3.52 / MAX: 13.5 MIN: 3.52 / MAX: 12.63 MIN: 3.52 / MAX: 16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Phoronix Test Suite v10.8.4