TR 2970WX NN + More AMD Ryzen Threadripper 2970WX 24-Core testing with a Gigabyte X399 AORUS Gaming 7 (F12h BIOS) and Sapphire AMD Radeon RX 550 640SP / 560/560X 4GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2009264-FI-TR2970WXN17&grs&sor .
TR 2970WX NN + More Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat AMD Ryzen Threadripper 2970WX 24-Core @ 3.00GHz (24 Cores / 48 Threads) Gigabyte X399 AORUS Gaming 7 (F12h BIOS) AMD 17h 16GB 120GB Corsair Force MP500 Sapphire AMD Radeon RX 550 640SP / 560/560X 4GB (1300/1750MHz) Realtek ALC1220 DELL S2409W Qualcomm Atheros Killer E2500 + 2 x QLogic cLOM8214 1/10GbE + Intel 8265 / 8275 Ubuntu 20.04 5.8.0-050800-generic (x86_64) GNOME Shell 3.36.4 X Server 1.20.8 modesetting 1.20.8 4.6 Mesa 20.0.8 (LLVM 10.0.0) GCC 9.3.0 ext4 1920x1080 5.9.0-050900rc6daily20200926-generic (x86_64) 20200925 OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x800820d Graphics Details - GLAMOR Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected
TR 2970WX NN + More osbench: Create Threads ncnn: Vulkan GPU - blazeface osbench: Create Processes osbench: Create Files ncnn: CPU - blazeface influxdb: 4 - 10000 - 2,5000,1 - 10000 osbench: Launch Programs ncnn: Vulkan GPU - squeezenet webp: Quality 100, Lossless, Highest Compression ncnn: Vulkan GPU - alexnet couchdb: 100 - 1000 - 24 osbench: Memory Allocations ncnn: CPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 webp: Quality 100 webp: Quality 100, Lossless ncnn: Vulkan GPU - shufflenet-v2 webp: Default ncnn: Vulkan GPU - mnasnet influxdb: 1024 - 10000 - 2,5000,1 - 10000 ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - resnet50 influxdb: 64 - 10000 - 2,5000,1 - 10000 webp: Quality 100, Highest Compression ncnn: Vulkan GPU - mobilenet libraw: Post-Processing Benchmark realsr-ncnn: 4x - No tnn: CPU - SqueezeNet v1.1 tnn: CPU - MobileNet v2 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 realsr-ncnn: 4x - Yes ncnn: CPU - yolov4-tiny ncnn: CPU - resnet50 ncnn: CPU - alexnet ncnn: CPU - resnet18 ncnn: CPU - vgg16 ncnn: CPU - googlenet ncnn: CPU - efficientnet-b0 ncnn: CPU - shufflenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU - mobilenet ncnn: CPU - squeezenet espeak: Text-To-Speech Synthesis Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 16.332467 2.17 38.786729 15.492504 5.01 1020198.3 64.817270 28.97 38.421 20.23 122.375 79.048316 12.08 20.82 2.457 18.759 6.44 1.610 10.21 1266364.3 27.05 19.80 45.96 1245572.3 7.775 22.16 30.82 124.758 258.424 294.939 44.18 134.01 9.46 10.97 974.000 52.34 60.11 38.52 36.96 91.54 36.91 16.51 13.05 12.92 13.69 31.18 30.66 34.343 17.846107 2.27 40.818850 15.940509 5.11 996638.1 65.773130 28.60 39.254 20.28 124.279 77.799638 12.18 20.83 2.445 18.599 6.46 1.626 10.16 1256621.9 27.20 19.65 45.66 1243255.8 7.732 22.09 30.77 124.359 259.009 295.263 44.16 133.85 9.45 10.96 974.343 51.08 71.67 37.00 52.28 95.74 42.47 18.58 13.48 13.33 14.06 32.25 34.10 33.421 16.439914 2.15 40.656725 16.183030 4.95 995507.3 66.293081 28.35 38.578 20.59 124.452 78.763008 11.99 20.51 2.483 18.526 6.52 1.607 10.28 1251920.4 26.90 19.75 45.84 1238007.3 7.754 22.05 30.90 124.383 258.216 295.805 44.06 133.74 9.46 10.97 974.386 51.32 65.65 35.66 58.59 99.70 39.01 17.50 13.95 13.43 16.22 32.87 32.95 33.273 OpenBenchmarking.org
OSBench Test: Create Threads OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Threads Linux 5.8 Linux 5.9 Git Repeat Linux 5.9 Git 4 8 12 16 20 SE +/- 0.17, N = 3 SE +/- 0.20, N = 5 SE +/- 0.16, N = 15 16.33 16.44 17.85 1. (CC) gcc options: -lm
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: blazeface Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 0.5108 1.0216 1.5324 2.0432 2.554 SE +/- 0.03, N = 3 SE +/- 0.03, N = 15 SE +/- 0.03, N = 4 2.15 2.17 2.27 MIN: 1.82 / MAX: 3.74 MIN: 1.83 / MAX: 5.86 MIN: 2.01 / MAX: 7.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OSBench Test: Create Processes OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Processes Linux 5.8 Linux 5.9 Git Repeat Linux 5.9 Git 9 18 27 36 45 SE +/- 0.08, N = 3 SE +/- 0.61, N = 3 SE +/- 0.56, N = 3 38.79 40.66 40.82 1. (CC) gcc options: -lm
OSBench Test: Create Files OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Files Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 15.49 15.94 16.18 1. (CC) gcc options: -lm
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: blazeface Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 1.1498 2.2996 3.4494 4.5992 5.749 SE +/- 0.06, N = 12 SE +/- 0.15, N = 3 SE +/- 0.07, N = 12 4.95 5.01 5.11 MIN: 4.59 / MAX: 37.49 MIN: 4.64 / MAX: 7.94 MIN: 4.64 / MAX: 32.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
InfluxDB Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 OpenBenchmarking.org val/sec, More Is Better InfluxDB 1.8.2 Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 200K 400K 600K 800K 1000K SE +/- 2790.54, N = 3 SE +/- 12156.00, N = 3 SE +/- 7784.44, N = 3 1020198.3 996638.1 995507.3
OSBench Test: Launch Programs OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Launch Programs Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 15 30 45 60 75 SE +/- 0.33, N = 3 SE +/- 0.95, N = 4 SE +/- 0.15, N = 3 64.82 65.77 66.29 1. (CC) gcc options: -lm
NCNN Target: Vulkan GPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: squeezenet Linux 5.9 Git Repeat Linux 5.9 Git Linux 5.8 7 14 21 28 35 SE +/- 0.16, N = 3 SE +/- 0.37, N = 4 SE +/- 0.24, N = 15 28.35 28.60 28.97 MIN: 27.06 / MAX: 36.04 MIN: 26.77 / MAX: 37.15 MIN: 26.62 / MAX: 36.99 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
WebP Image Encode Encode Settings: Quality 100, Lossless, Highest Compression OpenBenchmarking.org Encode Time - Seconds, Fewer Is Better WebP Image Encode 1.1 Encode Settings: Quality 100, Lossless, Highest Compression Linux 5.8 Linux 5.9 Git Repeat Linux 5.9 Git 9 18 27 36 45 SE +/- 0.13, N = 3 SE +/- 0.17, N = 3 SE +/- 0.11, N = 3 38.42 38.58 39.25 1. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: alexnet Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 5 10 15 20 25 SE +/- 0.05, N = 15 SE +/- 0.17, N = 4 SE +/- 0.45, N = 3 20.23 20.28 20.59 MIN: 19.47 / MAX: 28.79 MIN: 19.51 / MAX: 28.12 MIN: 19.38 / MAX: 28.43 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Apache CouchDB Bulk Size: 100 - Inserts: 1000 - Rounds: 24 OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.1.1 Bulk Size: 100 - Inserts: 1000 - Rounds: 24 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 30 60 90 120 150 SE +/- 0.88, N = 3 SE +/- 1.07, N = 3 SE +/- 1.77, N = 3 122.38 124.28 124.45 1. (CXX) g++ options: -std=c++14 -lmozjs-68 -lm -lerl_interface -lei -fPIC -MMD
OSBench Test: Memory Allocations OpenBenchmarking.org Ns Per Event, Fewer Is Better OSBench Test: Memory Allocations Linux 5.9 Git Linux 5.9 Git Repeat Linux 5.8 20 40 60 80 100 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 3 77.80 78.76 79.05 1. (CC) gcc options: -lm
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mnasnet Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 3 6 9 12 15 SE +/- 0.18, N = 12 SE +/- 0.15, N = 3 SE +/- 0.12, N = 12 11.99 12.08 12.18 MIN: 10.89 / MAX: 342.44 MIN: 11.18 / MAX: 46.41 MIN: 11.24 / MAX: 110.31 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: efficientnet-b0 Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.11, N = 15 SE +/- 0.15, N = 4 20.51 20.82 20.83 MIN: 19.52 / MAX: 23.32 MIN: 18.95 / MAX: 26.73 MIN: 19.63 / MAX: 25.15 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
WebP Image Encode Encode Settings: Quality 100 OpenBenchmarking.org Encode Time - Seconds, Fewer Is Better WebP Image Encode 1.1 Encode Settings: Quality 100 Linux 5.9 Git Linux 5.8 Linux 5.9 Git Repeat 0.5587 1.1174 1.6761 2.2348 2.7935 SE +/- 0.007, N = 3 SE +/- 0.011, N = 3 SE +/- 0.013, N = 3 2.445 2.457 2.483 1. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff
WebP Image Encode Encode Settings: Quality 100, Lossless OpenBenchmarking.org Encode Time - Seconds, Fewer Is Better WebP Image Encode 1.1 Encode Settings: Quality 100, Lossless Linux 5.9 Git Repeat Linux 5.9 Git Linux 5.8 5 10 15 20 25 SE +/- 0.23, N = 3 SE +/- 0.26, N = 4 SE +/- 0.03, N = 3 18.53 18.60 18.76 1. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: shufflenet-v2 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 2 4 6 8 10 SE +/- 0.01, N = 15 SE +/- 0.05, N = 4 SE +/- 0.08, N = 3 6.44 6.46 6.52 MIN: 5.62 / MAX: 9.35 MIN: 5.73 / MAX: 9.16 MIN: 5.75 / MAX: 8.72 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
WebP Image Encode Encode Settings: Default OpenBenchmarking.org Encode Time - Seconds, Fewer Is Better WebP Image Encode 1.1 Encode Settings: Default Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 0.3659 0.7318 1.0977 1.4636 1.8295 SE +/- 0.000, N = 3 SE +/- 0.002, N = 3 SE +/- 0.001, N = 3 1.607 1.610 1.626 1. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: mnasnet Linux 5.9 Git Linux 5.8 Linux 5.9 Git Repeat 3 6 9 12 15 SE +/- 0.03, N = 4 SE +/- 0.03, N = 15 SE +/- 0.16, N = 3 10.16 10.21 10.28 MIN: 9.48 / MAX: 13.93 MIN: 9.55 / MAX: 16 MIN: 9.54 / MAX: 14.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
InfluxDB Concurrent Streams: 1024 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 OpenBenchmarking.org val/sec, More Is Better InfluxDB 1.8.2 Concurrent Streams: 1024 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 300K 600K 900K 1200K 1500K SE +/- 13092.34, N = 3 SE +/- 2116.83, N = 3 SE +/- 1710.08, N = 3 1266364.3 1256621.9 1251920.4
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: googlenet Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.04, N = 15 SE +/- 0.22, N = 4 26.90 27.05 27.20 MIN: 26.12 / MAX: 39.16 MIN: 25.23 / MAX: 33.38 MIN: 25.89 / MAX: 33.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: resnet18 Linux 5.9 Git Linux 5.9 Git Repeat Linux 5.8 5 10 15 20 25 SE +/- 0.11, N = 4 SE +/- 0.13, N = 3 SE +/- 0.09, N = 15 19.65 19.75 19.80 MIN: 19.06 / MAX: 22.8 MIN: 19.07 / MAX: 22.67 MIN: 18.98 / MAX: 28.54 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: resnet50 Linux 5.9 Git Linux 5.9 Git Repeat Linux 5.8 10 20 30 40 50 SE +/- 0.04, N = 4 SE +/- 0.15, N = 3 SE +/- 0.07, N = 15 45.66 45.84 45.96 MIN: 44.45 / MAX: 51.45 MIN: 44.72 / MAX: 49.5 MIN: 44.53 / MAX: 59.57 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
InfluxDB Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 OpenBenchmarking.org val/sec, More Is Better InfluxDB 1.8.2 Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 300K 600K 900K 1200K 1500K SE +/- 4132.64, N = 3 SE +/- 2224.57, N = 3 SE +/- 2080.28, N = 3 1245572.3 1243255.8 1238007.3
WebP Image Encode Encode Settings: Quality 100, Highest Compression OpenBenchmarking.org Encode Time - Seconds, Fewer Is Better WebP Image Encode 1.1 Encode Settings: Quality 100, Highest Compression Linux 5.9 Git Linux 5.9 Git Repeat Linux 5.8 2 4 6 8 10 SE +/- 0.021, N = 3 SE +/- 0.024, N = 3 SE +/- 0.039, N = 3 7.732 7.754 7.775 1. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: mobilenet Linux 5.9 Git Repeat Linux 5.9 Git Linux 5.8 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.02, N = 15 22.05 22.09 22.16 MIN: 21.01 / MAX: 23.75 MIN: 21.08 / MAX: 28.46 MIN: 20.83 / MAX: 28.17 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
LibRaw Post-Processing Benchmark OpenBenchmarking.org Mpix/sec, More Is Better LibRaw 0.20 Post-Processing Benchmark Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 7 14 21 28 35 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 30.90 30.82 30.77 1. (CXX) g++ options: -O2 -fopenmp -ljpeg -lz -lm
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No Linux 5.9 Git Linux 5.9 Git Repeat Linux 5.8 30 60 90 120 150 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 124.36 124.38 124.76
TNN Target: CPU - Model: SqueezeNet v1.1 OpenBenchmarking.org ms, Fewer Is Better TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 Linux 5.9 Git Repeat Linux 5.8 Linux 5.9 Git 60 120 180 240 300 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.77, N = 3 258.22 258.42 259.01 MIN: 257.01 / MAX: 259.55 MIN: 257.57 / MAX: 260.74 MIN: 257.05 / MAX: 264.71 1. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
TNN Target: CPU - Model: MobileNet v2 OpenBenchmarking.org ms, Fewer Is Better TNN 0.2.3 Target: CPU - Model: MobileNet v2 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 60 120 180 240 300 SE +/- 1.00, N = 3 SE +/- 0.60, N = 3 SE +/- 0.44, N = 3 294.94 295.26 295.81 MIN: 278.83 / MAX: 315.53 MIN: 275.59 / MAX: 321.25 MIN: 275.48 / MAX: 334.45 1. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: yolov4-tiny Linux 5.9 Git Repeat Linux 5.9 Git Linux 5.8 10 20 30 40 50 SE +/- 0.02, N = 3 SE +/- 0.06, N = 4 SE +/- 0.05, N = 15 44.06 44.16 44.18 MIN: 42.05 / MAX: 47.89 MIN: 41.67 / MAX: 48.98 MIN: 42.06 / MAX: 50.96 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: vgg16 Linux 5.9 Git Repeat Linux 5.9 Git Linux 5.8 30 60 90 120 150 SE +/- 0.19, N = 3 SE +/- 0.16, N = 4 SE +/- 0.09, N = 15 133.74 133.85 134.01 MIN: 132.16 / MAX: 140.12 MIN: 132.08 / MAX: 141.32 MIN: 132.1 / MAX: 142.92 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 Linux 5.9 Git Linux 5.8 Linux 5.9 Git Repeat 3 6 9 12 15 SE +/- 0.01, N = 4 SE +/- 0.01, N = 15 SE +/- 0.01, N = 3 9.45 9.46 9.46 MIN: 8.72 / MAX: 10.61 MIN: 8.62 / MAX: 14.48 MIN: 8.58 / MAX: 10.96 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 Linux 5.9 Git Linux 5.8 Linux 5.9 Git Repeat 3 6 9 12 15 SE +/- 0.02, N = 4 SE +/- 0.02, N = 15 SE +/- 0.02, N = 3 10.96 10.97 10.97 MIN: 10.05 / MAX: 14.07 MIN: 9.94 / MAX: 15.31 MIN: 9.98 / MAX: 14.14 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 200 400 600 800 1000 SE +/- 0.20, N = 3 SE +/- 0.03, N = 3 SE +/- 0.13, N = 3 974.00 974.34 974.39
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: yolov4-tiny Linux 5.9 Git Linux 5.9 Git Repeat Linux 5.8 12 24 36 48 60 SE +/- 0.96, N = 12 SE +/- 0.79, N = 12 SE +/- 0.83, N = 3 51.08 51.32 52.34 MIN: 42.05 / MAX: 213.57 MIN: 42.04 / MAX: 214.86 MIN: 44.27 / MAX: 207.57 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet50 Linux 5.8 Linux 5.9 Git Repeat Linux 5.9 Git 16 32 48 64 80 SE +/- 5.77, N = 3 SE +/- 5.27, N = 12 SE +/- 5.77, N = 12 60.11 65.65 71.67 MIN: 41.52 / MAX: 518.24 MIN: 37.96 / MAX: 537.32 MIN: 38.92 / MAX: 530.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: alexnet Linux 5.9 Git Repeat Linux 5.9 Git Linux 5.8 9 18 27 36 45 SE +/- 1.35, N = 12 SE +/- 2.20, N = 12 SE +/- 7.38, N = 3 35.66 37.00 38.52 MIN: 18.84 / MAX: 125.05 MIN: 16.59 / MAX: 112.15 MIN: 17.41 / MAX: 105.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet18 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 13 26 39 52 65 SE +/- 4.82, N = 3 SE +/- 6.08, N = 12 SE +/- 7.45, N = 12 36.96 52.28 58.59 MIN: 22.12 / MAX: 220.9 MIN: 21.12 / MAX: 215.72 MIN: 21.44 / MAX: 245.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: vgg16 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 20 40 60 80 100 SE +/- 2.56, N = 3 SE +/- 2.26, N = 12 SE +/- 0.99, N = 12 91.54 95.74 99.70 MIN: 69.5 / MAX: 213.3 MIN: 63.79 / MAX: 220.6 MIN: 65.21 / MAX: 223.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: googlenet Linux 5.8 Linux 5.9 Git Repeat Linux 5.9 Git 10 20 30 40 50 SE +/- 2.78, N = 3 SE +/- 2.68, N = 12 SE +/- 3.05, N = 12 36.91 39.01 42.47 MIN: 27.59 / MAX: 479.39 MIN: 27.69 / MAX: 511.48 MIN: 27.92 / MAX: 504.41 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: efficientnet-b0 Linux 5.8 Linux 5.9 Git Repeat Linux 5.9 Git 5 10 15 20 25 SE +/- 0.48, N = 3 SE +/- 0.43, N = 12 SE +/- 1.28, N = 12 16.51 17.50 18.58 MIN: 15.42 / MAX: 48.65 MIN: 15.46 / MAX: 521.68 MIN: 15.35 / MAX: 510.96 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: shufflenet-v2 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 4 8 12 16 20 SE +/- 0.43, N = 3 SE +/- 0.22, N = 12 SE +/- 0.67, N = 12 13.05 13.48 13.95 MIN: 12.14 / MAX: 14.64 MIN: 12.18 / MAX: 390.55 MIN: 12.15 / MAX: 414.99 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU-v3-v3 - Model: mobilenet-v3 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 3 6 9 12 15 SE +/- 0.28, N = 3 SE +/- 0.30, N = 12 SE +/- 0.93, N = 12 12.92 13.33 13.43 MIN: 11.59 / MAX: 110.56 MIN: 11.55 / MAX: 394.82 MIN: 11.56 / MAX: 398.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU-v2-v2 - Model: mobilenet-v2 Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 4 8 12 16 20 SE +/- 0.44, N = 3 SE +/- 0.22, N = 12 SE +/- 1.58, N = 12 13.69 14.06 16.22 MIN: 11.92 / MAX: 347.04 MIN: 11.96 / MAX: 335.89 MIN: 11.87 / MAX: 425.43 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenet Linux 5.8 Linux 5.9 Git Linux 5.9 Git Repeat 8 16 24 32 40 SE +/- 0.47, N = 3 SE +/- 0.80, N = 12 SE +/- 0.98, N = 12 31.18 32.25 32.87 MIN: 28.88 / MAX: 240.65 MIN: 28.41 / MAX: 398.09 MIN: 28.65 / MAX: 439.38 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet Linux 5.8 Linux 5.9 Git Repeat Linux 5.9 Git 8 16 24 32 40 SE +/- 0.44, N = 3 SE +/- 0.99, N = 12 SE +/- 1.65, N = 12 30.66 32.95 34.10 MIN: 26.97 / MAX: 316.95 MIN: 26.72 / MAX: 456.36 MIN: 26.75 / MAX: 425.49 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
eSpeak-NG Speech Engine Text-To-Speech Synthesis OpenBenchmarking.org Seconds, Fewer Is Better eSpeak-NG Speech Engine 20200907 Text-To-Speech Synthesis Linux 5.9 Git Repeat Linux 5.9 Git Linux 5.8 8 16 24 32 40 SE +/- 0.55, N = 20 SE +/- 0.48, N = 20 SE +/- 0.53, N = 20 33.27 33.42 34.34 1. (CC) gcc options: -O2 -std=c99
Phoronix Test Suite v10.8.4