dgga AMD Ryzen Threadripper 3970X 32-Core testing with a ASUS ROG ZENITH II EXTREME (1802 BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2312245-NE-DGGA0402643&sor .
dgga Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution AMD Ryzen Threadripper 3970X 32-Core b c AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads) ASUS ROG ZENITH II EXTREME (1802 BIOS) AMD Starship/Matisse 64GB Samsung SSD 980 PRO 500GB AMD Radeon RX 5700 8GB (1750/875MHz) AMD Navi 10 HDMI Audio ASUS VP28U Aquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 22.04 6.2.0-36-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.49) 1.2.204 GCC 11.4.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x830107a Java Details - OpenJDK Runtime Environment (build 11.0.20.1+1-post-Ubuntu-0ubuntu122.04) Python Details - Python 3.10.12 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
dgga xmrig: KawPow - 1M xmrig: Monero - 1M xmrig: Wownero - 1M xmrig: GhostRider - 1M xmrig: CryptoNight-Heavy - 1M xmrig: CryptoNight-Femto UPX2 - 1M java-scimark2: Composite java-scimark2: Monte Carlo java-scimark2: Fast Fourier Transform java-scimark2: Sparse Matrix Multiply java-scimark2: Dense LU Matrix Factorization java-scimark2: Jacobi Successive Over-Relaxation webp2: Default webp2: Quality 75, Compression Effort 7 webp2: Quality 95, Compression Effort 7 webp2: Quality 100, Compression Effort 5 webp2: Quality 100, Lossless Compression embree: Pathtracer - Crown embree: Pathtracer ISPC - Crown embree: Pathtracer - Asian Dragon embree: Pathtracer - Asian Dragon Obj embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer ISPC - Asian Dragon Obj svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p openssl: SHA256 openssl: SHA512 openssl: RSA4096 openssl: RSA4096 openssl: ChaCha20 openssl: AES-128-GCM openssl: AES-256-GCM openssl: ChaCha20-Poly1305 pytorch: CPU - 1 - ResNet-50 pytorch: CPU - 1 - ResNet-152 pytorch: CPU - 16 - ResNet-50 pytorch: CPU - 32 - ResNet-50 pytorch: CPU - 64 - ResNet-50 pytorch: CPU - 16 - ResNet-152 pytorch: CPU - 32 - ResNet-152 pytorch: CPU - 64 - ResNet-152 pytorch: CPU - 1 - Efficientnet_v2_l pytorch: CPU - 16 - Efficientnet_v2_l pytorch: CPU - 32 - Efficientnet_v2_l pytorch: CPU - 64 - Efficientnet_v2_l deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 16276.6 16368.8 27698.5 4771.3 16450.1 16317.7 3628.54 1662.78 460.52 3259.85 10937.37 1822.2 9.74 0.36 0.18 7.89 0.04 38.6634 34.8277 41.9049 37.7699 39.4881 33.989 4.712 44.813 139.049 141.072 12.238 77.466 302.256 361.391 42506964290 14922955600 9381 609998 132709569060 152254146970 139151548420 86074896380 35.38 14.04 30.97 30.97 30.33 11.76 11.79 11.85 7.89 5.98 5.97 6.00 29.8842 530.7568 17.5286 57.041 674.1167 23.712 169.4233 5.896 323.1865 49.4836 144.8781 6.894 1820.1556 8.7652 766.4844 1.3008 154.4159 103.4836 92.4279 10.8073 37.0667 431.396 21.412 46.6936 325.3167 49.16 152.0352 6.5694 158.0562 101.1265 94.279 10.5994 247.0871 64.7241 90.0923 11.0925 33.9103 469.2415 21.7159 46.0342 345.4208 46.2963 85.8602 11.6407 30.5082 522.4351 17.7819 56.2287 16472.3 16429.8 28017.5 4833.4 16398.3 16315.6 3500.03 1664.07 452.84 2552.03 11007.91 1823.29 9.47 0.36 0.18 7.99 0.04 38.6826 34.6107 41.9584 37.5554 39.3303 33.9219 4.699 44.26 140.202 143.719 12.17 77.744 303.201 358.894 42475560230 14877687680 9368.1 609586.6 132535967470 152243466510 138940289020 86178622410 36.22 14.26 31.08 30.44 29.85 11.79 11.65 11.59 7.95 5.92 5.96 6.09 29.5264 539.6021 17.1783 58.2042 671.9488 23.7852 167.5851 5.9607 320.683 49.8705 145.6431 6.8579 1805.6704 8.8357 752.7752 1.324 149.1863 107.1318 91.6072 10.904 37.1773 427.7464 21.2394 47.0734 324.6279 49.2645 147.051 6.7922 157.0528 101.838 94.009 10.6301 245.4336 65.1634 83.5111 11.9675 33.5294 476.8669 21.5157 46.4632 344.6466 46.3817 86.1225 11.6045 29.9828 532.7014 17.4838 57.1874 16425.2 16527 28103.3 4784.7 16312.4 16555.2 3630.68 1603.8 447.63 3252.08 11024.98 1824.92 9.77 0.36 0.18 7.78 0.04 38.788 34.7267 41.9227 37.5529 39.3408 33.9649 4.797 44.897 141.265 137.23 12.173 77.763 303.029 353.489 42542937860 14860394950 9368 609364.3 132480014470 152248762370 139048226820 85685137680 35.95 14.30 31.36 31.11 30.87 11.71 11.95 11.69 7.93 6.06 6.00 6.01 29.6241 536.858 17.2364 58.0081 670.8731 23.8232 167.2022 5.9747 320.2104 49.9441 142.5611 7.0064 1808.3307 8.821 766.4 1.3006 149.2703 107.1516 91.5797 10.9073 36.9162 431.935 21.2359 47.081 324.1138 49.3431 150.8915 6.6191 158.4441 100.8112 93.7414 10.6602 246.1586 64.9519 83.9665 11.9026 33.4894 477.2306 21.284 46.9683 344.6426 46.4012 86.7163 11.5257 29.6746 536.3063 17.5075 57.1103 OpenBenchmarking.org
Xmrig Variant: KawPow - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: KawPow - Hash Count: 1M b c AMD Ryzen Threadripper 3970X 32-Core 4K 8K 12K 16K 20K 16472.3 16425.2 16276.6 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: Monero - Hash Count: 1M c b AMD Ryzen Threadripper 3970X 32-Core 4K 8K 12K 16K 20K 16527.0 16429.8 16368.8 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: Wownero - Hash Count: 1M c b AMD Ryzen Threadripper 3970X 32-Core 6K 12K 18K 24K 30K 28103.3 28017.5 27698.5 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M b c AMD Ryzen Threadripper 3970X 32-Core 1000 2000 3000 4000 5000 4833.4 4784.7 4771.3 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: CryptoNight-Heavy - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: CryptoNight-Heavy - Hash Count: 1M AMD Ryzen Threadripper 3970X 32-Core b c 4K 8K 12K 16K 20K 16450.1 16398.3 16312.4 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: CryptoNight-Femto UPX2 - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: CryptoNight-Femto UPX2 - Hash Count: 1M c AMD Ryzen Threadripper 3970X 32-Core b 4K 8K 12K 16K 20K 16555.2 16317.7 16315.6 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Java SciMark Computational Test: Composite OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Composite c AMD Ryzen Threadripper 3970X 32-Core b 800 1600 2400 3200 4000 3630.68 3628.54 3500.03
Java SciMark Computational Test: Monte Carlo OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Monte Carlo b AMD Ryzen Threadripper 3970X 32-Core c 400 800 1200 1600 2000 1664.07 1662.78 1603.80
Java SciMark Computational Test: Fast Fourier Transform OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Fast Fourier Transform AMD Ryzen Threadripper 3970X 32-Core b c 100 200 300 400 500 460.52 452.84 447.63
Java SciMark Computational Test: Sparse Matrix Multiply OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Sparse Matrix Multiply AMD Ryzen Threadripper 3970X 32-Core c b 700 1400 2100 2800 3500 3259.85 3252.08 2552.03
Java SciMark Computational Test: Dense LU Matrix Factorization OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Dense LU Matrix Factorization c b AMD Ryzen Threadripper 3970X 32-Core 2K 4K 6K 8K 10K 11024.98 11007.91 10937.37
Java SciMark Computational Test: Jacobi Successive Over-Relaxation OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Jacobi Successive Over-Relaxation c b AMD Ryzen Threadripper 3970X 32-Core 400 800 1200 1600 2000 1824.92 1823.29 1822.20
WebP2 Image Encode Encode Settings: Default OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Default c AMD Ryzen Threadripper 3970X 32-Core b 3 6 9 12 15 9.77 9.74 9.47 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
WebP2 Image Encode Encode Settings: Quality 75, Compression Effort 7 OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 75, Compression Effort 7 c b AMD Ryzen Threadripper 3970X 32-Core 0.081 0.162 0.243 0.324 0.405 0.36 0.36 0.36 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
WebP2 Image Encode Encode Settings: Quality 95, Compression Effort 7 OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 95, Compression Effort 7 c b AMD Ryzen Threadripper 3970X 32-Core 0.0405 0.081 0.1215 0.162 0.2025 0.18 0.18 0.18 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
WebP2 Image Encode Encode Settings: Quality 100, Compression Effort 5 OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 100, Compression Effort 5 b AMD Ryzen Threadripper 3970X 32-Core c 2 4 6 8 10 7.99 7.89 7.78 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
WebP2 Image Encode Encode Settings: Quality 100, Lossless Compression OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 100, Lossless Compression c b AMD Ryzen Threadripper 3970X 32-Core 0.009 0.018 0.027 0.036 0.045 0.04 0.04 0.04 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Crown c b AMD Ryzen Threadripper 3970X 32-Core 9 18 27 36 45 38.79 38.68 38.66 MIN: 38.44 / MAX: 39.41 MIN: 38.31 / MAX: 39.27 MIN: 38.32 / MAX: 39.41
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown AMD Ryzen Threadripper 3970X 32-Core c b 8 16 24 32 40 34.83 34.73 34.61 MIN: 34.51 / MAX: 35.43 MIN: 34.36 / MAX: 35.34 MIN: 34.23 / MAX: 35.36
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon b c AMD Ryzen Threadripper 3970X 32-Core 10 20 30 40 50 41.96 41.92 41.90 MIN: 41.73 / MAX: 42.57 MIN: 41.68 / MAX: 42.7 MIN: 41.66 / MAX: 42.52
Embree Binary: Pathtracer - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon Obj AMD Ryzen Threadripper 3970X 32-Core b c 9 18 27 36 45 37.77 37.56 37.55 MIN: 37.52 / MAX: 38.28 MIN: 37.33 / MAX: 38.01 MIN: 37.34 / MAX: 38.21
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon AMD Ryzen Threadripper 3970X 32-Core c b 9 18 27 36 45 39.49 39.34 39.33 MIN: 39.27 / MAX: 39.89 MIN: 39.13 / MAX: 39.88 MIN: 39.12 / MAX: 39.81
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AMD Ryzen Threadripper 3970X 32-Core c b 8 16 24 32 40 33.99 33.96 33.92 MIN: 33.79 / MAX: 34.43 MIN: 33.77 / MAX: 34.36 MIN: 33.73 / MAX: 34.41
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 4K c AMD Ryzen Threadripper 3970X 32-Core b 1.0793 2.1586 3.2379 4.3172 5.3965 4.797 4.712 4.699 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 4K c AMD Ryzen Threadripper 3970X 32-Core b 10 20 30 40 50 44.90 44.81 44.26 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 4K c b AMD Ryzen Threadripper 3970X 32-Core 30 60 90 120 150 141.27 140.20 139.05 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 4K b AMD Ryzen Threadripper 3970X 32-Core c 30 60 90 120 150 143.72 141.07 137.23 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 1080p AMD Ryzen Threadripper 3970X 32-Core c b 3 6 9 12 15 12.24 12.17 12.17 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 1080p c b AMD Ryzen Threadripper 3970X 32-Core 20 40 60 80 100 77.76 77.74 77.47 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 1080p b c AMD Ryzen Threadripper 3970X 32-Core 70 140 210 280 350 303.20 303.03 302.26 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 1080p AMD Ryzen Threadripper 3970X 32-Core b c 80 160 240 320 400 361.39 358.89 353.49 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: SHA256 c AMD Ryzen Threadripper 3970X 32-Core b 9000M 18000M 27000M 36000M 45000M 42542937860 42506964290 42475560230 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: SHA512 AMD Ryzen Threadripper 3970X 32-Core b c 3000M 6000M 9000M 12000M 15000M 14922955600 14877687680 14860394950 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL Algorithm: RSA4096 AMD Ryzen Threadripper 3970X 32-Core b c 2K 4K 6K 8K 10K 9381.0 9368.1 9368.0 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL Algorithm: RSA4096 AMD Ryzen Threadripper 3970X 32-Core b c 130K 260K 390K 520K 650K 609998.0 609586.6 609364.3 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: ChaCha20 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: ChaCha20 AMD Ryzen Threadripper 3970X 32-Core b c 30000M 60000M 90000M 120000M 150000M 132709569060 132535967470 132480014470 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: AES-128-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: AES-128-GCM AMD Ryzen Threadripper 3970X 32-Core c b 30000M 60000M 90000M 120000M 150000M 152254146970 152248762370 152243466510 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: AES-256-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: AES-256-GCM AMD Ryzen Threadripper 3970X 32-Core c b 30000M 60000M 90000M 120000M 150000M 139151548420 139048226820 138940289020 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: ChaCha20-Poly1305 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: ChaCha20-Poly1305 b AMD Ryzen Threadripper 3970X 32-Core c 20000M 40000M 60000M 80000M 100000M 86178622410 86074896380 85685137680 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 b c AMD Ryzen Threadripper 3970X 32-Core 8 16 24 32 40 36.22 35.95 35.38 MIN: 35.77 / MAX: 36.63 MIN: 32.12 / MAX: 36.39 MIN: 31.54 / MAX: 36.03
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 c b AMD Ryzen Threadripper 3970X 32-Core 4 8 12 16 20 14.30 14.26 14.04 MIN: 13.48 / MAX: 14.43 MIN: 13.64 / MAX: 14.35 MIN: 13.32 / MAX: 14.21
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 c b AMD Ryzen Threadripper 3970X 32-Core 7 14 21 28 35 31.36 31.08 30.97 MIN: 30.9 / MAX: 31.58 MIN: 30.3 / MAX: 31.41 MIN: 30.46 / MAX: 31.35
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 c AMD Ryzen Threadripper 3970X 32-Core b 7 14 21 28 35 31.11 30.97 30.44 MIN: 28.26 / MAX: 31.39 MIN: 28.08 / MAX: 31.41 MIN: 27.31 / MAX: 30.86
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 c AMD Ryzen Threadripper 3970X 32-Core b 7 14 21 28 35 30.87 30.33 29.85 MIN: 30.38 / MAX: 31.05 MIN: 29.76 / MAX: 30.69 MIN: 26.63 / MAX: 30.71
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 b AMD Ryzen Threadripper 3970X 32-Core c 3 6 9 12 15 11.79 11.76 11.71 MIN: 11.36 / MAX: 11.88 MIN: 11.35 / MAX: 11.85 MIN: 11.21 / MAX: 11.83
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 c AMD Ryzen Threadripper 3970X 32-Core b 3 6 9 12 15 11.95 11.79 11.65 MIN: 11.46 / MAX: 12.05 MIN: 11.35 / MAX: 11.86 MIN: 11.19 / MAX: 11.78
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 AMD Ryzen Threadripper 3970X 32-Core c b 3 6 9 12 15 11.85 11.69 11.59 MIN: 11.36 / MAX: 11.93 MIN: 11.19 / MAX: 11.76 MIN: 11.15 / MAX: 11.75
PyTorch Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l b c AMD Ryzen Threadripper 3970X 32-Core 2 4 6 8 10 7.95 7.93 7.89 MIN: 7.74 / MAX: 8.01 MIN: 7.7 / MAX: 8.02 MIN: 7.7 / MAX: 7.97
PyTorch Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l c AMD Ryzen Threadripper 3970X 32-Core b 2 4 6 8 10 6.06 5.98 5.92 MIN: 5.92 / MAX: 6.09 MIN: 5.87 / MAX: 6.02 MIN: 5.73 / MAX: 6
PyTorch Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l c AMD Ryzen Threadripper 3970X 32-Core b 2 4 6 8 10 6.00 5.97 5.96 MIN: 5.87 / MAX: 6.05 MIN: 5.85 / MAX: 6 MIN: 5.84 / MAX: 6
PyTorch Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l b c AMD Ryzen Threadripper 3970X 32-Core 2 4 6 8 10 6.09 6.01 6.00 MIN: 5.63 / MAX: 6.21 MIN: 5.89 / MAX: 6.04 MIN: 5.87 / MAX: 6.03
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 7 14 21 28 35 29.88 29.62 29.53
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 120 240 360 480 600 530.76 536.86 539.60
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 4 8 12 16 20 17.53 17.24 17.18
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 13 26 39 52 65 57.04 58.01 58.20
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 150 300 450 600 750 674.12 671.95 670.87
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 6 12 18 24 30 23.71 23.79 23.82
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 40 80 120 160 200 169.42 167.59 167.20
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 1.3443 2.6886 4.0329 5.3772 6.7215 5.8960 5.9607 5.9747
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 70 140 210 280 350 323.19 320.68 320.21
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 49.48 49.87 49.94
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream b AMD Ryzen Threadripper 3970X 32-Core c 30 60 90 120 150 145.64 144.88 142.56
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream b AMD Ryzen Threadripper 3970X 32-Core c 2 4 6 8 10 6.8579 6.8940 7.0064
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 400 800 1200 1600 2000 1820.16 1808.33 1805.67
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 2 4 6 8 10 8.7652 8.8210 8.8357
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 170 340 510 680 850 766.48 766.40 752.78
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream c AMD Ryzen Threadripper 3970X 32-Core b 0.2979 0.5958 0.8937 1.1916 1.4895 1.3006 1.3008 1.3240
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 30 60 90 120 150 154.42 149.27 149.19
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 20 40 60 80 100 103.48 107.13 107.15
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 20 40 60 80 100 92.43 91.61 91.58
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 3 6 9 12 15 10.81 10.90 10.91
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream b AMD Ryzen Threadripper 3970X 32-Core c 9 18 27 36 45 37.18 37.07 36.92
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream b AMD Ryzen Threadripper 3970X 32-Core c 90 180 270 360 450 427.75 431.40 431.94
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 5 10 15 20 25 21.41 21.24 21.24
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 46.69 47.07 47.08
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 70 140 210 280 350 325.32 324.63 324.11
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 49.16 49.26 49.34
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 30 60 90 120 150 152.04 150.89 147.05
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 2 4 6 8 10 6.5694 6.6191 6.7922
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream c AMD Ryzen Threadripper 3970X 32-Core b 40 80 120 160 200 158.44 158.06 157.05
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream c AMD Ryzen Threadripper 3970X 32-Core b 20 40 60 80 100 100.81 101.13 101.84
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 20 40 60 80 100 94.28 94.01 93.74
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 3 6 9 12 15 10.60 10.63 10.66
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 50 100 150 200 250 247.09 246.16 245.43
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 15 30 45 60 75 64.72 64.95 65.16
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 20 40 60 80 100 90.09 83.97 83.51
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 3 6 9 12 15 11.09 11.90 11.97
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 8 16 24 32 40 33.91 33.53 33.49
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 100 200 300 400 500 469.24 476.87 477.23
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 5 10 15 20 25 21.72 21.52 21.28
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 46.03 46.46 46.97
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 80 160 240 320 400 345.42 344.65 344.64
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 46.30 46.38 46.40
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream c b AMD Ryzen Threadripper 3970X 32-Core 20 40 60 80 100 86.72 86.12 85.86
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream c b AMD Ryzen Threadripper 3970X 32-Core 3 6 9 12 15 11.53 11.60 11.64
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 7 14 21 28 35 30.51 29.98 29.67
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 120 240 360 480 600 522.44 532.70 536.31
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 4 8 12 16 20 17.78 17.51 17.48
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 13 26 39 52 65 56.23 57.11 57.19
Phoronix Test Suite v10.8.5