dgga AMD Ryzen Threadripper 3970X 32-Core testing with a ASUS ROG ZENITH II EXTREME (1802 BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2312245-NE-DGGA0402643&sor&grs .
dgga Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution AMD Ryzen Threadripper 3970X 32-Core b c AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads) ASUS ROG ZENITH II EXTREME (1802 BIOS) AMD Starship/Matisse 64GB Samsung SSD 980 PRO 500GB AMD Radeon RX 5700 8GB (1750/875MHz) AMD Navi 10 HDMI Audio ASUS VP28U Aquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 22.04 6.2.0-36-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.49) 1.2.204 GCC 11.4.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x830107a Java Details - OpenJDK Runtime Environment (build 11.0.20.1+1-post-Ubuntu-0ubuntu122.04) Python Details - Python 3.10.12 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
dgga java-scimark2: Sparse Matrix Multiply deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream svt-av1: Preset 13 - Bosphorus 4K java-scimark2: Monte Carlo java-scimark2: Composite deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream pytorch: CPU - 64 - ResNet-50 deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream webp2: Default java-scimark2: Fast Fourier Transform deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream webp2: Quality 100, Compression Effort 5 deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream pytorch: CPU - 32 - ResNet-152 pytorch: CPU - 1 - ResNet-50 pytorch: CPU - 16 - Efficientnet_v2_l pytorch: CPU - 64 - ResNet-152 svt-av1: Preset 13 - Bosphorus 1080p pytorch: CPU - 32 - ResNet-50 deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream svt-av1: Preset 4 - Bosphorus 4K deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream pytorch: CPU - 1 - ResNet-152 deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream svt-av1: Preset 12 - Bosphorus 4K pytorch: CPU - 64 - Efficientnet_v2_l xmrig: CryptoNight-Femto UPX2 - 1M xmrig: Wownero - 1M svt-av1: Preset 8 - Bosphorus 4K deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream xmrig: GhostRider - 1M pytorch: CPU - 16 - ResNet-50 deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream xmrig: KawPow - 1M deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream xmrig: Monero - 1M deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream xmrig: CryptoNight-Heavy - 1M deepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream java-scimark2: Dense LU Matrix Factorization pytorch: CPU - 1 - Efficientnet_v2_l deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream pytorch: CPU - 16 - ResNet-152 deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream pytorch: CPU - 32 - Efficientnet_v2_l embree: Pathtracer ISPC - Crown embree: Pathtracer - Asian Dragon Obj openssl: ChaCha20-Poly1305 deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream svt-av1: Preset 4 - Bosphorus 1080p deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream openssl: SHA512 embree: Pathtracer ISPC - Asian Dragon svt-av1: Preset 8 - Bosphorus 1080p deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream embree: Pathtracer - Crown svt-av1: Preset 12 - Bosphorus 1080p deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream embree: Pathtracer ISPC - Asian Dragon Obj openssl: ChaCha20 openssl: SHA256 openssl: AES-256-GCM java-scimark2: Jacobi Successive Over-Relaxation openssl: RSA4096 embree: Pathtracer - Asian Dragon openssl: RSA4096 openssl: AES-128-GCM webp2: Quality 100, Lossless Compression webp2: Quality 95, Compression Effort 7 webp2: Quality 75, Compression Effort 7 AMD Ryzen Threadripper 3970X 32-Core b c 3259.85 11.0925 90.0923 141.072 1662.78 3628.54 103.4836 154.4159 30.33 6.5694 152.0352 9.74 460.52 30.5082 7.89 522.4351 11.79 35.38 5.98 11.85 361.391 30.97 6.894 144.8781 4.712 57.041 17.5286 21.7159 46.0342 14.04 766.4844 1.3008 17.7819 56.2287 469.2415 530.7568 139.049 6.00 16317.7 27698.5 44.813 5.896 169.4233 4771.3 30.97 33.9103 29.8842 16276.6 101.1265 11.6407 85.8602 431.396 16368.8 49.4836 323.1865 92.4279 10.8073 158.0562 16450.1 46.6936 21.412 8.7652 1820.1556 10937.37 7.89 37.0667 11.76 64.7241 247.0871 5.97 34.8277 37.7699 86074896380 10.5994 94.279 12.238 674.1167 23.712 14922955600 39.4881 77.466 49.16 325.3167 38.6634 302.256 46.2963 345.4208 33.989 132709569060 42506964290 139151548420 1822.2 9381 41.9049 609998 152254146970 0.04 0.18 0.36 2552.03 11.9675 83.5111 143.719 1664.07 3500.03 107.1318 149.1863 29.85 6.7922 147.051 9.47 452.84 29.9828 7.99 532.7014 11.65 36.22 5.92 11.59 358.894 30.44 6.8579 145.6431 4.699 58.2042 17.1783 21.5157 46.4632 14.26 752.7752 1.324 17.4838 57.1874 476.8669 539.6021 140.202 6.09 16315.6 28017.5 44.26 5.9607 167.5851 4833.4 31.08 33.5294 29.5264 16472.3 101.838 11.6045 86.1225 427.7464 16429.8 49.8705 320.683 91.6072 10.904 157.0528 16398.3 47.0734 21.2394 8.8357 1805.6704 11007.91 7.95 37.1773 11.79 65.1634 245.4336 5.96 34.6107 37.5554 86178622410 10.6301 94.009 12.17 671.9488 23.7852 14877687680 39.3303 77.744 49.2645 324.6279 38.6826 303.201 46.3817 344.6466 33.9219 132535967470 42475560230 138940289020 1823.29 9368.1 41.9584 609586.6 152243466510 0.04 0.18 0.36 3252.08 11.9026 83.9665 137.23 1603.8 3630.68 107.1516 149.2703 30.87 6.6191 150.8915 9.77 447.63 29.6746 7.78 536.3063 11.95 35.95 6.06 11.69 353.489 31.11 7.0064 142.5611 4.797 58.0081 17.2364 21.284 46.9683 14.30 766.4 1.3006 17.5075 57.1103 477.2306 536.858 141.265 6.01 16555.2 28103.3 44.897 5.9747 167.2022 4784.7 31.36 33.4894 29.6241 16425.2 100.8112 11.5257 86.7163 431.935 16527 49.9441 320.2104 91.5797 10.9073 158.4441 16312.4 47.081 21.2359 8.821 1808.3307 11024.98 7.93 36.9162 11.71 64.9519 246.1586 6.00 34.7267 37.5529 85685137680 10.6602 93.7414 12.173 670.8731 23.8232 14860394950 39.3408 77.763 49.3431 324.1138 38.788 303.029 46.4012 344.6426 33.9649 132480014470 42542937860 139048226820 1824.92 9368 41.9227 609364.3 152248762370 0.04 0.18 0.36 OpenBenchmarking.org
Java SciMark Computational Test: Sparse Matrix Multiply OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Sparse Matrix Multiply AMD Ryzen Threadripper 3970X 32-Core c b 700 1400 2100 2800 3500 3259.85 3252.08 2552.03
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 3 6 9 12 15 11.09 11.90 11.97
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 20 40 60 80 100 90.09 83.97 83.51
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 4K b AMD Ryzen Threadripper 3970X 32-Core c 30 60 90 120 150 143.72 141.07 137.23 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Java SciMark Computational Test: Monte Carlo OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Monte Carlo b AMD Ryzen Threadripper 3970X 32-Core c 400 800 1200 1600 2000 1664.07 1662.78 1603.80
Java SciMark Computational Test: Composite OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Composite c AMD Ryzen Threadripper 3970X 32-Core b 800 1600 2400 3200 4000 3630.68 3628.54 3500.03
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 20 40 60 80 100 103.48 107.13 107.15
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 30 60 90 120 150 154.42 149.27 149.19
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 c AMD Ryzen Threadripper 3970X 32-Core b 7 14 21 28 35 30.87 30.33 29.85 MIN: 30.38 / MAX: 31.05 MIN: 29.76 / MAX: 30.69 MIN: 26.63 / MAX: 30.71
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 2 4 6 8 10 6.5694 6.6191 6.7922
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 30 60 90 120 150 152.04 150.89 147.05
WebP2 Image Encode Encode Settings: Default OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Default c AMD Ryzen Threadripper 3970X 32-Core b 3 6 9 12 15 9.77 9.74 9.47 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
Java SciMark Computational Test: Fast Fourier Transform OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Fast Fourier Transform AMD Ryzen Threadripper 3970X 32-Core b c 100 200 300 400 500 460.52 452.84 447.63
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 7 14 21 28 35 30.51 29.98 29.67
WebP2 Image Encode Encode Settings: Quality 100, Compression Effort 5 OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 100, Compression Effort 5 b AMD Ryzen Threadripper 3970X 32-Core c 2 4 6 8 10 7.99 7.89 7.78 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 120 240 360 480 600 522.44 532.70 536.31
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 c AMD Ryzen Threadripper 3970X 32-Core b 3 6 9 12 15 11.95 11.79 11.65 MIN: 11.46 / MAX: 12.05 MIN: 11.35 / MAX: 11.86 MIN: 11.19 / MAX: 11.78
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 b c AMD Ryzen Threadripper 3970X 32-Core 8 16 24 32 40 36.22 35.95 35.38 MIN: 35.77 / MAX: 36.63 MIN: 32.12 / MAX: 36.39 MIN: 31.54 / MAX: 36.03
PyTorch Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l c AMD Ryzen Threadripper 3970X 32-Core b 2 4 6 8 10 6.06 5.98 5.92 MIN: 5.92 / MAX: 6.09 MIN: 5.87 / MAX: 6.02 MIN: 5.73 / MAX: 6
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 AMD Ryzen Threadripper 3970X 32-Core c b 3 6 9 12 15 11.85 11.69 11.59 MIN: 11.36 / MAX: 11.93 MIN: 11.19 / MAX: 11.76 MIN: 11.15 / MAX: 11.75
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 1080p AMD Ryzen Threadripper 3970X 32-Core b c 80 160 240 320 400 361.39 358.89 353.49 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 c AMD Ryzen Threadripper 3970X 32-Core b 7 14 21 28 35 31.11 30.97 30.44 MIN: 28.26 / MAX: 31.39 MIN: 28.08 / MAX: 31.41 MIN: 27.31 / MAX: 30.86
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream b AMD Ryzen Threadripper 3970X 32-Core c 2 4 6 8 10 6.8579 6.8940 7.0064
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream b AMD Ryzen Threadripper 3970X 32-Core c 30 60 90 120 150 145.64 144.88 142.56
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 4K c AMD Ryzen Threadripper 3970X 32-Core b 1.0793 2.1586 3.2379 4.3172 5.3965 4.797 4.712 4.699 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 13 26 39 52 65 57.04 58.01 58.20
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 4 8 12 16 20 17.53 17.24 17.18
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 5 10 15 20 25 21.72 21.52 21.28
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 46.03 46.46 46.97
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 c b AMD Ryzen Threadripper 3970X 32-Core 4 8 12 16 20 14.30 14.26 14.04 MIN: 13.48 / MAX: 14.43 MIN: 13.64 / MAX: 14.35 MIN: 13.32 / MAX: 14.21
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 170 340 510 680 850 766.48 766.40 752.78
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream c AMD Ryzen Threadripper 3970X 32-Core b 0.2979 0.5958 0.8937 1.1916 1.4895 1.3006 1.3008 1.3240
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 4 8 12 16 20 17.78 17.51 17.48
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core c b 13 26 39 52 65 56.23 57.11 57.19
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 100 200 300 400 500 469.24 476.87 477.23
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 120 240 360 480 600 530.76 536.86 539.60
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 4K c b AMD Ryzen Threadripper 3970X 32-Core 30 60 90 120 150 141.27 140.20 139.05 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
PyTorch Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l b c AMD Ryzen Threadripper 3970X 32-Core 2 4 6 8 10 6.09 6.01 6.00 MIN: 5.63 / MAX: 6.21 MIN: 5.89 / MAX: 6.04 MIN: 5.87 / MAX: 6.03
Xmrig Variant: CryptoNight-Femto UPX2 - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: CryptoNight-Femto UPX2 - Hash Count: 1M c AMD Ryzen Threadripper 3970X 32-Core b 4K 8K 12K 16K 20K 16555.2 16317.7 16315.6 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: Wownero - Hash Count: 1M c b AMD Ryzen Threadripper 3970X 32-Core 6K 12K 18K 24K 30K 28103.3 28017.5 27698.5 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 4K c AMD Ryzen Threadripper 3970X 32-Core b 10 20 30 40 50 44.90 44.81 44.26 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 1.3443 2.6886 4.0329 5.3772 6.7215 5.8960 5.9607 5.9747
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 40 80 120 160 200 169.42 167.59 167.20
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M b c AMD Ryzen Threadripper 3970X 32-Core 1000 2000 3000 4000 5000 4833.4 4784.7 4771.3 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 c b AMD Ryzen Threadripper 3970X 32-Core 7 14 21 28 35 31.36 31.08 30.97 MIN: 30.9 / MAX: 31.58 MIN: 30.3 / MAX: 31.41 MIN: 30.46 / MAX: 31.35
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 8 16 24 32 40 33.91 33.53 33.49
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 7 14 21 28 35 29.88 29.62 29.53
Xmrig Variant: KawPow - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: KawPow - Hash Count: 1M b c AMD Ryzen Threadripper 3970X 32-Core 4K 8K 12K 16K 20K 16472.3 16425.2 16276.6 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream c AMD Ryzen Threadripper 3970X 32-Core b 20 40 60 80 100 100.81 101.13 101.84
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream c b AMD Ryzen Threadripper 3970X 32-Core 3 6 9 12 15 11.53 11.60 11.64
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream c b AMD Ryzen Threadripper 3970X 32-Core 20 40 60 80 100 86.72 86.12 85.86
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream b AMD Ryzen Threadripper 3970X 32-Core c 90 180 270 360 450 427.75 431.40 431.94
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: Monero - Hash Count: 1M c b AMD Ryzen Threadripper 3970X 32-Core 4K 8K 12K 16K 20K 16527.0 16429.8 16368.8 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 49.48 49.87 49.94
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 70 140 210 280 350 323.19 320.68 320.21
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 20 40 60 80 100 92.43 91.61 91.58
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 3 6 9 12 15 10.81 10.90 10.91
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream c AMD Ryzen Threadripper 3970X 32-Core b 40 80 120 160 200 158.44 158.06 157.05
Xmrig Variant: CryptoNight-Heavy - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: CryptoNight-Heavy - Hash Count: 1M AMD Ryzen Threadripper 3970X 32-Core b c 4K 8K 12K 16K 20K 16450.1 16398.3 16312.4 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 46.69 47.07 47.08
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 5 10 15 20 25 21.41 21.24 21.24
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 2 4 6 8 10 8.7652 8.8210 8.8357
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 400 800 1200 1600 2000 1820.16 1808.33 1805.67
Java SciMark Computational Test: Dense LU Matrix Factorization OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Dense LU Matrix Factorization c b AMD Ryzen Threadripper 3970X 32-Core 2K 4K 6K 8K 10K 11024.98 11007.91 10937.37
PyTorch Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l b c AMD Ryzen Threadripper 3970X 32-Core 2 4 6 8 10 7.95 7.93 7.89 MIN: 7.74 / MAX: 8.01 MIN: 7.7 / MAX: 8.02 MIN: 7.7 / MAX: 7.97
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream b AMD Ryzen Threadripper 3970X 32-Core c 9 18 27 36 45 37.18 37.07 36.92
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 b AMD Ryzen Threadripper 3970X 32-Core c 3 6 9 12 15 11.79 11.76 11.71 MIN: 11.36 / MAX: 11.88 MIN: 11.35 / MAX: 11.85 MIN: 11.21 / MAX: 11.83
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 15 30 45 60 75 64.72 64.95 65.16
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core c b 50 100 150 200 250 247.09 246.16 245.43
PyTorch Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l c AMD Ryzen Threadripper 3970X 32-Core b 2 4 6 8 10 6.00 5.97 5.96 MIN: 5.87 / MAX: 6.05 MIN: 5.85 / MAX: 6 MIN: 5.84 / MAX: 6
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown AMD Ryzen Threadripper 3970X 32-Core c b 8 16 24 32 40 34.83 34.73 34.61 MIN: 34.51 / MAX: 35.43 MIN: 34.36 / MAX: 35.34 MIN: 34.23 / MAX: 35.36
Embree Binary: Pathtracer - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon Obj AMD Ryzen Threadripper 3970X 32-Core b c 9 18 27 36 45 37.77 37.56 37.55 MIN: 37.52 / MAX: 38.28 MIN: 37.33 / MAX: 38.01 MIN: 37.34 / MAX: 38.21
OpenSSL Algorithm: ChaCha20-Poly1305 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: ChaCha20-Poly1305 b AMD Ryzen Threadripper 3970X 32-Core c 20000M 40000M 60000M 80000M 100000M 86178622410 86074896380 85685137680 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 3 6 9 12 15 10.60 10.63 10.66
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream AMD Ryzen Threadripper 3970X 32-Core b c 20 40 60 80 100 94.28 94.01 93.74
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 1080p AMD Ryzen Threadripper 3970X 32-Core c b 3 6 9 12 15 12.24 12.17 12.17 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 150 300 450 600 750 674.12 671.95 670.87
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 6 12 18 24 30 23.71 23.79 23.82
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: SHA512 AMD Ryzen Threadripper 3970X 32-Core b c 3000M 6000M 9000M 12000M 15000M 14922955600 14877687680 14860394950 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon AMD Ryzen Threadripper 3970X 32-Core c b 9 18 27 36 45 39.49 39.34 39.33 MIN: 39.27 / MAX: 39.89 MIN: 39.13 / MAX: 39.88 MIN: 39.12 / MAX: 39.81
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 1080p c b AMD Ryzen Threadripper 3970X 32-Core 20 40 60 80 100 77.76 77.74 77.47 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 49.16 49.26 49.34
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 70 140 210 280 350 325.32 324.63 324.11
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Crown c b AMD Ryzen Threadripper 3970X 32-Core 9 18 27 36 45 38.79 38.68 38.66 MIN: 38.44 / MAX: 39.41 MIN: 38.31 / MAX: 39.27 MIN: 38.32 / MAX: 39.41
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 1080p b c AMD Ryzen Threadripper 3970X 32-Core 70 140 210 280 350 303.20 303.03 302.26 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 11 22 33 44 55 46.30 46.38 46.40
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream AMD Ryzen Threadripper 3970X 32-Core b c 80 160 240 320 400 345.42 344.65 344.64
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AMD Ryzen Threadripper 3970X 32-Core c b 8 16 24 32 40 33.99 33.96 33.92 MIN: 33.79 / MAX: 34.43 MIN: 33.77 / MAX: 34.36 MIN: 33.73 / MAX: 34.41
OpenSSL Algorithm: ChaCha20 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: ChaCha20 AMD Ryzen Threadripper 3970X 32-Core b c 30000M 60000M 90000M 120000M 150000M 132709569060 132535967470 132480014470 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: SHA256 c AMD Ryzen Threadripper 3970X 32-Core b 9000M 18000M 27000M 36000M 45000M 42542937860 42506964290 42475560230 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: AES-256-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: AES-256-GCM AMD Ryzen Threadripper 3970X 32-Core c b 30000M 60000M 90000M 120000M 150000M 139151548420 139048226820 138940289020 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
Java SciMark Computational Test: Jacobi Successive Over-Relaxation OpenBenchmarking.org Mflops, More Is Better Java SciMark 2.2 Computational Test: Jacobi Successive Over-Relaxation c b AMD Ryzen Threadripper 3970X 32-Core 400 800 1200 1600 2000 1824.92 1823.29 1822.20
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL Algorithm: RSA4096 AMD Ryzen Threadripper 3970X 32-Core b c 2K 4K 6K 8K 10K 9381.0 9368.1 9368.0 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon b c AMD Ryzen Threadripper 3970X 32-Core 10 20 30 40 50 41.96 41.92 41.90 MIN: 41.73 / MAX: 42.57 MIN: 41.68 / MAX: 42.7 MIN: 41.66 / MAX: 42.52
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL Algorithm: RSA4096 AMD Ryzen Threadripper 3970X 32-Core b c 130K 260K 390K 520K 650K 609998.0 609586.6 609364.3 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
OpenSSL Algorithm: AES-128-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL Algorithm: AES-128-GCM AMD Ryzen Threadripper 3970X 32-Core c b 30000M 60000M 90000M 120000M 150000M 152254146970 152248762370 152243466510 1. OpenSSL 3.0.2 15 Mar 2022 (Library: OpenSSL 3.0.2 15 Mar 2022)
WebP2 Image Encode Encode Settings: Quality 100, Lossless Compression OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 100, Lossless Compression c b AMD Ryzen Threadripper 3970X 32-Core 0.009 0.018 0.027 0.036 0.045 0.04 0.04 0.04 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
WebP2 Image Encode Encode Settings: Quality 95, Compression Effort 7 OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 95, Compression Effort 7 c b AMD Ryzen Threadripper 3970X 32-Core 0.0405 0.081 0.1215 0.162 0.2025 0.18 0.18 0.18 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
WebP2 Image Encode Encode Settings: Quality 75, Compression Effort 7 OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 75, Compression Effort 7 c b AMD Ryzen Threadripper 3970X 32-Core 0.081 0.162 0.243 0.324 0.405 0.36 0.36 0.36 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl
Phoronix Test Suite v10.8.5