2024-12-04-1617 AMD Ryzen 9 7950X 16-Core testing with a MSI MPG X670E CARBON WIFI (MS-7D70) v1.0 (1.M1 BIOS) and NVIDIA GeForce RTX 4090 24GB on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2412063-NOKI-202412076&grr .
2024-12-04-1617 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver Compiler File-System Screen Resolution AMD Ryzen 9 7950X 16-Core AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) MSI MPG X670E CARBON WIFI (MS-7D70) v1.0 (1.M1 BIOS) AMD Device 14d8 4 x 48 GB DDR5-3600MT/s Kingston KF560C32-48 4 x 2000GB Samsung SSD 980 PRO 2TB + 2 x 4001GB Samsung SSD 870 + 62GB USB DISK 2.0 NVIDIA GeForce RTX 4090 24GB NVIDIA AD102 HD Audio BenQ GW2270 Realtek RTL8125 2.5GbE + MEDIATEK MT7922 802.11ax PCI Ubuntu 24.04 6.8.0-41-generic (x86_64) GNOME Shell 46.0 X Server 1.21.1.11 nouveau GCC 13.2.0 tmpfs 1920x1080 OpenBenchmarking.org - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601209 - Python 3.12.3 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
2024-12-04-1617 tensorflow: GPU - 512 - VGG-16 tensorflow: GPU - 256 - VGG-16 tensorflow: GPU - 512 - ResNet-50 tensorflow: GPU - 256 - ResNet-50 tensorflow: CPU - 512 - VGG-16 tensorflow: GPU - 64 - VGG-16 tensorflow: GPU - 512 - GoogLeNet tensorflow: CPU - 512 - ResNet-50 tensorflow: CPU - 256 - VGG-16 tensorflow: GPU - 32 - VGG-16 tensorflow: GPU - 512 - AlexNet tensorflow: GPU - 256 - GoogLeNet tensorflow: CPU - 256 - ResNet-50 tensorflow: GPU - 64 - ResNet-50 whisper-cpp: ggml-medium.en - 2016 State of the Union tensorflow: GPU - 16 - VGG-16 tensorflow: GPU - 256 - AlexNet tensorflow: CPU - 512 - GoogLeNet build-llvm: Unix Makefiles tensorflow: GPU - 32 - ResNet-50 build-llvm: Ninja tensorflow: CPU - 64 - VGG-16 whisper-cpp: ggml-small.en - 2016 State of the Union tensorflow: CPU - 256 - GoogLeNet tensorflow: GPU - 64 - GoogLeNet tensorflow: CPU - 64 - ResNet-50 tensorflow: CPU - 32 - VGG-16 tensorflow: GPU - 16 - ResNet-50 ffmpeg: libx264 - Upload pytorch: CPU - 64 - Efficientnet_v2_l pytorch: CPU - 32 - Efficientnet_v2_l pytorch: CPU - 256 - Efficientnet_v2_l pytorch: CPU - 16 - Efficientnet_v2_l pytorch: CPU - 512 - Efficientnet_v2_l tensorflow: GPU - 64 - AlexNet openvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Token openvino-genai: Gemma-7b-int4-ov - CPU - Time To First Token openvino-genai: Gemma-7b-int4-ov - CPU tensorflow: CPU - 512 - AlexNet ffmpeg: libx264 - Platform ffmpeg: libx264 - Video On Demand tensorflow: GPU - 32 - GoogLeNet ffmpeg: libx265 - Platform ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Upload openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU tensorflow: CPU - 16 - VGG-16 pytorch: CPU - 64 - ResNet-152 tensorflow: CPU - 32 - ResNet-50 pytorch: CPU - 32 - ResNet-152 pytorch: CPU - 256 - ResNet-152 pytorch: CPU - 512 - ResNet-152 pytorch: CPU - 16 - ResNet-152 whisper-cpp: ggml-base.en - 2016 State of the Union pytorch: CPU - 1 - Efficientnet_v2_l tensorflow: GPU - 32 - AlexNet pytorch: CPU - 16 - ResNet-50 tensorflow: CPU - 256 - AlexNet tensorflow: GPU - 16 - GoogLeNet tensorflow: CPU - 64 - GoogLeNet john-the-ripper: MD5 john-the-ripper: HMAC-SHA512 openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Token openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Token openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU tensorflow: GPU - 1 - VGG-16 tensorflow: CPU - 16 - ResNet-50 pytorch: CPU - 32 - ResNet-50 tensorflow: GPU - 16 - AlexNet pytorch: CPU - 1 - ResNet-152 pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 512 - ResNet-50 pytorch: CPU - 64 - ResNet-50 ffmpeg: libx265 - Live openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU tensorflow: CPU - 32 - GoogLeNet ffmpeg: libx264 - Live john-the-ripper: WPA PSK john-the-ripper: bcrypt john-the-ripper: Blowfish tensorflow: CPU - 1 - VGG-16 tensorflow: CPU - 64 - AlexNet compress-7zip: Decompression Rating compress-7zip: Compression Rating compress-7zip: Decompression Rating compress-7zip: Compression Rating pytorch: CPU - 1 - ResNet-50 tensorflow: GPU - 1 - ResNet-50 tensorflow: CPU - 32 - AlexNet svt-av1: Preset 4 - Bosphorus 4K tensorflow: CPU - 16 - GoogLeNet tensorflow: CPU - 16 - AlexNet tensorflow: GPU - 1 - AlexNet tensorflow: CPU - 1 - ResNet-50 tensorflow: CPU - 1 - AlexNet svt-av1: Preset 8 - Bosphorus 4K tensorflow: GPU - 1 - GoogLeNet svt-av1: Preset 4 - Bosphorus 1080p tensorflow: CPU - 1 - GoogLeNet svt-av1: Preset 8 - Bosphorus 1080p AMD Ryzen 9 7950X 16-Core 2.65 2.64 9.01 9.01 19.25 2.61 28.50 33.55 19.19 2.58 50.36 28.43 33.43 9.04 753.88513 2.53 50.07 110.87 414.752 9.01 386.664 18.61 259.85652 110.74 28.22 33.66 17.76 8.97 17.45 10.72 10.68 10.71 10.80 10.90 48.15 126.70 135.94 7.89 403.50 65.36 65.63 28.22 69.23 69.32 34.36 95.68 106.18 10.45 16.45 17.80 33.83 18.09 18.22 18.26 18.24 92.60867 13.92 45.42 43.41 384.10 27.83 113.64 4252333 182728000 53.06 54.63 18.85 2.09 33.26 42.89 40.43 25.89 43.11 43.33 43.16 180.17 63.73 69.33 15.69 116.32 286.88 163571 44266 44174 4.24 290.12 162781 147842 170934 150238 62.93 6.70 210.45 10.805 118.82 134.49 11.88 12.89 11.54 81.824 24.25 28.946 51.20 257.824 OpenBenchmarking.org
TensorFlow Device: GPU - Batch Size: 512 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5963 1.1926 1.7889 2.3852 2.9815 SE +/- 0.00, N = 3 2.65
TensorFlow Device: GPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.594 1.188 1.782 2.376 2.97 SE +/- 0.01, N = 3 2.64
TensorFlow Device: GPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.04, N = 3 9.01
TensorFlow Device: GPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 9.01
TensorFlow Device: CPU - Batch Size: 512 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.02, N = 3 19.25
TensorFlow Device: GPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5873 1.1746 1.7619 2.3492 2.9365 SE +/- 0.00, N = 3 2.61
TensorFlow Device: GPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.01, N = 3 28.50
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.02, N = 3 33.55
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.01, N = 3 19.19
TensorFlow Device: GPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5805 1.161 1.7415 2.322 2.9025 SE +/- 0.01, N = 3 2.58
TensorFlow Device: GPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 11 22 33 44 55 SE +/- 0.05, N = 3 50.36
TensorFlow Device: GPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.05, N = 3 28.43
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.00, N = 3 33.43
TensorFlow Device: GPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 9.04
Whisper.cpp Model: ggml-medium.en - Input: 2016 State of the Union OpenBenchmarking.org Seconds, Fewer Is Better Whisper.cpp 1.6.2 Model: ggml-medium.en - Input: 2016 State of the Union AMD Ryzen 9 7950X 16-Core 160 320 480 640 800 SE +/- 1.36, N = 3 753.89 1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni
TensorFlow Device: GPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5693 1.1386 1.7079 2.2772 2.8465 SE +/- 0.01, N = 3 2.53
TensorFlow Device: GPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 11 22 33 44 55 SE +/- 0.09, N = 3 50.07
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.02, N = 3 110.87
Timed LLVM Compilation Build System: Unix Makefiles OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Unix Makefiles AMD Ryzen 9 7950X 16-Core 90 180 270 360 450 SE +/- 0.08, N = 3 414.75
TensorFlow Device: GPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.00, N = 3 9.01
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja AMD Ryzen 9 7950X 16-Core 80 160 240 320 400 SE +/- 0.30, N = 3 386.66
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.00, N = 3 18.61
Whisper.cpp Model: ggml-small.en - Input: 2016 State of the Union OpenBenchmarking.org Seconds, Fewer Is Better Whisper.cpp 1.6.2 Model: ggml-small.en - Input: 2016 State of the Union AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.32, N = 3 259.86 1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.05, N = 3 110.74
TensorFlow Device: GPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.04, N = 3 28.22
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.01, N = 3 33.66
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.01, N = 3 17.76
TensorFlow Device: GPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 8.97
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Upload AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.07, N = 3 17.45 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
PyTorch Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.09, N = 3 10.72 MIN: 8.64 / MAX: 11.15
PyTorch Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 10.68 MIN: 8.73 / MAX: 11.11
PyTorch Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 10.71 MIN: 8.83 / MAX: 11.09
PyTorch Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.15, N = 3 10.80 MIN: 8.55 / MAX: 11.28
PyTorch Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.03, N = 3 10.90 MIN: 9.08 / MAX: 11.2
TensorFlow Device: GPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 11 22 33 44 55 SE +/- 0.14, N = 3 48.15
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.17, N = 3 126.70
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.25, N = 3 135.94
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU AMD Ryzen 9 7950X 16-Core 2 4 6 8 10 SE +/- 0.01, N = 3 7.89
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 90 180 270 360 450 SE +/- 0.08, N = 3 403.50
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Platform AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.11, N = 3 65.36 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Video On Demand AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.39, N = 3 65.63 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
TensorFlow Device: GPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.08, N = 3 28.22
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.10, N = 3 69.23 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.23, N = 3 69.32 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.12, N = 3 34.36 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.06, N = 3 95.68
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.05, N = 3 106.18
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 10.45
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.01, N = 3 16.45
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.05, N = 3 17.80 MIN: 17.31 / MAX: 18.07
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.01, N = 3 33.83
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.15, N = 3 18.09 MIN: 17.52 / MAX: 18.48
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.14, N = 3 18.22 MIN: 17.5 / MAX: 18.6
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.11, N = 3 18.26 MIN: 17.68 / MAX: 18.59
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.04, N = 3 18.24 MIN: 17.72 / MAX: 18.43
Whisper.cpp Model: ggml-base.en - Input: 2016 State of the Union OpenBenchmarking.org Seconds, Fewer Is Better Whisper.cpp 1.6.2 Model: ggml-base.en - Input: 2016 State of the Union AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.23, N = 3 92.61 1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni
PyTorch Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.11, N = 3 13.92 MIN: 13.59 / MAX: 14.24
TensorFlow Device: GPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.05, N = 3 45.42
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.48, N = 5 43.41 MIN: 39.89 / MAX: 44.61
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 80 160 240 320 400 SE +/- 0.17, N = 3 384.10
TensorFlow Device: GPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.09, N = 3 27.83
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.02, N = 3 113.64
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: MD5 AMD Ryzen 9 7950X 16-Core 900K 1800K 2700K 3600K 4500K SE +/- 7218.80, N = 3 4252333 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
John The Ripper Test: HMAC-SHA512 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: HMAC-SHA512 AMD Ryzen 9 7950X 16-Core 40M 80M 120M 160M 200M SE +/- 430001.55, N = 3 182728000 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 12 24 36 48 60 SE +/- 0.02, N = 3 53.06
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 12 24 36 48 60 SE +/- 0.07, N = 3 54.63
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.01, N = 3 18.85
TensorFlow Device: GPU - Batch Size: 1 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.4703 0.9406 1.4109 1.8812 2.3515 SE +/- 0.01, N = 3 2.09
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.02, N = 3 33.26
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.25, N = 3 42.89 MIN: 40.6 / MAX: 43.82
TensorFlow Device: GPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 9 18 27 36 45 SE +/- 0.09, N = 3 40.43
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 6 12 18 24 30 SE +/- 0.21, N = 3 25.89 MIN: 22.3 / MAX: 26.4
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.33, N = 3 43.11 MIN: 40.78 / MAX: 44.21
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.13, N = 3 43.33 MIN: 40.95 / MAX: 43.88
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.43, N = 3 43.16 MIN: 40.82 / MAX: 44.23
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Live AMD Ryzen 9 7950X 16-Core 40 80 120 160 200 SE +/- 0.04, N = 3 180.17 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 14 28 42 56 70 SE +/- 0.12, N = 3 63.73
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.33, N = 3 69.33
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.03, N = 3 15.69
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.13, N = 3 116.32
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Live AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.63, N = 3 286.88 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
John The Ripper Test: WPA PSK OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK AMD Ryzen 9 7950X 16-Core 40K 80K 120K 160K 200K SE +/- 66.12, N = 3 163571 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt AMD Ryzen 9 7950X 16-Core 9K 18K 27K 36K 45K SE +/- 9.84, N = 3 44266 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish AMD Ryzen 9 7950X 16-Core 9K 18K 27K 36K 45K SE +/- 22.75, N = 3 44174 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
TensorFlow Device: CPU - Batch Size: 1 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.954 1.908 2.862 3.816 4.77 SE +/- 0.00, N = 3 4.24
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.15, N = 3 290.12
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression Test: Decompression Rating AMD Ryzen 9 7950X 16-Core 30K 60K 90K 120K 150K SE +/- 168.14, N = 3 162781 1. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression Test: Compression Rating AMD Ryzen 9 7950X 16-Core 30K 60K 90K 120K 150K SE +/- 121.76, N = 3 147842 1. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 24.05 Test: Decompression Rating AMD Ryzen 9 7950X 16-Core 40K 80K 120K 160K 200K SE +/- 405.66, N = 3 170934 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 24.05 Test: Compression Rating AMD Ryzen 9 7950X 16-Core 30K 60K 90K 120K 150K SE +/- 188.93, N = 3 150238 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 14 28 42 56 70 SE +/- 0.20, N = 3 62.93 MIN: 45.93 / MAX: 66.01
TensorFlow Device: GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 2 4 6 8 10 SE +/- 0.02, N = 3 6.70
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 50 100 150 200 250 SE +/- 0.16, N = 3 210.45
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 4 - Input: Bosphorus 4K AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.04, N = 3 10.81 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.19, N = 3 118.82
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.06, N = 3 134.49
TensorFlow Device: GPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.03, N = 3 11.88
TensorFlow Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 12.89
TensorFlow Device: CPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 11.54
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 8 - Input: Bosphorus 4K AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.20, N = 3 81.82 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Device: GPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 6 12 18 24 30 SE +/- 0.07, N = 3 24.25
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 4 - Input: Bosphorus 1080p AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.15, N = 3 28.95 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Device: CPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 12 24 36 48 60 SE +/- 0.11, N = 3 51.20
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 8 - Input: Bosphorus 1080p AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.25, N = 3 257.82 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Phoronix Test Suite v10.8.5