2024-12-04-1617 AMD Ryzen 9 7950X 16-Core testing with a MSI MPG X670E CARBON WIFI (MS-7D70) v1.0 (1.M1 BIOS) and NVIDIA GeForce RTX 4090 24GB on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2412063-NOKI-202412076&grw .
2024-12-04-1617 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver Compiler File-System Screen Resolution AMD Ryzen 9 7950X 16-Core AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) MSI MPG X670E CARBON WIFI (MS-7D70) v1.0 (1.M1 BIOS) AMD Device 14d8 4 x 48 GB DDR5-3600MT/s Kingston KF560C32-48 4 x 2000GB Samsung SSD 980 PRO 2TB + 2 x 4001GB Samsung SSD 870 + 62GB USB DISK 2.0 NVIDIA GeForce RTX 4090 24GB NVIDIA AD102 HD Audio BenQ GW2270 Realtek RTL8125 2.5GbE + MEDIATEK MT7922 802.11ax PCI Ubuntu 24.04 6.8.0-41-generic (x86_64) GNOME Shell 46.0 X Server 1.21.1.11 nouveau GCC 13.2.0 tmpfs 1920x1080 OpenBenchmarking.org - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601209 - Python 3.12.3 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
2024-12-04-1617 openvino-genai: Gemma-7b-int4-ov - CPU openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU openvino-genai: Falcon-7b-instruct-int4-ov - CPU openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K tensorflow: GPU - 1 - VGG-16 tensorflow: CPU - 1 - AlexNet tensorflow: CPU - 16 - VGG-16 tensorflow: CPU - 32 - VGG-16 tensorflow: CPU - 64 - VGG-16 tensorflow: GPU - 1 - AlexNet compress-7zip: Compression Rating tensorflow: GPU - 16 - VGG-16 compress-7zip: Decompression Rating svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 4 - Bosphorus 1080p tensorflow: CPU - 1 - VGG-16 tensorflow: GPU - 32 - VGG-16 tensorflow: GPU - 64 - VGG-16 tensorflow: CPU - 16 - AlexNet tensorflow: CPU - 256 - VGG-16 tensorflow: CPU - 32 - AlexNet tensorflow: CPU - 512 - VGG-16 tensorflow: CPU - 64 - AlexNet tensorflow: GPU - 16 - AlexNet tensorflow: GPU - 256 - VGG-16 tensorflow: GPU - 32 - AlexNet tensorflow: GPU - 512 - VGG-16 tensorflow: GPU - 64 - AlexNet tensorflow: CPU - 1 - GoogLeNet tensorflow: CPU - 1 - ResNet-50 tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 512 - AlexNet tensorflow: GPU - 1 - GoogLeNet tensorflow: GPU - 1 - ResNet-50 tensorflow: GPU - 256 - AlexNet tensorflow: GPU - 512 - AlexNet tensorflow: CPU - 16 - GoogLeNet tensorflow: CPU - 16 - ResNet-50 tensorflow: CPU - 32 - GoogLeNet tensorflow: CPU - 32 - ResNet-50 tensorflow: CPU - 64 - GoogLeNet tensorflow: CPU - 64 - ResNet-50 tensorflow: GPU - 16 - GoogLeNet tensorflow: GPU - 16 - ResNet-50 tensorflow: GPU - 32 - GoogLeNet tensorflow: GPU - 32 - ResNet-50 tensorflow: GPU - 64 - GoogLeNet tensorflow: GPU - 64 - ResNet-50 tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 256 - ResNet-50 tensorflow: CPU - 512 - GoogLeNet tensorflow: CPU - 512 - ResNet-50 tensorflow: GPU - 256 - GoogLeNet tensorflow: GPU - 256 - ResNet-50 tensorflow: GPU - 512 - GoogLeNet tensorflow: GPU - 512 - ResNet-50 pytorch: CPU - 1 - ResNet-50 pytorch: CPU - 1 - ResNet-152 pytorch: CPU - 16 - ResNet-50 pytorch: CPU - 32 - ResNet-50 pytorch: CPU - 64 - ResNet-50 pytorch: CPU - 16 - ResNet-152 pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 32 - ResNet-152 pytorch: CPU - 512 - ResNet-50 pytorch: CPU - 64 - ResNet-152 pytorch: CPU - 256 - ResNet-152 pytorch: CPU - 512 - ResNet-152 pytorch: CPU - 1 - Efficientnet_v2_l pytorch: CPU - 16 - Efficientnet_v2_l pytorch: CPU - 32 - Efficientnet_v2_l pytorch: CPU - 64 - Efficientnet_v2_l pytorch: CPU - 256 - Efficientnet_v2_l pytorch: CPU - 512 - Efficientnet_v2_l whisper-cpp: ggml-base.en - 2016 State of the Union whisper-cpp: ggml-small.en - 2016 State of the Union whisper-cpp: ggml-medium.en - 2016 State of the Union compress-7zip: Compression Rating compress-7zip: Decompression Rating john-the-ripper: bcrypt john-the-ripper: WPA PSK john-the-ripper: Blowfish john-the-ripper: HMAC-SHA512 john-the-ripper: MD5 build-llvm: Ninja build-llvm: Unix Makefiles ffmpeg: libx264 - Live ffmpeg: libx265 - Live ffmpeg: libx264 - Upload ffmpeg: libx265 - Upload ffmpeg: libx264 - Platform ffmpeg: libx265 - Platform ffmpeg: libx264 - Video On Demand ffmpeg: libx265 - Video On Demand openvino-genai: Gemma-7b-int4-ov - CPU - Time To First Token openvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Token openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Token openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 7.89 18.85 10.45 15.69 10.805 81.824 2.09 11.54 16.45 17.76 18.61 11.88 147842 2.53 162781 257.824 28.946 4.24 2.58 2.61 134.49 19.19 210.45 19.25 290.12 40.43 2.64 45.42 2.65 48.15 51.20 12.89 384.10 403.50 24.25 6.70 50.07 50.36 118.82 33.26 116.32 33.83 113.64 33.66 27.83 8.97 28.22 9.01 28.22 9.04 110.74 33.43 110.87 33.55 28.43 9.01 28.50 9.01 62.93 25.89 43.41 42.89 43.16 18.24 43.11 18.09 43.33 17.80 18.22 18.26 13.92 10.80 10.68 10.72 10.71 10.90 92.60867 259.85652 753.88513 150238 170934 44266 163571 44174 182728000 4252333 386.664 414.752 286.88 180.17 17.45 34.36 65.36 69.23 65.63 69.32 135.94 126.70 54.63 53.06 106.18 95.68 69.33 63.73 OpenBenchmarking.org
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU AMD Ryzen 9 7950X 16-Core 2 4 6 8 10 SE +/- 0.01, N = 3 7.89
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.01, N = 3 18.85
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 10.45
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.03, N = 3 15.69
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 4 - Input: Bosphorus 4K AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.04, N = 3 10.81 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 8 - Input: Bosphorus 4K AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.20, N = 3 81.82 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Device: GPU - Batch Size: 1 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.4703 0.9406 1.4109 1.8812 2.3515 SE +/- 0.01, N = 3 2.09
TensorFlow Device: CPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 11.54
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.01, N = 3 16.45
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.01, N = 3 17.76
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.00, N = 3 18.61
TensorFlow Device: GPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.03, N = 3 11.88
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression Test: Compression Rating AMD Ryzen 9 7950X 16-Core 30K 60K 90K 120K 150K SE +/- 121.76, N = 3 147842 1. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20
TensorFlow Device: GPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5693 1.1386 1.7079 2.2772 2.8465 SE +/- 0.01, N = 3 2.53
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression Test: Decompression Rating AMD Ryzen 9 7950X 16-Core 30K 60K 90K 120K 150K SE +/- 168.14, N = 3 162781 1. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 8 - Input: Bosphorus 1080p AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.25, N = 3 257.82 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 Git Encoder Mode: Preset 4 - Input: Bosphorus 1080p AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.15, N = 3 28.95 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Device: CPU - Batch Size: 1 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.954 1.908 2.862 3.816 4.77 SE +/- 0.00, N = 3 4.24
TensorFlow Device: GPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5805 1.161 1.7415 2.322 2.9025 SE +/- 0.01, N = 3 2.58
TensorFlow Device: GPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5873 1.1746 1.7619 2.3492 2.9365 SE +/- 0.00, N = 3 2.61
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.06, N = 3 134.49
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.01, N = 3 19.19
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 50 100 150 200 250 SE +/- 0.16, N = 3 210.45
TensorFlow Device: CPU - Batch Size: 512 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 5 10 15 20 25 SE +/- 0.02, N = 3 19.25
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.15, N = 3 290.12
TensorFlow Device: GPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 9 18 27 36 45 SE +/- 0.09, N = 3 40.43
TensorFlow Device: GPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.594 1.188 1.782 2.376 2.97 SE +/- 0.01, N = 3 2.64
TensorFlow Device: GPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.05, N = 3 45.42
TensorFlow Device: GPU - Batch Size: 512 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: VGG-16 AMD Ryzen 9 7950X 16-Core 0.5963 1.1926 1.7889 2.3852 2.9815 SE +/- 0.00, N = 3 2.65
TensorFlow Device: GPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 11 22 33 44 55 SE +/- 0.14, N = 3 48.15
TensorFlow Device: CPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 12 24 36 48 60 SE +/- 0.11, N = 3 51.20
TensorFlow Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 12.89
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 80 160 240 320 400 SE +/- 0.17, N = 3 384.10
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 90 180 270 360 450 SE +/- 0.08, N = 3 403.50
TensorFlow Device: GPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 6 12 18 24 30 SE +/- 0.07, N = 3 24.25
TensorFlow Device: GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 1 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 2 4 6 8 10 SE +/- 0.02, N = 3 6.70
TensorFlow Device: GPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 11 22 33 44 55 SE +/- 0.09, N = 3 50.07
TensorFlow Device: GPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: AlexNet AMD Ryzen 9 7950X 16-Core 11 22 33 44 55 SE +/- 0.05, N = 3 50.36
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.19, N = 3 118.82
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.02, N = 3 33.26
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.13, N = 3 116.32
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.01, N = 3 33.83
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.02, N = 3 113.64
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.01, N = 3 33.66
TensorFlow Device: GPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.09, N = 3 27.83
TensorFlow Device: GPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 16 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 8.97
TensorFlow Device: GPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.08, N = 3 28.22
TensorFlow Device: GPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 32 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.00, N = 3 9.01
TensorFlow Device: GPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.04, N = 3 28.22
TensorFlow Device: GPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 64 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 9.04
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.05, N = 3 110.74
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.00, N = 3 33.43
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.02, N = 3 110.87
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.02, N = 3 33.55
TensorFlow Device: GPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.05, N = 3 28.43
TensorFlow Device: GPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 256 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 9.01
TensorFlow Device: GPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: GoogLeNet AMD Ryzen 9 7950X 16-Core 7 14 21 28 35 SE +/- 0.01, N = 3 28.50
TensorFlow Device: GPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: GPU - Batch Size: 512 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.04, N = 3 9.01
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 14 28 42 56 70 SE +/- 0.20, N = 3 62.93 MIN: 45.93 / MAX: 66.01
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 6 12 18 24 30 SE +/- 0.21, N = 3 25.89 MIN: 22.3 / MAX: 26.4
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.48, N = 5 43.41 MIN: 39.89 / MAX: 44.61
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.25, N = 3 42.89 MIN: 40.6 / MAX: 43.82
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.43, N = 3 43.16 MIN: 40.82 / MAX: 44.23
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.04, N = 3 18.24 MIN: 17.72 / MAX: 18.43
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.33, N = 3 43.11 MIN: 40.78 / MAX: 44.21
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.15, N = 3 18.09 MIN: 17.52 / MAX: 18.48
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 AMD Ryzen 9 7950X 16-Core 10 20 30 40 50 SE +/- 0.13, N = 3 43.33 MIN: 40.95 / MAX: 43.88
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.05, N = 3 17.80 MIN: 17.31 / MAX: 18.07
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.14, N = 3 18.22 MIN: 17.5 / MAX: 18.6
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.11, N = 3 18.26 MIN: 17.68 / MAX: 18.59
PyTorch Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.11, N = 3 13.92 MIN: 13.59 / MAX: 14.24
PyTorch Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.15, N = 3 10.80 MIN: 8.55 / MAX: 11.28
PyTorch Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 10.68 MIN: 8.73 / MAX: 11.11
PyTorch Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.09, N = 3 10.72 MIN: 8.64 / MAX: 11.15
PyTorch Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.01, N = 3 10.71 MIN: 8.83 / MAX: 11.09
PyTorch Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l AMD Ryzen 9 7950X 16-Core 3 6 9 12 15 SE +/- 0.03, N = 3 10.90 MIN: 9.08 / MAX: 11.2
Whisper.cpp Model: ggml-base.en - Input: 2016 State of the Union OpenBenchmarking.org Seconds, Fewer Is Better Whisper.cpp 1.6.2 Model: ggml-base.en - Input: 2016 State of the Union AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.23, N = 3 92.61 1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni
Whisper.cpp Model: ggml-small.en - Input: 2016 State of the Union OpenBenchmarking.org Seconds, Fewer Is Better Whisper.cpp 1.6.2 Model: ggml-small.en - Input: 2016 State of the Union AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.32, N = 3 259.86 1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni
Whisper.cpp Model: ggml-medium.en - Input: 2016 State of the Union OpenBenchmarking.org Seconds, Fewer Is Better Whisper.cpp 1.6.2 Model: ggml-medium.en - Input: 2016 State of the Union AMD Ryzen 9 7950X 16-Core 160 320 480 640 800 SE +/- 1.36, N = 3 753.89 1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 24.05 Test: Compression Rating AMD Ryzen 9 7950X 16-Core 30K 60K 90K 120K 150K SE +/- 188.93, N = 3 150238 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 24.05 Test: Decompression Rating AMD Ryzen 9 7950X 16-Core 40K 80K 120K 160K 200K SE +/- 405.66, N = 3 170934 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt AMD Ryzen 9 7950X 16-Core 9K 18K 27K 36K 45K SE +/- 9.84, N = 3 44266 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
John The Ripper Test: WPA PSK OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK AMD Ryzen 9 7950X 16-Core 40K 80K 120K 160K 200K SE +/- 66.12, N = 3 163571 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish AMD Ryzen 9 7950X 16-Core 9K 18K 27K 36K 45K SE +/- 22.75, N = 3 44174 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
John The Ripper Test: HMAC-SHA512 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: HMAC-SHA512 AMD Ryzen 9 7950X 16-Core 40M 80M 120M 160M 200M SE +/- 430001.55, N = 3 182728000 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: MD5 AMD Ryzen 9 7950X 16-Core 900K 1800K 2700K 3600K 4500K SE +/- 7218.80, N = 3 4252333 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja AMD Ryzen 9 7950X 16-Core 80 160 240 320 400 SE +/- 0.30, N = 3 386.66
Timed LLVM Compilation Build System: Unix Makefiles OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Unix Makefiles AMD Ryzen 9 7950X 16-Core 90 180 270 360 450 SE +/- 0.08, N = 3 414.75
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Live AMD Ryzen 9 7950X 16-Core 60 120 180 240 300 SE +/- 0.63, N = 3 286.88 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Live AMD Ryzen 9 7950X 16-Core 40 80 120 160 200 SE +/- 0.04, N = 3 180.17 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Upload AMD Ryzen 9 7950X 16-Core 4 8 12 16 20 SE +/- 0.07, N = 3 17.45 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload AMD Ryzen 9 7950X 16-Core 8 16 24 32 40 SE +/- 0.12, N = 3 34.36 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Platform AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.11, N = 3 65.36 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.10, N = 3 69.23 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx264 - Scenario: Video On Demand AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.39, N = 3 65.63 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.23, N = 3 69.32 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.25, N = 3 135.94
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 30 60 90 120 150 SE +/- 0.17, N = 3 126.70
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 12 24 36 48 60 SE +/- 0.07, N = 3 54.63
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 12 24 36 48 60 SE +/- 0.02, N = 3 53.06
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.05, N = 3 106.18
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 20 40 60 80 100 SE +/- 0.06, N = 3 95.68
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token AMD Ryzen 9 7950X 16-Core 15 30 45 60 75 SE +/- 0.33, N = 3 69.33
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token AMD Ryzen 9 7950X 16-Core 14 28 42 56 70 SE +/- 0.12, N = 3 63.73
Phoronix Test Suite v10.8.5