big bench AMD Ryzen Threadripper 7980X 64-Cores testing with a ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS) and AMD Radeon RX 7900 XT 20GB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401079-PTS-BIGBENCH30&sor&grr .
big bench Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads) ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS) AMD Device 14a4 128GB 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0 AMD Radeon RX 7900 XT 20GB (2025/1249MHz) Realtek ALC1220 DELL U2723QE Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI Ubuntu 23.10 6.7.0-060700rc2daily20231126-generic (x86_64) GNOME Shell 45.0 X Server 1.21.1.7 + Wayland 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56) GCC 13.2.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
big bench tensorflow: CPU - 512 - VGG-16 tensorflow: CPU - 512 - ResNet-50 tensorflow: CPU - 256 - VGG-16 quicksilver: CTS2 quicksilver: CORAL2 P2 tensorflow: CPU - 256 - ResNet-50 pytorch: CPU - 256 - Efficientnet_v2_l pytorch: CPU - 64 - Efficientnet_v2_l pytorch: CPU - 512 - Efficientnet_v2_l pytorch: CPU - 32 - Efficientnet_v2_l pytorch: CPU - 16 - Efficientnet_v2_l tensorflow: CPU - 512 - GoogLeNet pytorch: CPU - 16 - ResNet-152 pytorch: CPU - 32 - ResNet-50 tensorflow: CPU - 64 - VGG-16 pytorch: CPU - 32 - ResNet-152 pytorch: CPU - 64 - ResNet-152 pytorch: CPU - 512 - ResNet-152 pytorch: CPU - 256 - ResNet-152 pytorch: CPU - 1 - Efficientnet_v2_l tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 64 - ResNet-50 pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 1 - ResNet-50 pytorch: CPU - 1 - ResNet-152 tensorflow: CPU - 32 - VGG-16 pytorch: CPU - 16 - ResNet-50 quicksilver: CORAL2 P1 pytorch: CPU - 64 - ResNet-50 tensorflow: CPU - 32 - ResNet-50 tensorflow: CPU - 512 - AlexNet pytorch: CPU - 512 - ResNet-50 tensorflow: CPU - 16 - VGG-16 tensorflow: CPU - 16 - ResNet-50 tensorflow: CPU - 64 - GoogLeNet tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 1 - GoogLeNet tensorflow: CPU - 1 - ResNet-50 tensorflow: CPU - 32 - GoogLeNet tensorflow: CPU - 1 - VGG-16 tensorflow: CPU - 16 - GoogLeNet tensorflow: CPU - 64 - AlexNet tensorflow: CPU - 32 - AlexNet tensorflow: CPU - 16 - AlexNet tensorflow: CPU - 1 - AlexNet a b c 57.97 95.05 57.14 20023333 19776667 91.12 7.47 7.46 7.47 7.49 7.52 315.49 18.68 47.47 52.95 18.76 18.69 18.96 18.99 12.19 311.60 80.0 47.43 59.04 21.94 48.89 47.47 26026667 47.57 69.43 1145.66 47.54 44.41 54.70 272.16 1070.73 21.82 7.19 226.85 9.74 187.92 740.46 510.66 311.97 25.72 57.97 95.08 57.11 19973333 19733333 91.13 7.40 7.45 7.52 7.45 7.46 315.83 18.65 47.24 53 18.67 18.62 18.49 18.80 12.29 311.23 79.77 47.24 59.22 21.91 48.93 47.41 26010000 47.22 69.49 1148.38 45.97 44.5 54.44 272.22 1073.52 22.59 7.26 231.61 9.73 188.5 741.77 508.52 312.08 25.81 57.99 95.04 57.15 20090000 19820000 91.11 7.54 7.52 7.48 7.52 7.50 316.04 18.71 48.12 52.91 19.02 19.38 18.82 19.10 12.27 311.73 79.87 43.07 59.69 21.80 48.81 47.60 25920000 47.81 69.17 1151.27 46.60 44.48 54.72 272.84 1075.09 22.37 7.25 222.04 9.72 188.52 741.04 510.4 312.14 25.96 OpenBenchmarking.org
TensorFlow Device: CPU - Batch Size: 512 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: VGG-16 c b a 13 26 39 52 65 SE +/- 0.02, N = 3 57.99 57.97 57.97
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 b a c 20 40 60 80 100 SE +/- 0.01, N = 3 95.08 95.05 95.04
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: VGG-16 c a b 13 26 39 52 65 SE +/- 0.02, N = 3 57.15 57.14 57.11
Quicksilver Input: CTS2 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CTS2 c a b 4M 8M 12M 16M 20M SE +/- 40960.69, N = 3 SE +/- 49103.07, N = 3 20090000 20023333 19973333 1. (CXX) g++ options: -fopenmp -O3 -march=native
Quicksilver Input: CORAL2 P2 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P2 c a b 4M 8M 12M 16M 20M SE +/- 23333.33, N = 3 SE +/- 57831.17, N = 3 19820000 19776667 19733333 1. (CXX) g++ options: -fopenmp -O3 -march=native
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: ResNet-50 b a c 20 40 60 80 100 SE +/- 0.03, N = 3 91.13 91.12 91.11
PyTorch Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l c a b 2 4 6 8 10 SE +/- 0.01, N = 3 7.54 7.47 7.40 MIN: 7.01 / MAX: 8.17 MIN: 6.98 / MAX: 8.1 MIN: 6.92 / MAX: 8.06
PyTorch Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l c a b 2 4 6 8 10 SE +/- 0.02, N = 3 7.52 7.46 7.45 MIN: 5.94 / MAX: 8.1 MIN: 6.94 / MAX: 8.17 MIN: 6.98 / MAX: 8.07
PyTorch Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l b c a 2 4 6 8 10 SE +/- 0.01, N = 3 7.52 7.48 7.47 MIN: 7.01 / MAX: 8.06 MIN: 7.03 / MAX: 8.13 MIN: 6.97 / MAX: 8.13
PyTorch Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l c a b 2 4 6 8 10 SE +/- 0.01, N = 3 7.52 7.49 7.45 MIN: 7.05 / MAX: 8.13 MIN: 6.96 / MAX: 8.11 MIN: 6.99 / MAX: 8.1
PyTorch Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l a c b 2 4 6 8 10 SE +/- 0.02, N = 3 7.52 7.50 7.46 MIN: 6.92 / MAX: 8.16 MIN: 7.02 / MAX: 8.12 MIN: 6.82 / MAX: 8.06
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: GoogLeNet c b a 70 140 210 280 350 SE +/- 0.17, N = 3 316.04 315.83 315.49
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 c a b 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 18.71 18.68 18.65 MIN: 18.25 / MAX: 18.96 MIN: 18.15 / MAX: 18.95 MIN: 17.9 / MAX: 19.22
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 c a b 11 22 33 44 55 SE +/- 0.12, N = 3 SE +/- 0.43, N = 13 48.12 47.47 47.24 MIN: 44.48 / MAX: 49.1 MIN: 43.75 / MAX: 48.83 MIN: 40.13 / MAX: 49.58
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: VGG-16 b a c 12 24 36 48 60 SE +/- 0.06, N = 3 53.00 52.95 52.91
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 c a b 5 10 15 20 25 SE +/- 0.14, N = 3 19.02 18.76 18.67 MIN: 18.53 / MAX: 19.21 MIN: 18.21 / MAX: 19.24 MIN: 17.72 / MAX: 18.87
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 c a b 5 10 15 20 25 SE +/- 0.03, N = 3 19.38 18.69 18.62 MIN: 18.61 / MAX: 19.57 MIN: 18.14 / MAX: 18.93 MIN: 18.09 / MAX: 18.8
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 a c b 5 10 15 20 25 SE +/- 0.05, N = 3 18.96 18.82 18.49 MIN: 18.41 / MAX: 19.25 MIN: 18.25 / MAX: 19.03 MIN: 18.01 / MAX: 18.69
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 c a b 5 10 15 20 25 SE +/- 0.08, N = 3 19.10 18.99 18.80 MIN: 18.59 / MAX: 19.3 MIN: 18.38 / MAX: 19.33 MIN: 18.29 / MAX: 19.02
PyTorch Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l b c a 3 6 9 12 15 SE +/- 0.03, N = 3 12.29 12.27 12.19 MIN: 12.13 / MAX: 12.42 MIN: 12 / MAX: 12.4 MIN: 11.91 / MAX: 12.38
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: GoogLeNet c a b 70 140 210 280 350 SE +/- 0.26, N = 3 311.73 311.60 311.23
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: ResNet-50 a c b 20 40 60 80 100 SE +/- 0.06, N = 3 80.00 79.87 79.77
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 a b c 11 22 33 44 55 SE +/- 0.44, N = 6 SE +/- 0.65, N = 3 47.43 47.24 43.07 MIN: 39.54 / MAX: 49.38 MIN: 39.04 / MAX: 49.14 MIN: 39.73 / MAX: 45.38
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 c b a 13 26 39 52 65 SE +/- 0.39, N = 14 SE +/- 0.52, N = 3 59.69 59.22 59.04 MIN: 53.84 / MAX: 61.85 MIN: 49.85 / MAX: 62.35 MIN: 49.45 / MAX: 62.07
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 a b c 5 10 15 20 25 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 21.94 21.91 21.80 MIN: 20.91 / MAX: 22.35 MIN: 20.97 / MAX: 22.39 MIN: 21.22 / MAX: 22.14
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: VGG-16 b a c 11 22 33 44 55 SE +/- 0.07, N = 3 48.93 48.89 48.81
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 c a b 11 22 33 44 55 SE +/- 0.21, N = 3 SE +/- 0.15, N = 3 47.60 47.47 47.41 MIN: 43.77 / MAX: 48.91 MIN: 43.56 / MAX: 48.81 MIN: 43.15 / MAX: 48.78
Quicksilver Input: CORAL2 P1 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P1 a b c 6M 12M 18M 24M 30M SE +/- 92796.07, N = 3 SE +/- 79372.54, N = 3 26026667 26010000 25920000 1. (CXX) g++ options: -fopenmp -O3 -march=native
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 c a b 11 22 33 44 55 SE +/- 0.18, N = 3 SE +/- 0.32, N = 3 47.81 47.57 47.22 MIN: 43.73 / MAX: 48.84 MIN: 43.64 / MAX: 49.11 MIN: 43.76 / MAX: 48.92
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: ResNet-50 b a c 15 30 45 60 75 SE +/- 0.03, N = 3 69.49 69.43 69.17
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: AlexNet c b a 200 400 600 800 1000 SE +/- 0.89, N = 3 1151.27 1148.38 1145.66
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 a c b 11 22 33 44 55 SE +/- 0.26, N = 3 47.54 46.60 45.97 MIN: 43.78 / MAX: 49.15 MIN: 43.8 / MAX: 47.68 MIN: 43.46 / MAX: 48.21
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: VGG-16 b c a 10 20 30 40 50 SE +/- 0.01, N = 3 44.50 44.48 44.41
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 c a b 12 24 36 48 60 SE +/- 0.07, N = 3 54.72 54.70 54.44
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: GoogLeNet c b a 60 120 180 240 300 SE +/- 0.93, N = 3 272.84 272.22 272.16
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: AlexNet c b a 200 400 600 800 1000 SE +/- 2.11, N = 3 1075.09 1073.52 1070.73
TensorFlow Device: CPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: GoogLeNet b c a 5 10 15 20 25 SE +/- 0.29, N = 15 22.59 22.37 21.82
TensorFlow Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: ResNet-50 b c a 2 4 6 8 10 SE +/- 0.04, N = 3 7.26 7.25 7.19
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: GoogLeNet b a c 50 100 150 200 250 SE +/- 0.94, N = 3 231.61 226.85 222.04
TensorFlow Device: CPU - Batch Size: 1 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: VGG-16 a b c 3 6 9 12 15 SE +/- 0.01, N = 3 9.74 9.73 9.72
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet c b a 40 80 120 160 200 SE +/- 0.56, N = 3 188.52 188.50 187.92
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: AlexNet b c a 160 320 480 640 800 SE +/- 0.53, N = 3 741.77 741.04 740.46
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: AlexNet a c b 110 220 330 440 550 SE +/- 0.43, N = 3 510.66 510.40 508.52
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet c b a 70 140 210 280 350 SE +/- 0.95, N = 3 312.14 312.08 311.97
TensorFlow Device: CPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: AlexNet c b a 6 12 18 24 30 SE +/- 0.03, N = 3 25.96 25.81 25.72
Phoronix Test Suite v10.8.5