pyt AMD Ryzen Threadripper PRO 5965WX 24-Cores testing with a ASUS Pro WS WRX80E-SAGE SE WIFI (1201 BIOS) and ASUS NVIDIA NV106 2GB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2311165-NE-PYT74848100&grw&sor&rro .
pyt Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution a b c AMD Ryzen Threadripper PRO 5965WX 24-Cores @ 3.80GHz (24 Cores / 48 Threads) ASUS Pro WS WRX80E-SAGE SE WIFI (1201 BIOS) AMD Starship/Matisse 128GB 2048GB SOLIDIGM SSDPFKKW020X7 ASUS NVIDIA NV106 2GB AMD Starship/Matisse VA2431 2 x Intel X550 + Intel Wi-Fi 6 AX200 Ubuntu 23.10 6.5.0-10-generic (x86_64) GNOME Shell 45.0 X Server + Wayland nouveau 4.3 Mesa 23.2.1-1ubuntu3 GCC 13.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa008205 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
pyt pytorch: CPU - 1 - ResNet-50 pytorch: CPU - 1 - ResNet-152 pytorch: CPU - 16 - ResNet-50 pytorch: CPU - 32 - ResNet-50 pytorch: CPU - 64 - ResNet-50 pytorch: CPU - 16 - ResNet-152 pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 32 - ResNet-152 pytorch: CPU - 512 - ResNet-50 pytorch: CPU - 64 - ResNet-152 pytorch: CPU - 256 - ResNet-152 pytorch: CPU - 512 - ResNet-152 pytorch: CPU - 1 - Efficientnet_v2_l pytorch: CPU - 16 - Efficientnet_v2_l pytorch: CPU - 32 - Efficientnet_v2_l pytorch: CPU - 64 - Efficientnet_v2_l pytorch: CPU - 256 - Efficientnet_v2_l pytorch: CPU - 512 - Efficientnet_v2_l a b c 40.49 15.78 31.77 31.19 31.90 12.61 32.41 12.60 32.08 12.45 12.42 12.46 9.67 7.06 6.93 6.98 6.99 6.98 40.32 15.82 31.95 32.17 31.67 12.45 32.00 12.29 32.17 12.48 12.33 12.37 9.69 7.04 6.99 6.95 7.00 6.99 40.80 16.12 31.91 32.20 31.47 12.42 31.70 12.52 32.51 12.48 12.37 12.35 9.59 6.95 6.93 6.93 6.99 6.95 OpenBenchmarking.org
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 b a c 9 18 27 36 45 40.32 40.49 40.80 MIN: 37.53 / MAX: 40.57 MIN: 36.35 / MAX: 40.84 MIN: 37.94 / MAX: 41.03
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 a b c 4 8 12 16 20 15.78 15.82 16.12 MIN: 13.65 / MAX: 16 MIN: 15.34 / MAX: 15.9 MIN: 15.63 / MAX: 16.18
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 a c b 7 14 21 28 35 31.77 31.91 31.95 MIN: 28.82 / MAX: 32.17 MIN: 30.03 / MAX: 32.14 MIN: 29.97 / MAX: 32.29
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 a b c 7 14 21 28 35 31.19 32.17 32.20 MIN: 26.98 / MAX: 32.29 MIN: 30.23 / MAX: 32.41 MIN: 30.06 / MAX: 32.51
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 c b a 7 14 21 28 35 31.47 31.67 31.90 MIN: 29.63 / MAX: 31.67 MIN: 29.72 / MAX: 31.94 MIN: 28.18 / MAX: 32.3
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 c b a 3 6 9 12 15 12.42 12.45 12.61 MIN: 12.08 / MAX: 12.5 MIN: 12.05 / MAX: 12.53 MIN: 11.48 / MAX: 12.74
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 c b a 8 16 24 32 40 31.70 32.00 32.41 MIN: 29.83 / MAX: 32.04 MIN: 27.01 / MAX: 32.27 MIN: 30.42 / MAX: 32.66
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 b c a 3 6 9 12 15 12.29 12.52 12.60 MIN: 11.92 / MAX: 12.37 MIN: 12.14 / MAX: 12.59 MIN: 12.25 / MAX: 12.67
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 a b c 8 16 24 32 40 32.08 32.17 32.51 MIN: 30.03 / MAX: 32.31 MIN: 30.04 / MAX: 32.45 MIN: 28.02 / MAX: 32.79
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 a b c 3 6 9 12 15 12.45 12.48 12.48 MIN: 12.16 / MAX: 12.53 MIN: 12.14 / MAX: 12.58 MIN: 12.17 / MAX: 12.57
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 b c a 3 6 9 12 15 12.33 12.37 12.42 MIN: 12 / MAX: 12.45 MIN: 12.04 / MAX: 12.42 MIN: 12.09 / MAX: 12.48
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 c b a 3 6 9 12 15 12.35 12.37 12.46 MIN: 10.69 / MAX: 12.45 MIN: 12.07 / MAX: 12.44 MIN: 12.15 / MAX: 12.52
PyTorch Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l c a b 3 6 9 12 15 9.59 9.67 9.69 MIN: 9.39 / MAX: 9.62 MIN: 9.48 / MAX: 9.72 MIN: 9.49 / MAX: 9.73
PyTorch Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l c b a 2 4 6 8 10 6.95 7.04 7.06 MIN: 6.84 / MAX: 6.99 MIN: 6.94 / MAX: 7.07 MIN: 6.96 / MAX: 7.09
PyTorch Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l a c b 2 4 6 8 10 6.93 6.93 6.99 MIN: 6.83 / MAX: 6.96 MIN: 6.36 / MAX: 6.96 MIN: 6.14 / MAX: 7.09
PyTorch Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l c b a 2 4 6 8 10 6.93 6.95 6.98 MIN: 6.83 / MAX: 6.97 MIN: 6.85 / MAX: 6.98 MIN: 6.87 / MAX: 7.01
PyTorch Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l a c b 2 4 6 8 10 6.99 6.99 7.00 MIN: 6.47 / MAX: 7.04 MIN: 6.92 / MAX: 7.03 MIN: 6.89 / MAX: 7.03
PyTorch Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l c a b 2 4 6 8 10 6.95 6.98 6.99 MIN: 6.84 / MAX: 6.97 MIN: 6.87 / MAX: 7.01 MIN: 6.89 / MAX: 7.02
Phoronix Test Suite v10.8.5