pytorch_all_l AMD Ryzen 9 5900X 12-Core testing with a ASUS TUF GAMING B550M-PLUS (WI-FI) (1801 BIOS) and MSI NVIDIA GeForce RTX 3080 10GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2312292-NE-PYTORCHAL51 .
pytorch_all_l Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution pytorch_all AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS TUF GAMING B550M-PLUS (WI-FI) (1801 BIOS) AMD Starship/Matisse 4 x 16 GB DDR4-2666MT/s CRUCIAL 1000GB Western Digital WDS100T2B0C-00PXH0 MSI NVIDIA GeForce RTX 3080 10GB NVIDIA GA102 HD Audio LG TV Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX200 Ubuntu 22.04 6.2.0-39-generic (x86_64) GNOME Shell 42.9 X Server 1.21.1.4 NVIDIA 535.129.03 4.6.0 OpenCL 3.0 CUDA 12.2.147 1.3.242 GCC 11.4.0 + CUDA 11.5 ext4 5120x2880 OpenBenchmarking.org - Transparent Huge Pages: madvise - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa201009 - Python 3.10.12 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
pytorch_all_l pytorch: CPU - 1 - ResNet-50 pytorch: CPU - 1 - ResNet-152 pytorch: CPU - 16 - ResNet-50 pytorch: CPU - 32 - ResNet-50 pytorch: CPU - 64 - ResNet-50 pytorch: CPU - 16 - ResNet-152 pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 32 - ResNet-152 pytorch: CPU - 512 - ResNet-50 pytorch: CPU - 64 - ResNet-152 pytorch: CPU - 256 - ResNet-152 pytorch: CPU - 512 - ResNet-152 pytorch: CPU - 1 - Efficientnet_v2_l pytorch: CPU - 16 - Efficientnet_v2_l pytorch: CPU - 32 - Efficientnet_v2_l pytorch: CPU - 64 - Efficientnet_v2_l pytorch: CPU - 256 - Efficientnet_v2_l pytorch: CPU - 512 - Efficientnet_v2_l pytorch_all 37.37 14.45 26.65 26.78 26.21 11.13 23.33 11.16 26.35 11.10 11.24 11.08 9.21 6.50 6.50 6.48 6.57 6.53 OpenBenchmarking.org
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 pytorch_all 9 18 27 36 45 SE +/- 0.26, N = 3 37.37 MIN: 31.52 / MAX: 38.8
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 pytorch_all 4 8 12 16 20 SE +/- 0.12, N = 9 14.45 MIN: 13.01 / MAX: 15.49
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 pytorch_all 6 12 18 24 30 SE +/- 0.45, N = 15 26.65 MIN: 20.59 / MAX: 29.47
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 pytorch_all 6 12 18 24 30 SE +/- 0.42, N = 15 26.78 MIN: 20.17 / MAX: 28.27
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 pytorch_all 6 12 18 24 30 SE +/- 0.59, N = 15 26.21 MIN: 19.72 / MAX: 29.44
PyTorch Device: CPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 pytorch_all 3 6 9 12 15 SE +/- 0.04, N = 3 11.13 MIN: 10.87 / MAX: 11.26
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 pytorch_all 6 12 18 24 30 SE +/- 0.24, N = 3 23.33 MIN: 19.48 / MAX: 24.45
PyTorch Device: CPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 pytorch_all 3 6 9 12 15 SE +/- 0.05, N = 3 11.16 MIN: 9.15 / MAX: 11.32
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 pytorch_all 6 12 18 24 30 SE +/- 0.52, N = 15 26.35 MIN: 19.72 / MAX: 28.69
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 pytorch_all 3 6 9 12 15 SE +/- 0.03, N = 3 11.10 MIN: 10.21 / MAX: 11.22
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 pytorch_all 3 6 9 12 15 SE +/- 0.13, N = 3 11.24 MIN: 9.07 / MAX: 11.69
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 pytorch_all 3 6 9 12 15 SE +/- 0.03, N = 3 11.08 MIN: 10.89 / MAX: 11.21
PyTorch Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l pytorch_all 3 6 9 12 15 SE +/- 0.02, N = 3 9.21 MIN: 8.59 / MAX: 9.29
PyTorch Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l pytorch_all 2 4 6 8 10 SE +/- 0.01, N = 3 6.50 MIN: 6.4 / MAX: 6.56
PyTorch Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l pytorch_all 2 4 6 8 10 SE +/- 0.01, N = 3 6.50 MIN: 6.23 / MAX: 6.56
PyTorch Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l pytorch_all 2 4 6 8 10 SE +/- 0.02, N = 3 6.48 MIN: 6.23 / MAX: 6.56
PyTorch Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l pytorch_all 2 4 6 8 10 SE +/- 0.05, N = 3 6.57 MIN: 5.81 / MAX: 6.71
PyTorch Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l pytorch_all 2 4 6 8 10 SE +/- 0.03, N = 3 6.53 MIN: 5.82 / MAX: 6.94
Phoronix Test Suite v10.8.4