pytorch epyc

AMD EPYC 8534P 64-Core testing with a AMD Cinnabar (RCB1009C BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2311161-NE-PYTORCHEP15.

pytorch epycProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionabcAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)AMD Device 14a4192GB800GB Micron_7450_MTFDKBA800TFSASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 23.106.5.0-5-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.7GCC 13.2.0ext4640x480OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseProcessor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212 Python Details- Python 3.11.5Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

pytorch epycpytorch: CPU - 1 - ResNet-50pytorch: CPU - 1 - ResNet-152pytorch: CPU - 16 - ResNet-50pytorch: CPU - 32 - ResNet-50pytorch: CPU - 64 - ResNet-50pytorch: CPU - 16 - ResNet-152pytorch: CPU - 256 - ResNet-50pytorch: CPU - 32 - ResNet-152pytorch: CPU - 512 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 256 - ResNet-152pytorch: CPU - 512 - ResNet-152pytorch: CPU - 1 - Efficientnet_v2_lpytorch: CPU - 16 - Efficientnet_v2_lpytorch: CPU - 32 - Efficientnet_v2_lpytorch: CPU - 64 - Efficientnet_v2_lpytorch: CPU - 256 - Efficientnet_v2_lpytorch: CPU - 512 - Efficientnet_v2_labc45.1116.5236.2137.0136.5114.5336.2514.5137.0214.4414.5614.539.626.056.066.046.046.0445.5516.6536.6736.7736.6814.6536.9014.7136.7914.4414.3414.439.576.056.066.036.056.0344.9516.6036.6936.8736.8414.3936.6214.5836.6914.3714.6414.369.576.076.056.056.046.03OpenBenchmarking.org

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50abc102030405045.1145.5544.95MIN: 43.89 / MAX: 45.82MIN: 44.21 / MAX: 46.24MIN: 44.04 / MAX: 45.47

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152abc4812162016.5216.6516.60MIN: 16.02 / MAX: 16.68MIN: 16.51 / MAX: 16.78MIN: 16.48 / MAX: 16.74

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-50abc81624324036.2136.6736.69MIN: 35.15 / MAX: 36.78MIN: 35.64 / MAX: 37.06MIN: 35.59 / MAX: 37.29

PyTorch

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-50abc91827364537.0136.7736.87MIN: 36.16 / MAX: 37.46MIN: 35.54 / MAX: 37.27MIN: 35.68 / MAX: 37.32

PyTorch

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50abc81624324036.5136.6836.84MIN: 34.81 / MAX: 36.88MIN: 35.58 / MAX: 37.12MIN: 35.86 / MAX: 37.25

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-152abc4812162014.5314.6514.39MIN: 14.32 / MAX: 14.66MIN: 14.51 / MAX: 14.75MIN: 14.21 / MAX: 14.48

PyTorch

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-50abc81624324036.2536.9036.62MIN: 35.17 / MAX: 36.6MIN: 35.68 / MAX: 37.36MIN: 35.48 / MAX: 37.15

PyTorch

Device: CPU - Batch Size: 32 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-152abc4812162014.5114.7114.58MIN: 14.3 / MAX: 14.61MIN: 14.57 / MAX: 14.79MIN: 14.47 / MAX: 14.67

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: ResNet-50abc91827364537.0236.7936.69MIN: 35.43 / MAX: 37.51MIN: 35.89 / MAX: 37.3MIN: 35.61 / MAX: 37.08

PyTorch

Device: CPU - Batch Size: 64 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152abc4812162014.4414.4414.37MIN: 14.22 / MAX: 14.53MIN: 14.35 / MAX: 14.54MIN: 14.15 / MAX: 14.49

PyTorch

Device: CPU - Batch Size: 256 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-152abc4812162014.5614.3414.64MIN: 14.33 / MAX: 14.67MIN: 14.17 / MAX: 14.43MIN: 14.42 / MAX: 14.74

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: ResNet-152abc4812162014.5314.4314.36MIN: 14.35 / MAX: 14.65MIN: 14.28 / MAX: 14.52MIN: 14.17 / MAX: 14.45

PyTorch

Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_labc36912159.629.579.57MIN: 9.53 / MAX: 9.7MIN: 9.45 / MAX: 9.69MIN: 9.45 / MAX: 9.67

PyTorch

Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_labc2468106.056.056.07MIN: 5.61 / MAX: 6.17MIN: 5.64 / MAX: 6.18MIN: 5.68 / MAX: 6.2

PyTorch

Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_labc2468106.066.066.05MIN: 5.47 / MAX: 6.19MIN: 5.53 / MAX: 6.16MIN: 5.5 / MAX: 6.15

PyTorch

Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_labc2468106.046.036.05MIN: 5.5 / MAX: 6.18MIN: 5.51 / MAX: 6.12MIN: 5.66 / MAX: 6.17

PyTorch

Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_labc2468106.046.056.04MIN: 5.58 / MAX: 6.17MIN: 5.61 / MAX: 6.15MIN: 5.63 / MAX: 6.15

PyTorch

Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_labc2468106.046.036.03MIN: 5.54 / MAX: 6.15MIN: 5.54 / MAX: 6.13MIN: 5.59 / MAX: 6.17

Phoronix Test Suite v10.8.4