VMware testing on Ubuntu 22.04.4 LTS via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2405219-NE-PYTORCHGP66 pytorch-gpu-defaultconfig - Phoronix Test Suite pytorch-gpu-defaultconfig VMware testing on Ubuntu 22.04.4 LTS via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2405219-NE-PYTORCHGP66&grr .
pytorch-gpu-defaultconfig Processor Motherboard Memory Disk Graphics OS Kernel Display Driver Compiler File-System Screen Resolution System Layer 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 12 x Intel Xeon Gold 6444Y (23 Cores) Intel 440BX (VMW71.00V.21100432.B64.2301110304 BIOS) 240GB 268GB Virtual disk NVIDIA L40S-8C 8GB Ubuntu 22.04.4 LTS 5.14.0-284.64.1.el9_2.x86_64 (x86_64) NVIDIA GCC 11.4.0 nfs 1024x768 VMware OpenBenchmarking.org - Transparent Huge Pages: always - CPU Microcode: 0x2b000571 - Python 3.10.12 - gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Unknown: No mitigations + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
pytorch-gpu-defaultconfig pytorch: NVIDIA CUDA GPU - 512 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 512 - ResNet-152 pytorch: NVIDIA CUDA GPU - 1 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 1 - ResNet-152 pytorch: NVIDIA CUDA GPU - 512 - ResNet-50 pytorch: NVIDIA CUDA GPU - 1 - ResNet-50 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 61.86 120.07 61.12 119.95 316.59 327.16 OpenBenchmarking.org
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 14 28 42 56 70 SE +/- 0.48, N = 3 61.86 MIN: 53.21 / MAX: 63.33
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 30 60 90 120 150 SE +/- 1.17, N = 3 120.07 MIN: 104 / MAX: 122.75
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 14 28 42 56 70 SE +/- 0.21, N = 3 61.12 MIN: 53.05 / MAX: 62.95
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 30 60 90 120 150 SE +/- 0.72, N = 3 119.95 MIN: 89.65 / MAX: 122.3
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 70 140 210 280 350 SE +/- 1.05, N = 3 316.59 MIN: 186.55 / MAX: 323.06
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - 70 140 210 280 350 SE +/- 0.56, N = 3 327.16 MIN: 193.7 / MAX: 336.22
Phoronix Test Suite v10.8.4