pytorch-gpu-defaultconfig
VMware testing on Ubuntu 22.04.4 LTS via the Phoronix Test Suite.


12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB -: 

	Processor: 12 x Intel Xeon Gold 6444Y (23 Cores), Motherboard: Intel 440BX (VMW71.00V.21100432.B64.2301110304 BIOS), Memory: 240GB, Disk: 268GB Virtual disk, Graphics: NVIDIA L40S-8C 8GB

	OS: Ubuntu 22.04.4 LTS, Kernel: 5.14.0-284.64.1.el9_2.x86_64 (x86_64), Display Driver: NVIDIA, Compiler: GCC 11.4.0, File-System: nfs, Screen Resolution: 1024x768, System Layer: VMware


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50
batches/sec > Higher Is Better
12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - . 327.16 |===================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152
batches/sec > Higher Is Better
12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - . 119.95 |===================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50
batches/sec > Higher Is Better
12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - . 316.59 |===================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152
batches/sec > Higher Is Better
12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - . 120.07 |===================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - . 61.12 |====================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
12 x Intel Xeon Gold 6444Y - NVIDIA L40S-8C 8GB - . 61.86 |====================