pytorch-test AMD Ryzen 7 5700X 8-Core testing with a MSI PRO B550M-P GEN3 (MS-7D95) v1.0 (1.60 BIOS) and NVIDIA GeForce RTX 4070 SUPER 12GB on Debian via the Phoronix Test Suite. All options: Processor: AMD Ryzen 7 5700X 8-Core @ 3.40GHz (8 Cores / 16 Threads), Motherboard: MSI PRO B550M-P GEN3 (MS-7D95) v1.0 (1.60 BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: 256GB ARDOR GAMING m.2 NVME 256Gb AL1282 + 4001GB Seagate ST4000VX016-3CV1 + 512GB Apacer AS350 512, Graphics: NVIDIA GeForce RTX 4070 SUPER 12GB, Audio: NVIDIA Device 22bc, Monitor: PHL 242V8, Network: Realtek RTL8111/8168/8211/8411 OS: Debian, Kernel: 6.6.15-amd64 (x86_64), Desktop: Xfce 4.18, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.54.15, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.89 + OpenCL 3.0 PoCL 5.0+debian Linux +Asserts RELOC SPIR LLVM 16.0.6 SLEEF DISTRO POCL_DEBUG, Compiler: GCC 13.2.0 + CUDA 12.0, File-System: ext4, Screen Resolution: 4480x1440 PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 batches/sec > Higher Is Better All options . 44.60 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 batches/sec > Higher Is Better All options . 18.16 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 batches/sec > Higher Is Better All options . 28.47 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 batches/sec > Higher Is Better All options . 28.33 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 batches/sec > Higher Is Better All options . 27.77 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 batches/sec > Higher Is Better All options . 11.47 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 batches/sec > Higher Is Better All options . 27.81 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 batches/sec > Higher Is Better All options . 11.52 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 batches/sec > Higher Is Better All options . 27.94 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 batches/sec > Higher Is Better All options . 11.50 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 batches/sec > Higher Is Better All options . 11.41 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 batches/sec > Higher Is Better All options . 11.32 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 10.98 |========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 7.74 |=========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 7.61 |=========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 7.60 |=========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 7.50 |=========================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 7.44 |=========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 batches/sec > Higher Is Better All options . 212.31 |========================================================= PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 batches/sec > Higher Is Better All options . 76.01 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50 batches/sec > Higher Is Better All options . 214.58 |========================================================= PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50 batches/sec > Higher Is Better All options . 217.50 |========================================================= PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50 batches/sec > Higher Is Better All options . 217.22 |========================================================= PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152 batches/sec > Higher Is Better All options . 73.74 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50 batches/sec > Higher Is Better All options . 212.89 |========================================================= PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152 batches/sec > Higher Is Better All options . 76.28 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 batches/sec > Higher Is Better All options . 215.10 |========================================================= PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152 batches/sec > Higher Is Better All options . 75.03 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152 batches/sec > Higher Is Better All options . 76.76 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 batches/sec > Higher Is Better All options . 77.12 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 40.73 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 38.81 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 39.03 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 39.00 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 39.65 |========================================================== PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l batches/sec > Higher Is Better All options . 37.97 |==========================================================