pytorch bench
AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 23.10 via the Phoronix Test Suite.


a: 

	Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200

	OS: Ubuntu 23.10, Kernel: 6.5.0-10-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

b: 

	Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200

	OS: Ubuntu 23.10, Kernel: 6.5.0-10-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

c: 

	Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200

	OS: Ubuntu 23.10, Kernel: 6.5.0-10-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160


PyTorch 2.1
Device: CPU - Batch Size: 1 - Model: ResNet-50
batches/sec > Higher Is Better
a . 20.88 |====================================================================
b . 18.63 |=============================================================
c . 19.18 |==============================================================


PyTorch 2.1
Device: CPU - Batch Size: 1 - Model: ResNet-152
batches/sec > Higher Is Better
a . 8.22 |=====================================================================
b . 7.80 |=================================================================
c . 8.03 |===================================================================


PyTorch 2.1
Device: CPU - Batch Size: 16 - Model: ResNet-50
batches/sec > Higher Is Better
a . 16.88 |====================================================================
b . 16.03 |=================================================================
c . 15.57 |===============================================================


PyTorch 2.1
Device: CPU - Batch Size: 32 - Model: ResNet-50
batches/sec > Higher Is Better
a . 17.11 |====================================================================
b . 16.09 |================================================================
c . 16.52 |==================================================================


PyTorch 2.1
Device: CPU - Batch Size: 64 - Model: ResNet-50
batches/sec > Higher Is Better
a . 15.96 |==================================================================
b . 15.99 |===================================================================
c . 16.35 |====================================================================


PyTorch 2.1
Device: CPU - Batch Size: 16 - Model: ResNet-152
batches/sec > Higher Is Better
a . 6.69 |====================================================================
b . 6.81 |=====================================================================
c . 6.76 |====================================================================


PyTorch 2.1
Device: CPU - Batch Size: 256 - Model: ResNet-50
batches/sec > Higher Is Better
a . 16.66 |===================================================================
b . 16.83 |====================================================================
c . 16.27 |==================================================================


PyTorch 2.1
Device: CPU - Batch Size: 32 - Model: ResNet-152
batches/sec > Higher Is Better
a . 6.78 |=====================================================================
b . 6.76 |=====================================================================
c . 6.69 |====================================================================


PyTorch 2.1
Device: CPU - Batch Size: 512 - Model: ResNet-50
batches/sec > Higher Is Better
a . 16.59 |====================================================================
b . 16.06 |==================================================================
c . 15.64 |================================================================


PyTorch 2.1
Device: CPU - Batch Size: 64 - Model: ResNet-152
batches/sec > Higher Is Better
a . 6.84 |=====================================================================
b . 6.82 |=====================================================================
c . 6.67 |===================================================================


PyTorch 2.1
Device: CPU - Batch Size: 256 - Model: ResNet-152
batches/sec > Higher Is Better
a . 7.01 |=====================================================================
b . 6.52 |================================================================
c . 6.65 |=================================================================


PyTorch 2.1
Device: CPU - Batch Size: 512 - Model: ResNet-152
batches/sec > Higher Is Better
a . 6.89 |=====================================================================
b . 6.66 |===================================================================
c . 6.51 |=================================================================


PyTorch 2.1
Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
a . 4.36 |=====================================================================
b . 4.17 |==================================================================
c . 4.16 |==================================================================


PyTorch 2.1
Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
a . 3.07 |=====================================================================
b . 2.90 |=================================================================
c . 2.93 |==================================================================


PyTorch 2.1
Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
a . 3.01 |=====================================================================
b . 2.99 |=====================================================================
c . 2.96 |====================================================================


PyTorch 2.1
Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
a . 2.96 |=====================================================================
b . 2.92 |====================================================================
c . 2.96 |=====================================================================


PyTorch 2.1
Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
a . 2.93 |===================================================================
b . 2.86 |=================================================================
c . 3.02 |=====================================================================


PyTorch 2.1
Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
a . 2.92 |===================================================================
b . 2.91 |===================================================================
c . 2.99 |=====================================================================