onnx 1.11 Threadripper AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) and AMD Radeon RX 5700 8GB on Pop 21.10 via the Phoronix Test Suite. A: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Pop 21.10, Kernel: 5.17.0-rc1-sched-core-phx (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server, OpenGL: 4.6 Mesa 21.2.2 (LLVM 12.0.1), Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Pop 21.10, Kernel: 5.17.0-rc1-sched-core-phx (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server, OpenGL: 4.6 Mesa 21.2.2 (LLVM 12.0.1), Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Pop 21.10, Kernel: 5.17.0-rc1-sched-core-phx (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server, OpenGL: 4.6 Mesa 21.2.2 (LLVM 12.0.1), Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 D: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Pop 21.10, Kernel: 5.17.0-rc1-sched-core-phx (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server, OpenGL: 4.6 Mesa 21.2.2 (LLVM 12.0.1), Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 perf-bench Benchmark: Epoll Wait ops/sec > Higher Is Better A . 5044 |=================================================================== B . 5166 |==================================================================== C . 5158 |==================================================================== D . 5213 |===================================================================== perf-bench Benchmark: Futex Hash ops/sec > Higher Is Better A . 3553285 |================================================================== B . 3578390 |================================================================== C . 3483369 |================================================================ D . 3540563 |================================================================= perf-bench Benchmark: Memcpy 1MB GB/sec > Higher Is Better A . 12.08 |==================================================================== B . 11.96 |=================================================================== C . 12.09 |==================================================================== D . 11.97 |=================================================================== perf-bench Benchmark: Memset 1MB GB/sec > Higher Is Better A . 69.64 |==================================================================== B . 69.56 |==================================================================== C . 69.49 |==================================================================== D . 69.50 |==================================================================== perf-bench Benchmark: Sched Pipe ops/sec > Higher Is Better A . 255487 |================================================================= B . 246745 |=============================================================== C . 256473 |================================================================= D . 264487 |=================================================================== perf-bench Benchmark: Futex Lock-Pi ops/sec > Higher Is Better A . 93 |======================================================================= B . 93 |======================================================================= C . 93 |======================================================================= D . 93 |======================================================================= perf-bench Benchmark: Syscall Basic ops/sec > Higher Is Better A . 16605197 |================================================================ B . 16727281 |================================================================ C . 16659267 |================================================================ D . 16878142 |================================================================= ONNX Runtime 1.11 Model: GPT-2 - Device: CPU Inferences Per Minute > Higher Is Better A . 4120 |===================================================================== B . 3850 |================================================================ C . 3868 |================================================================= D . 3869 |================================================================= ONNX Runtime 1.11 Model: yolov4 - Device: CPU Inferences Per Minute > Higher Is Better A . 380 |====================================================================== B . 368 |==================================================================== C . 370 |==================================================================== D . 369 |==================================================================== ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU Inferences Per Minute > Higher Is Better A . 435 |====================================================================== B . 426 |===================================================================== C . 431 |===================================================================== D . 431 |===================================================================== ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU Inferences Per Minute > Higher Is Better A . 81 |======================================================================= B . 81 |======================================================================= C . 81 |======================================================================= D . 81 |======================================================================= ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU Inferences Per Minute > Higher Is Better A . 1096 |===================================================================== B . 1092 |===================================================================== C . 1086 |==================================================================== D . 1092 |===================================================================== ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU Inferences Per Minute > Higher Is Better A . 3634 |================================================================== B . 3662 |=================================================================== C . 3692 |=================================================================== D . 3787 |=====================================================================