MNN Comparison
Intel Core i9-10900K testing with a Gigabyte Z490 AORUS MASTER (F3 BIOS) and Gigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB on Ubuntu 20.10 via the Phoronix Test Suite.


Ryzen 9 5950X: 

	Processor: AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (2702 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 1000GB Sabrent Rocket 4.0 1TB + 1000GB Samsung SSD 980 PRO 1TB, Graphics: Sapphire AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 6GB (1780/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: ASUS VP28U, Network: Realtek RTL8125 2.5GbE + Intel I211

	OS: Ubuntu 20.10, Kernel: 5.10.0-phx (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Display Driver: modesetting 1.20.9, OpenGL: 4.6 Mesa 20.2.1 (LLVM 11.0.0), Vulkan: 1.2.131, Compiler: GCC 10.2.0, File-System: ext4, Screen Resolution: 3840x2160

Core i7 1165G7: 

	Processor: Intel Core i7-1165G7 @ 4.70GHz (4 Cores / 8 Threads), Motherboard: Dell 0GG9PT (1.0.3 BIOS), Chipset: Intel Tiger Lake-LP, Memory: 16GB, Disk: Kioxia KBG40ZNS256G NVMe 256GB, Graphics: Intel UHD 3GB (1300MHz), Audio: Realtek ALC289, Network: Intel Wi-Fi 6 AX201

	OS: Ubuntu 20.10, Kernel: 5.11.0-rc1-phx (x86_64) 20201228, Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Display Driver: modesetting 1.20.9, OpenGL: 4.6 Mesa 21.0.0-devel (git-7d8d99e 2020-12-25 groovy-oibaf-ppa), Vulkan: 1.2.145, Compiler: GCC 10.2.0, File-System: ext4, Screen Resolution: 1920x1200

EPYC 7742 2P: 

	Processor: 2 x AMD EPYC 7742 64-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD DAYTONA_X (RDY1006G BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 2 x 3841GB Micron_9300_MTFDHAL3T8TDP, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Mellanox MT27710

	OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.8 (LLVM 10.0.0 128 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Ryzen 5 4500U: 

	Processor: AMD Ryzen 5 4500U @ 2.38GHz (6 Cores), Motherboard: LENOVO LNVNB161216 (EECN20WW BIOS), Chipset: AMD Renoir Root Complex, Memory: 16GB, Disk: 256GB SK hynix HFM256GDHTNI-87A0B, Graphics: AMD Renoir 512MB (1500/400MHz), Audio: AMD Device 1637, Network: Realtek RTL8822CE 802.11ac PCIe

	OS: Ubuntu 20.10, Kernel: 5.10.0-pts (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Display Driver: amdgpu 19.1.0, OpenGL: 4.6 Mesa 21.0.0-devel (git-448e603 2020-12-21 groovy-oibaf-ppa) (LLVM 11.0.0), Vulkan: 1.2.145, Compiler: GCC 10.2.0, File-System: ext4, Screen Resolution: 1920x1080

Xeon Platinum 8280 2P: 

	Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE

	OS: Ubuntu 20.04, Kernel: 5.4.0-18-generic (x86_64), Desktop: GNOME Shell 3.36.0, Display Server: X Server 1.20.7, Display Driver: modesetting 1.20.7, OpenGL: 3.3 Mesa 20.0.2 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Core i9 10900K: 

	Processor: Intel Core i9-10900K @ 5.30GHz (10 Cores / 20 Threads), Motherboard: Gigabyte Z490 AORUS MASTER (F3 BIOS), Chipset: Intel Comet Lake PCH, Memory: 16GB, Disk: Samsung SSD 970 EVO 250GB, Graphics: Gigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB (1900/875MHz), Audio: Realtek ALC1220, Monitor: ASUS MG28U, Network: Intel + Intel Wi-Fi 6 AX201

	OS: Ubuntu 20.10, Kernel: 5.11.0-rc1-phx (x86_64) 20201228, Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Display Driver: modesetting 1.20.9, OpenGL: 4.6 Mesa 20.2.1 (LLVM 11.0.0), Vulkan: 1.2.131, Compiler: GCC 10.2.0, File-System: ext4, Screen Resolution: 3840x2160


Mobile Neural Network 2020-09-17
Model: SqueezeNetV1.0
ms < Lower Is Better
Ryzen 9 5950X ......... 6.494  |==========================
Core i7 1165G7 ........ 10.840 |===========================================
EPYC 7742 2P .......... 11.952 |===============================================
Ryzen 5 4500U ......... 8.922  |===================================
Xeon Platinum 8280 2P . 9.189  |====================================
Core i9 10900K ........ 4.475  |==================


Mobile Neural Network 2020-09-17
Model: resnet-v2-50
ms < Lower Is Better
Ryzen 9 5950X ......... 27.83 |==========================
Core i7 1165G7 ........ 51.89 |================================================
EPYC 7742 2P .......... 34.15 |================================
Ryzen 5 4500U ......... 34.36 |================================
Xeon Platinum 8280 2P . 32.84 |==============================
Core i9 10900K ........ 25.58 |========================


Mobile Neural Network 2020-09-17
Model: MobileNetV2_224
ms < Lower Is Better
Ryzen 9 5950X ......... 3.188 |==========================
Core i7 1165G7 ........ 5.917 |================================================
EPYC 7742 2P .......... 5.747 |===============================================
Ryzen 5 4500U ......... 5.496 |=============================================
Xeon Platinum 8280 2P . 5.092 |=========================================
Core i9 10900K ........ 3.006 |========================


Mobile Neural Network 2020-09-17
Model: mobilenet-v1-1.0
ms < Lower Is Better
Ryzen 9 5950X ......... 5.813 |==================================
Core i7 1165G7 ........ 8.111 |================================================
EPYC 7742 2P .......... 5.598 |=================================
Ryzen 5 4500U ......... 5.038 |==============================
Xeon Platinum 8280 2P . 5.135 |==============================
Core i9 10900K ........ 2.973 |==================


Mobile Neural Network 2020-09-17
Model: inception-v3
ms < Lower Is Better
Ryzen 9 5950X ......... 28.18 |====================
Core i7 1165G7 ........ 66.00 |================================================
EPYC 7742 2P .......... 35.46 |==========================
Ryzen 5 4500U ......... 46.17 |==================================
Xeon Platinum 8280 2P . 30.50 |======================
Core i9 10900K ........ 29.68 |======================


Mobile Neural Network 1.1.1
Model: SqueezeNetV1.0
ms < Lower Is Better
Ryzen 9 5950X ......... 5.125  |=====================
Core i7 1165G7 ........ 7.883  |================================
EPYC 7742 2P .......... 11.499 |===============================================
Ryzen 5 4500U ......... 8.137  |=================================
Xeon Platinum 8280 2P . 7.214  |=============================
Core i9 10900K ........ 5.012  |====================


Mobile Neural Network 1.1.1
Model: resnet-v2-50
ms < Lower Is Better
Ryzen 9 5950X ......... 26.60 |=============================
Core i7 1165G7 ........ 43.38 |================================================
EPYC 7742 2P .......... 30.13 |=================================
Ryzen 5 4500U ......... 39.19 |===========================================
Xeon Platinum 8280 2P . 26.80 |==============================
Core i9 10900K ........ 28.48 |================================


Mobile Neural Network 1.1.1
Model: MobileNetV2_224
ms < Lower Is Better
Ryzen 9 5950X ......... 3.357 |================================
Core i7 1165G7 ........ 4.394 |==========================================
EPYC 7742 2P .......... 5.021 |================================================
Ryzen 5 4500U ......... 4.808 |==============================================
Xeon Platinum 8280 2P . 4.025 |======================================
Core i9 10900K ........ 3.323 |================================


Mobile Neural Network 1.1.1
Model: mobilenet-v1-1.0
ms < Lower Is Better
Ryzen 9 5950X ......... 3.535 |================================
Core i7 1165G7 ........ 5.383 |================================================
EPYC 7742 2P .......... 3.512 |===============================
Ryzen 5 4500U ......... 4.824 |===========================================
Xeon Platinum 8280 2P . 2.589 |=======================
Core i9 10900K ........ 3.763 |==================================


Mobile Neural Network 1.1.1
Model: inception-v3
ms < Lower Is Better
Ryzen 9 5950X ......... 28.63 |=======================
Core i7 1165G7 ........ 60.78 |================================================
EPYC 7742 2P .......... 39.81 |===============================
Ryzen 5 4500U ......... 39.89 |================================
Xeon Platinum 8280 2P . 32.45 |==========================
Core i9 10900K ........ 32.07 |=========================