litert xnnpack AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS) and AMD Radeon RX 5700 8GB on Pop 22.04 via the Phoronix Test Suite. a: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS), Chipset: AMD Starship/Matisse, Memory: 4 x 32GB DDR4-3000MT/s CMK64GX4M2D3000C16, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB, Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Pop 22.04, Kernel: 6.8.0-76060800daily20240311-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.4, OpenGL: 4.6 Mesa 24.0.3-1pop1~1711635559~22.04~7a9f319 (LLVM 15.0.7 DRM 3.57), Vulkan: 1.3.274, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS), Chipset: AMD Starship/Matisse, Memory: 4 x 32GB DDR4-3000MT/s CMK64GX4M2D3000C16, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB, Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Pop 22.04, Kernel: 6.8.0-76060800daily20240311-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.4, OpenGL: 4.6 Mesa 24.0.3-1pop1~1711635559~22.04~7a9f319 (LLVM 15.0.7 DRM 3.57), Vulkan: 1.3.274, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1920x1080 d: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS), Chipset: AMD Starship/Matisse, Memory: 4 x 32GB DDR4-3000MT/s CMK64GX4M2D3000C16, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB, Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Pop 22.04, Kernel: 6.8.0-76060800daily20240311-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.4, OpenGL: 4.6 Mesa 24.0.3-1pop1~1711635559~22.04~7a9f319 (LLVM 15.0.7 DRM 3.57), Vulkan: 1.3.274, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1920x1080 XNNPACK b7b048 Model: QS8MobileNetV2 us < Lower Is Better a . 5696 |================================================================= b . 5691 |================================================================= d . 6038 |===================================================================== XNNPACK b7b048 Model: FP16MobileNetV3Small us < Lower Is Better a . 6357 |===================================================================== b . 5842 |=============================================================== d . 6057 |================================================================== XNNPACK b7b048 Model: FP16MobileNetV3Large us < Lower Is Better a . 9055 |===================================================================== b . 7559 |========================================================== d . 7944 |============================================================= XNNPACK b7b048 Model: FP16MobileNetV2 us < Lower Is Better a . 5908 |================================================================ b . 5983 |================================================================= d . 6324 |===================================================================== XNNPACK b7b048 Model: FP16MobileNetV1 us < Lower Is Better a . 3621 |================================================================= b . 3649 |================================================================== d . 3825 |===================================================================== XNNPACK b7b048 Model: FP32MobileNetV3Small us < Lower Is Better a . 5398 |=================================================== b . 5543 |==================================================== d . 7369 |===================================================================== XNNPACK b7b048 Model: FP32MobileNetV3Large us < Lower Is Better a . 9298 |======================================================== b . 9174 |======================================================== d . 11231 |==================================================================== XNNPACK b7b048 Model: FP32MobileNetV2 us < Lower Is Better a . 6964 |===================================================================== b . 6934 |===================================================================== d . 6889 |==================================================================== XNNPACK b7b048 Model: FP32MobileNetV1 us < Lower Is Better a . 4280 |===================================================================== b . 4238 |==================================================================== d . 4243 |==================================================================== LiteRT 2024-10-15 Model: Mobilenet Quant Microseconds < Lower Is Better a . 3191.88 |================================================================== b . 3089.77 |================================================================ d . 3084.06 |================================================================ LiteRT 2024-10-15 Model: SqueezeNet Microseconds < Lower Is Better a . 6423.64 |================================================================== b . 6349.14 |================================================================= d . 6274.44 |================================================================ LiteRT 2024-10-15 Model: Inception V4 Microseconds < Lower Is Better a . 56528.6 |================================================================= b . 57577.7 |================================================================== d . 56815.6 |================================================================= LiteRT 2024-10-15 Model: DeepLab V3 Microseconds < Lower Is Better a . 10506.6 |================================================================== b . 10343.9 |================================================================= d . 10484.8 |================================================================== LiteRT 2024-10-15 Model: Quantized COCO SSD MobileNet v1 Microseconds < Lower Is Better a . 5332.12 |================================================================= b . 5384.80 |================================================================== d . 5207.07 |================================================================ LiteRT 2024-10-15 Model: Inception ResNet V2 Microseconds < Lower Is Better a . 59856.0 |================================================================== b . 58681.4 |================================================================= d . 59960.4 |================================================================== LiteRT 2024-10-15 Model: NASNet Mobile Microseconds < Lower Is Better a . 54458.3 |================================================================== b . 54646.9 |================================================================== d . 53315.5 |================================================================ LiteRT 2024-10-15 Model: Mobilenet Float Microseconds < Lower Is Better a . 4243.70 |================================================================== b . 4187.56 |================================================================= d . 4173.74 |=================================================================