new ts AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Redis 7.0.4 Test: LPOP - Parallel Connections: 50 Requests Per Second > Higher Is Better A . 2498183.80 |=============================================================== B . 1558194.25 |======================================= C . 1515224.50 |====================================== Redis 7.0.4 Test: LPOP - Parallel Connections: 500 Requests Per Second > Higher Is Better A . 1916702.63 |=============================================================== B . 1162784.50 |====================================== C . 1177600.00 |======================================= Redis 7.0.4 Test: GET - Parallel Connections: 50 Requests Per Second > Higher Is Better A . 2469009.92 |=============================================================== B . 2128422.25 |====================================================== C . 2100667.75 |====================================================== NCNN 20220729 Target: CPU - Model: mobilenet ms < Lower Is Better A . 31.04 |============================================================= B . 34.56 |==================================================================== C . 33.04 |================================================================= Mobile Neural Network 2.0 Model: SqueezeNetV1.0 ms < Lower Is Better A . 7.313 |==================================================================== B . 6.653 |============================================================== C . 7.321 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better A . 316.70 |=============================================================== B . 321.74 |================================================================ C . 338.40 |=================================================================== Redis 7.0.4 Test: SET - Parallel Connections: 1000 Requests Per Second > Higher Is Better A . 1329224.63 |=============================================================== B . 1245858.12 |=========================================================== C . 1321178.38 |=============================================================== Redis 7.0.4 Test: SADD - Parallel Connections: 500 Requests Per Second > Higher Is Better A . 1550371.42 |=============================================================== B . 1455206.50 |=========================================================== C . 1516465.38 |============================================================== Mobile Neural Network 2.0 Model: squeezenetv1.1 ms < Lower Is Better A . 3.982 |================================================================ B . 4.056 |================================================================= C . 4.238 |==================================================================== NCNN 20220729 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better A . 164.83 |=================================================================== B . 155.32 |=============================================================== C . 155.83 |=============================================================== NCNN 20220729 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better A . 34.83 |================================================================ B . 35.62 |================================================================== C . 36.74 |==================================================================== Mobile Neural Network 2.0 Model: inception-v3 ms < Lower Is Better A . 27.03 |================================================================= B . 28.46 |==================================================================== C . 27.97 |=================================================================== Mobile Neural Network 2.0 Model: MobileNetV2_224 ms < Lower Is Better A . 5.030 |================================================================== B . 4.899 |================================================================= C . 5.152 |==================================================================== Redis 7.0.4 Test: SET - Parallel Connections: 500 Requests Per Second > Higher Is Better A . 1338680.82 |=============================================================== B . 1319110.88 |============================================================== C . 1274362.75 |============================================================ NCNN 20220729 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better A . 97.43 |================================================================ B . 102.29 |=================================================================== C . 101.49 |================================================================== NCNN 20220729 Target: CPU - Model: yolov4-tiny ms < Lower Is Better A . 40.70 |=================================================================== B . 41.12 |==================================================================== C . 39.56 |================================================================= NCNN 20220729 Target: Vulkan GPU - Model: FastestDet ms < Lower Is Better A . 98.49 |================================================================= B . 101.22 |=================================================================== C . 101.12 |=================================================================== Redis 7.0.4 Test: GET - Parallel Connections: 1000 Requests Per Second > Higher Is Better A . 1668219.58 |============================================================== B . 1697526.25 |=============================================================== C . 1653373.12 |============================================================= Redis 7.0.4 Test: LPOP - Parallel Connections: 1000 Requests Per Second > Higher Is Better A . 1180993.50 |=============================================================== B . 1152163.25 |============================================================= C . 1153624.25 |============================================================== NCNN 20220729 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better A . 182.91 |=================================================================== B . 178.89 |================================================================== C . 181.77 |=================================================================== Redis 7.0.4 Test: LPUSH - Parallel Connections: 500 Requests Per Second > Higher Is Better A . 1227521.85 |============================================================== B . 1255074.00 |=============================================================== C . 1237737.88 |============================================================== NCNN 20220729 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better A . 447.41 |================================================================== B . 442.91 |================================================================== C . 452.63 |=================================================================== NCNN 20220729 Target: CPU - Model: alexnet ms < Lower Is Better A . 17.99 |==================================================================== B . 18.07 |==================================================================== C . 17.69 |=================================================================== NCNN 20220729 Target: CPU - Model: googlenet ms < Lower Is Better A . 35.10 |=================================================================== B . 35.45 |=================================================================== C . 35.84 |==================================================================== NCNN 20220729 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better A . 163.75 |=================================================================== B . 160.38 |================================================================== C . 163.37 |=================================================================== NCNN 20220729 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better A . 43.88 |==================================================================== B . 43.97 |==================================================================== C . 43.09 |=================================================================== NCNN 20220729 Target: CPU - Model: resnet50 ms < Lower Is Better A . 44.63 |==================================================================== B . 43.86 |=================================================================== C . 44.73 |==================================================================== Redis 7.0.4 Test: SET - Parallel Connections: 50 Requests Per Second > Higher Is Better A . 1752688.12 |============================================================== B . 1770758.12 |=============================================================== C . 1743710.50 |============================================================== NCNN 20220729 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better A . 306.21 |================================================================== B . 309.69 |=================================================================== C . 310.94 |=================================================================== NCNN 20220729 Target: CPU - Model: vgg16 ms < Lower Is Better A . 50.01 |==================================================================== B . 49.25 |=================================================================== C . 49.61 |=================================================================== Mobile Neural Network 2.0 Model: mobilenetV3 ms < Lower Is Better A . 2.421 |=================================================================== B . 2.450 |==================================================================== C . 2.458 |==================================================================== Redis 7.0.4 Test: SADD - Parallel Connections: 1000 Requests Per Second > Higher Is Better A . 1497193.50 |============================================================== B . 1501072.38 |============================================================== C . 1519118.38 |=============================================================== Redis 7.0.4 Test: LPUSH - Parallel Connections: 1000 Requests Per Second > Higher Is Better A . 1220257.96 |============================================================== B . 1237332.00 |=============================================================== C . 1226720.12 |============================================================== Redis 7.0.4 Test: LPUSH - Parallel Connections: 50 Requests Per Second > Higher Is Better A . 1564561.87 |============================================================== B . 1585970.62 |=============================================================== C . 1576320.88 |=============================================================== NCNN 20220729 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better A . 1585.62 |================================================================== B . 1574.35 |================================================================== C . 1578.87 |================================================================== NCNN 20220729 Target: CPU - Model: vision_transformer ms < Lower Is Better A . 147.55 |=================================================================== B . 148.51 |=================================================================== C . 147.53 |=================================================================== Redis 7.0.4 Test: SADD - Parallel Connections: 50 Requests Per Second > Higher Is Better A . 1947375.17 |=============================================================== B . 1956880.88 |=============================================================== C . 1960093.50 |=============================================================== NCNN 20220729 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better A . 351.09 |=================================================================== B . 351.98 |=================================================================== C . 352.81 |=================================================================== NCNN 20220729 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better A . 291.61 |=================================================================== B . 291.76 |=================================================================== C . 292.70 |=================================================================== NCNN 20220729 Target: CPU - Model: regnety_400m ms < Lower Is Better A . 68.87 |==================================================================== B . 68.65 |==================================================================== C . 68.85 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: vision_transformer ms < Lower Is Better A . 5699.22 |================================================================== B . 5705.84 |================================================================== C . 5709.48 |================================================================== NCNN 20220729 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better A . 409.96 |=================================================================== B . 410.49 |=================================================================== C . 410.09 |=================================================================== NCNN 20220729 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better A . 814.60 |=================================================================== B . 814.71 |=================================================================== C . 814.64 |=================================================================== NCNN 20220729 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better A . 281.09 |=================================================================== B . 275.06 |================================================================== C . 264.94 |=============================================================== NCNN 20220729 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better A . 531.51 |=================================================================== B . 513.97 |================================================================= C . 516.33 |================================================================= NCNN 20220729 Target: CPU - Model: FastestDet ms < Lower Is Better A . 20.71 |========================================================= B . 23.24 |=============================================================== C . 24.91 |==================================================================== NCNN 20220729 Target: CPU - Model: resnet18 ms < Lower Is Better A . 24.06 |==================================================================== B . 22.50 |================================================================ C . 23.42 |================================================================== NCNN 20220729 Target: CPU - Model: blazeface ms < Lower Is Better A . 9.37 |===================================================================== B . 9.39 |===================================================================== C . 8.76 |================================================================ NCNN 20220729 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better A . 23.86 |==================================================================== B . 23.49 |=================================================================== C . 22.52 |================================================================ NCNN 20220729 Target: CPU - Model: mnasnet ms < Lower Is Better A . 18.10 |==================================================================== B . 17.35 |================================================================= C . 17.58 |================================================================== NCNN 20220729 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better A . 18.52 |==================================================================== B . 18.21 |=================================================================== C . 18.35 |=================================================================== NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better A . 17.94 |==================================================================== B . 17.38 |================================================================== C . 16.26 |============================================================== NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better A . 19.20 |==================================================================== B . 18.17 |================================================================ C . 18.43 |================================================================= Mobile Neural Network 2.0 Model: mobilenet-v1-1.0 ms < Lower Is Better A . 4.333 |==================================================================== B . 4.072 |================================================================ C . 3.896 |============================================================= Mobile Neural Network 2.0 Model: resnet-v2-50 ms < Lower Is Better A . 26.91 |==================================================================== B . 24.91 |=============================================================== C . 24.49 |============================================================== Redis 7.0.4 Test: GET - Parallel Connections: 500 Requests Per Second > Higher Is Better A . 1735192.35 |=============================================================== B . 1644604.00 |============================================================ C . 1649541.25 |============================================================