res.txt 2 x Intel Xeon Gold 6244 testing with a Dell 060K5C (2.4.1 BIOS) and NVIDIA Quadro GV100 32GB on Ubuntu 20.04.6 LTS via the Phoronix Test Suite. 2024-02-05 13:53: Processor: 2 x Intel Xeon Gold 6244 @ 4.40GHz (16 Cores / 32 Threads), Motherboard: Dell 060K5C (2.4.1 BIOS), Memory: 128GB, Disk: PM981a NVMe SAMSUNG 2048GB + 4 x 8002GB TOSHIBA MG06ACA8, Graphics: NVIDIA Quadro GV100 32GB OS: Ubuntu 20.04.6 LTS, Kernel: 3.10.0-1160.95.1.el7.x86_64 (x86_64), Display Driver: NVIDIA, Vulkan: 1.1.182, Compiler: GCC 9.4.0 + CUDA 12.0, File-System: xfs, Screen Resolution: 800x600 2024-02-05 13:58: Processor: 2 x Intel Xeon Gold 6244 @ 4.40GHz (16 Cores / 32 Threads), Motherboard: Dell 060K5C (2.4.1 BIOS), Memory: 128GB, Disk: PM981a NVMe SAMSUNG 2048GB + 4 x 8002GB TOSHIBA MG06ACA8, Graphics: NVIDIA Quadro GV100 32GB OS: Ubuntu 20.04.6 LTS, Kernel: 3.10.0-1160.95.1.el7.x86_64 (x86_64), Display Driver: NVIDIA, Vulkan: 1.1.182, Compiler: GCC 9.4.0 + CUDA 12.0, File-System: xfs, Screen Resolution: 800x600 2024-02-05 18:03: Processor: 2 x Intel Xeon Gold 6244 @ 4.40GHz (16 Cores / 32 Threads), Motherboard: Dell 060K5C (2.4.1 BIOS), Memory: 128GB, Disk: PM981a NVMe SAMSUNG 2048GB + 4 x 8002GB TOSHIBA MG06ACA8, Graphics: NVIDIA Quadro GV100 32GB OS: Ubuntu 20.04.6 LTS, Kernel: 3.10.0-1160.95.1.el7.x86_64 (x86_64), Display Driver: NVIDIA, Vulkan: 1.1.182, Compiler: GCC 9.4.0 + CUDA 12.0, File-System: xfs, Screen Resolution: 800x600 2024-02-05 18:36: Processor: 2 x Intel Xeon Gold 6244 @ 4.40GHz (16 Cores / 32 Threads), Motherboard: Dell 060K5C (2.4.1 BIOS), Memory: 128GB, Disk: PM981a NVMe SAMSUNG 2048GB + 4 x 8002GB TOSHIBA MG06ACA8, Graphics: NVIDIA Quadro GV100 32GB OS: Ubuntu 20.04.6 LTS, Kernel: 3.10.0-1160.95.1.el7.x86_64 (x86_64), Display Driver: NVIDIA, Vulkan: 1.1.182, Compiler: GCC 9.4.0 + CUDA 12.0, File-System: xfs, Screen Resolution: 800x600 2024-02-06 08:56: Processor: 2 x Intel Xeon Gold 6244 @ 4.40GHz (16 Cores / 32 Threads), Motherboard: Dell 060K5C (2.4.1 BIOS), Memory: 128GB, Disk: PM981a NVMe SAMSUNG 2048GB + 4 x 8002GB TOSHIBA MG06ACA8, Graphics: NVIDIA Quadro GV100 32GB OS: Ubuntu 20.04.6 LTS, Kernel: 3.10.0-1160.95.1.el7.x86_64 (x86_64), Display Driver: NVIDIA, Vulkan: 1.1.182, Compiler: GCC 9.4.0 + CUDA 12.0, File-System: xfs, Screen Resolution: 800x600 NCNN 20230517 Target: CPU - Model: mobilenet ms < Lower Is Better 2024-02-05 13:58 . 16.92 |============================== 2024-02-05 18:36 . 29.71 |===================================================== 2024-02-06 08:56 . 17.13 |=============================== NCNN 20230517 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 2024-02-05 13:58 . 7.18 |= 2024-02-05 18:36 . 373.65 |==================================================== 2024-02-06 08:56 . 7.03 |= NCNN 20230517 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 2024-02-05 13:58 . 6.72 |= 2024-02-05 18:36 . 459.15 |==================================================== 2024-02-06 08:56 . 6.57 |= NCNN 20230517 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better 2024-02-05 13:58 . 7.38 |== 2024-02-05 18:36 . 181.58 |==================================================== 2024-02-06 08:56 . 7.22 |== NCNN 20230517 Target: CPU - Model: mnasnet ms < Lower Is Better 2024-02-05 13:58 . 6.41 |=== 2024-02-05 18:36 . 131.20 |==================================================== 2024-02-06 08:56 . 6.38 |=== NCNN 20230517 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better 2024-02-05 13:58 . 8.47 |====================================================== 2024-02-05 18:36 . 8.53 |====================================================== 2024-02-06 08:56 . 8.37 |===================================================== NCNN 20230517 Target: CPU - Model: blazeface ms < Lower Is Better 2024-02-05 13:58 . 2.91 |==================================================== 2024-02-05 18:36 . 2.83 |=================================================== 2024-02-06 08:56 . 3.02 |====================================================== NCNN 20230517 Target: CPU - Model: googlenet ms < Lower Is Better 2024-02-05 13:58 . 16.21 |======= 2024-02-05 18:36 . 120.62 |==================================================== 2024-02-06 08:56 . 19.81 |========= NCNN 20230517 Target: CPU - Model: vgg16 ms < Lower Is Better 2024-02-05 13:58 . 43.20 |==== 2024-02-05 18:36 . 594.96 |==================================================== 2024-02-06 08:56 . 78.54 |======= NCNN 20230517 Target: CPU - Model: resnet18 ms < Lower Is Better 2024-02-05 13:58 . 9.98 |===== 2024-02-05 18:36 . 104.14 |==================================================== 2024-02-06 08:56 . 9.95 |===== NCNN 20230517 Target: CPU - Model: alexnet ms < Lower Is Better 2024-02-05 13:58 . 6.80 |===== 2024-02-05 18:36 . 74.46 |===================================================== 2024-02-06 08:56 . 6.72 |===== NCNN 20230517 Target: CPU - Model: resnet50 ms < Lower Is Better 2024-02-05 13:58 . 18.46 |= 2024-02-05 18:36 . 1279.57 |=================================================== 2024-02-06 08:56 . 17.98 |= NCNN 20230517 Target: CPU - Model: yolov4-tiny ms < Lower Is Better 2024-02-05 13:58 . 30.89 |====== 2024-02-05 18:36 . 254.60 |==================================================== 2024-02-06 08:56 . 42.97 |========= NCNN 20230517 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better 2024-02-05 13:58 . 15.34 |= 2024-02-05 18:36 . 1029.95 |=================================================== 2024-02-06 08:56 . 16.01 |= NCNN 20230517 Target: CPU - Model: regnety_400m ms < Lower Is Better 2024-02-05 13:58 . 21.42 |============================================= 2024-02-05 18:36 . 25.33 |===================================================== 2024-02-06 08:56 . 20.72 |=========================================== NCNN 20230517 Target: CPU - Model: vision_transformer ms < Lower Is Better 2024-02-05 13:58 . 67.77 |== 2024-02-05 18:36 . 1647.77 |=================================================== 2024-02-06 08:56 . 87.12 |=== NCNN 20230517 Target: CPU - Model: FastestDet ms < Lower Is Better 2024-02-05 13:58 . 8.27 | 2024-02-05 18:36 . 1112.16 |=================================================== 2024-02-06 08:56 . 8.09 | NCNN 20230517 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better 2024-02-05 13:58 . 16.73 |===== 2024-02-05 18:36 . 181.76 |==================================================== 2024-02-06 08:56 . 18.16 |===== NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 2024-02-05 13:58 . 7.06 |==== 2024-02-05 18:36 . 84.63 |===================================================== 2024-02-06 08:56 . 6.98 |==== NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 2024-02-05 13:58 . 6.67 |==== 2024-02-05 18:36 . 81.53 |===================================================== 2024-02-06 08:56 . 6.53 |==== NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better 2024-02-05 13:58 . 7.52 |====================================================== 2024-02-05 18:36 . 7.29 |==================================================== 2024-02-06 08:56 . 7.21 |==================================================== NCNN 20230517 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better 2024-02-05 13:58 . 6.46 |====================================================== 2024-02-05 18:36 . 6.35 |===================================================== 2024-02-06 08:56 . 6.28 |==================================================== NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better 2024-02-05 13:58 . 8.69 |====================================================== 2024-02-05 18:36 . 8.46 |===================================================== 2024-02-06 08:56 . 8.21 |=================================================== NCNN 20230517 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better 2024-02-05 13:58 . 3.01 |====================================================== 2024-02-05 18:36 . 2.94 |===================================================== 2024-02-06 08:56 . 2.99 |====================================================== NCNN 20230517 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better 2024-02-05 13:58 . 16.68 |===================================================== 2024-02-05 18:36 . 16.22 |==================================================== 2024-02-06 08:56 . 16.08 |=================================================== NCNN 20230517 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better 2024-02-05 13:58 . 43.35 |==== 2024-02-05 18:36 . 501.67 |==================================================== 2024-02-06 08:56 . 85.16 |========= NCNN 20230517 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better 2024-02-05 13:58 . 10.01 |===================================================== 2024-02-05 18:36 . 9.85 |==================================================== 2024-02-06 08:56 . 9.69 |=================================================== NCNN 20230517 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better 2024-02-05 13:58 . 6.65 |===================================================== 2024-02-05 18:36 . 6.83 |====================================================== 2024-02-06 08:56 . 6.64 |==================================================== NCNN 20230517 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better 2024-02-05 13:58 . 18.15 |== 2024-02-05 18:36 . 565.39 |==================================================== 2024-02-06 08:56 . 18.03 |== NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better 2024-02-05 13:58 . 31.54 |==== 2024-02-05 18:36 . 421.96 |==================================================== 2024-02-06 08:56 . 38.80 |===== NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better 2024-02-05 13:58 . 15.46 |=== 2024-02-05 18:36 . 244.36 |==================================================== 2024-02-06 08:56 . 14.93 |=== NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better 2024-02-05 13:58 . 21.47 |========== 2024-02-05 18:36 . 112.44 |==================================================== 2024-02-06 08:56 . 20.71 |========== NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer ms < Lower Is Better 2024-02-05 13:58 . 68.48 |=== 2024-02-05 18:36 . 1263.09 |=================================================== 2024-02-06 08:56 . 84.98 |=== NCNN 20230517 Target: Vulkan GPU - Model: FastestDet ms < Lower Is Better 2024-02-05 13:58 . 8.16 |= 2024-02-05 18:36 . 654.73 |==================================================== 2024-02-06 08:56 . 7.32 |= PlaidML FP16: No - Mode: Training - Network: VGG16 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Training - Network: VGG19 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Training - Network: VGG16 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Training - Network: VGG19 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: VGG19 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Training - Network: Mobilenet - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Training - Network: ResNet 50 - Device: CPU FPS > Higher Is Better 2024-02-06 08:56 . 0.37 |====================================================== PlaidML FP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better 2024-02-06 08:56 . 5.03 |====================================================== PlaidML FP16: Yes - Mode: Training - Network: IMDB LSTM - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Training - Network: Mobilenet - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Training - Network: ResNet 50 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: IMDB LSTM - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Training - Network: DenseNet 201 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Training - Network: Inception V3 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Training - Network: NASNer Large - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Inference - Network: Inception V3 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: No - Mode: Inference - Network: NASNer Large - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Training - Network: DenseNet 201 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Training - Network: Inception V3 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Training - Network: NASNer Large - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: CPU Examples Per Second > Higher Is Better PlaidML FP16: Yes - Mode: Inference - Network: NASNer Large - Device: CPU Examples Per Second > Higher Is Better