2 x Intel Xeon Gold 6244 testing with a Dell 060K5C (2.4.1 BIOS) and NVIDIA Quadro GV100 32GB on Ubuntu 20.04.6 LTS via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2402069-NE-RESTXT08482
res.txt,
"NCNN 20230517 - Target: CPU - Model: mobilenet",
Lower Results Are Better
"2024-02-05 13:58",16.06,16.15,17.55,17.91,14.87,18.08,16.9,17.84,16.16,16.81,17.77,18.37,16.07,18.25,15.04
"2024-02-05 18:36",128.82,17.13,16.95,17.65,18.22,16.24,16.17,17.69,18.56
"2024-02-06 08:56",14.62,17.51,18.19,17.06,16.7,17.28,17.62,16.54,17.58,17.69,17.63
"NCNN 20230517 - Target: CPU-v2-v2 - Model: mobilenet-v2",
Lower Results Are Better
"2024-02-05 13:58",7.05,7.28,7.63,7.69,7.39,7.31,7.38,7.21,7.26,7.47,7.04,6.31,7.3,6.02,7.4
"2024-02-05 18:36",1154.29,7.46,5.97,7.59,883.3,7.22,135.84,7.26,1153.88
"2024-02-06 08:56",6.99,6.98,6.88,7.02,7.43,7.14,7.07,6.9,6.93,7.03,6.92
"NCNN 20230517 - Target: CPU-v3-v3 - Model: mobilenet-v3",
Lower Results Are Better
"2024-02-05 13:58",6.5,6.74,7.1,7.07,6.81,6.75,6.77,6.71,6.74,6.98,6.76,6.14,6.81,6,6.97
"2024-02-05 18:36",1355.78,6.83,6.01,32.44,6.96,6.84,1355.08,6.81,1355.59
"2024-02-06 08:56",6.57,6.42,6.55,6.46,6.81,6.53,6.82,6.59,6.56,6.45,6.48
"NCNN 20230517 - Target: CPU - Model: shufflenet-v2",
Lower Results Are Better
"2024-02-05 13:58",7.2,7.51,7.58,7.46,7.53,7.33,7.47,7.29,7.46,7.22,7.46,7.41,7.53,7.15,7.04
"2024-02-05 18:36",7.22,7.58,7.02,7.5,7.44,1575.92,6.72,7.62,7.21
"2024-02-06 08:56",7.34,7.26,7.22,7.19,7.36,7.15,7.28,7.08,7.17,7.22,7.14
"NCNN 20230517 - Target: CPU - Model: mnasnet",
Lower Results Are Better
"2024-02-05 13:58",6.27,6.4,7.02,6.75,6.36,6.4,6.47,6.44,6.48,6.57,6.51,5.66,6.59,5.61,6.6
"2024-02-05 18:36",6.59,6.48,5.54,6.3,6.57,1131.1,5.23,6.47,6.53
"2024-02-06 08:56",6.36,6.22,7.24,6.17,6.62,6.24,6.43,6.23,6.2,6.18,6.26
"NCNN 20230517 - Target: CPU - Model: efficientnet-b0",
Lower Results Are Better
"2024-02-05 13:58",8.28,8.47,9.12,7.75,8.61,8.81,8.63,8.32,8.64,8.45,8.69,7.87,8.74,7.87,8.76
"2024-02-05 18:36",8.57,8.87,8.02,8.72,8.51,9.19,7.75,8.6,8.52
"2024-02-06 08:56",8.45,8.21,8.82,8.15,8.77,8.37,8.46,8.17,8.18,8.33,8.17
"NCNN 20230517 - Target: CPU - Model: blazeface",
Lower Results Are Better
"2024-02-05 13:58",2.84,3.27,3.16,2.43,3.13,3.22,2.42,2.99,3.11,2.73,3.16,2.55,3.06,2.5,3.11
"2024-02-05 18:36",3.07,2.52,2.29,3.06,3.04,3.17,2.32,3.03,2.99
"2024-02-06 08:56",3.07,3,3.11,2.94,3.13,2.97,3.06,2.95,3.03,2.96,2.96
"NCNN 20230517 - Target: CPU - Model: googlenet",
Lower Results Are Better
"2024-02-05 13:58",16.14,17.13,16.86,13.88,17,17.16,14,16.74,16.83,15.28,17.25,15.94,16.51,15.67,16.7
"2024-02-05 18:36",16.2,15.54,14.9,16.76,16.66,17.09,14.42,16.86,957.17
"2024-02-06 08:56",16.23,16.01,16.85,16.14,16.83,54.9,16.35,16.23,16.18,16.02,16.18
"NCNN 20230517 - Target: CPU - Model: vgg16",
Lower Results Are Better
"2024-02-05 13:58",42.87,42.18,42.45,42.02,43.16,41.91,45.08,42.06,42.03,44.37,42.9,44.14,43.73,45.69,43.48
"2024-02-05 18:36",635.62,625.18,582.93,655.16,634.79,642.85,325.77,647.96,604.35
"2024-02-06 08:56",73.55,63.35,73.38,94.48,114.35,72.25,82.14,90.17,63.2,66.7,70.35
"NCNN 20230517 - Target: CPU - Model: resnet18",
Lower Results Are Better
"2024-02-05 13:58",10.16,9.67,11.22,9.87,9.82,10.94,8.62,9.7,9.81,9.68,10.58,10.12,9.71,9.93,9.81
"2024-02-05 18:36",9.79,857.4,10.15,10.25,9.85,10.86,9.03,9.96,9.96
"2024-02-06 08:56",9.74,9.73,10.91,9.74,10.83,9.8,9.92,9.62,9.68,9.7,9.75
"NCNN 20230517 - Target: CPU - Model: alexnet",
Lower Results Are Better
"2024-02-05 13:58",6.94,5.87,6.94,6.6,6.76,7.02,6.56,6.79,6.88,6.75,7.03,7.08,6.77,7.06,7.02
"2024-02-05 18:36",6.7,383.02,239.01,6.84,6.9,6.91,7.06,6.77,6.97
"2024-02-06 08:56",6.75,6.6,7.04,6.62,6.94,6.6,6.75,6.72,6.58,6.79,6.56
"NCNN 20230517 - Target: CPU - Model: resnet50",
Lower Results Are Better
"2024-02-05 13:58",19.62,17.86,19.26,18.75,17.44,18.47,18.28,18.46,18.6,19.09,18.65,18.38,18.51,18.64,16.85
"2024-02-05 18:36",1661.32,1660.89,35.59,1660.26,17.78,1661.21,1658.75,1659.78,1500.51
"2024-02-06 08:56",16.17,18.29,18.64,17.68,18.01,17.79,17.86,18.37,18.36,18.05,18.51
"NCNN 20230517 - Target: CPU - Model: yolov4-tiny",
Lower Results Are Better
"2024-02-05 13:58",32.1,28.65,30.57,30.52,28.64,32.71,32.57,31.83,29.5,30.34,32.36,30.94,29.28,30.85,32.45
"2024-02-05 18:36",39.39,35.08,625.24,37.29,699.89,31.41,33.38,36.22,753.47
"2024-02-06 08:56",34.18,37.25,30.38,48.37,32.61,63.04,38.72,31.54,32.88,34.82,88.91
"NCNN 20230517 - Target: CPU - Model: squeezenet_ssd",
Lower Results Are Better
"2024-02-05 13:58",15.37,14.6,16.07,16.4,13.64,15.81,14.9,15.75,15.11,15.62,16.33,16.36,14.49,16.15,13.47
"2024-02-05 18:36",1840.79,1840.03,14.93,23.12,13.54,1841.11,1838.67,1840.51,16.88
"2024-02-06 08:56",13.12,15.76,21.72,15.54,15.41,15.89,15.83,15.44,15.95,15.84,15.61
"NCNN 20230517 - Target: CPU - Model: regnety_400m",
Lower Results Are Better
"2024-02-05 13:58",21.86,21.17,21.42,20.28,21.43,21.53,21.11,21.31,21.4,20.85,23.45,21.09,21.2,21.6,21.53
"2024-02-05 18:36",20.69,21.31,19.88,21.94,21.01,21.27,19.93,21.81,60.16
"2024-02-06 08:56",20.49,20.67,21.02,20.44,21.15,20.87,20.98,20.47,20.84,20.56,20.41
"NCNN 20230517 - Target: CPU - Model: vision_transformer",
Lower Results Are Better
"2024-02-05 13:58",66.87,69.47,69.58,70.29,65.6,68.92,65.8,67.94,66.06,70.16,64.79,68.1,65.68,68.29,68.99
"2024-02-05 18:36",1694.2,1751.55,1567.17,1750.85,1546.37,1751.68,1551.84,1738.53,1477.78
"2024-02-06 08:56",106.38,63.37,86.6,123.7,62.61,89.99,65.91,78.2,66.56,135.5,79.45
"NCNN 20230517 - Target: CPU - Model: FastestDet",
Lower Results Are Better
"2024-02-05 13:58",6.65,9.03,8.76,8.4,9.8,6.46,9.2,5.79,7.15,8.75,8.08,7.91,9.35,8.54,10.19
"2024-02-05 18:36",1099.83,220.54,1692.9,1219.34,1693.41,764.11,1693.17,264.38,1361.77
"2024-02-06 08:56",6.09,9.28,8.06,6.25,9.23,8.71,9.31,7.61,7.54,9.24,7.68
"NCNN 20230517 - Target: Vulkan GPU - Model: mobilenet",
Lower Results Are Better
"2024-02-05 13:58",15.15,17.92,18.01,17.9,16.18,15.04,15.59,17.3,16.03,15.66,18.51,15.75,17.91,16.09,17.88
"2024-02-05 18:36",18.66,17.21,1334.28,16.01,18.72,15.25,16.03,17.93
"2024-02-06 08:56",16.37,17.14,17.14,14.75,33.18,17.24,15.88,14.78,16.98
"NCNN 20230517 - Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2",
Lower Results Are Better
"2024-02-05 13:58",7.43,7.23,7.08,6.9,6.42,6.42,7.04,7.17,7.32,7.28,7.02,6.98,7.41,7.03,7.24
"2024-02-05 18:36",5.61,628.79,7.22,7.22,7.05,7.09,6.96,7.09
"2024-02-06 08:56",6.91,6.97,6.99,6.95,6.92,7,7,7.12,6.97
"NCNN 20230517 - Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3",
Lower Results Are Better
"2024-02-05 13:58",6.96,6.73,6.72,6.53,6.45,6.27,6.57,6.8,6.69,6.82,6.76,6.51,6.92,6.58,6.71
"2024-02-05 18:36",5.91,6.75,6.84,6.82,606.21,6.7,6.49,6.52
"2024-02-06 08:56",6.39,6.45,6.56,6.52,6.61,6.63,6.56,6.52,6.49
"NCNN 20230517 - Target: Vulkan GPU - Model: shufflenet-v2",
Lower Results Are Better
"2024-02-05 13:58",7.78,7.72,7.51,7.26,7.45,7.39,7.31,8.11,7.36,7.66,7.39,7.35,7.6,7.37,7.57
"2024-02-05 18:36",6.65,7.1,7.6,7.51,7.4,7.29,7.4,7.38
"2024-02-06 08:56",7.19,7.15,7.18,7.11,7.19,7.23,7.26,7.39,7.21
"NCNN 20230517 - Target: Vulkan GPU - Model: mnasnet",
Lower Results Are Better
"2024-02-05 13:58",6.54,7.1,6.49,6.1,6.56,6.35,6.28,6.63,6.49,6.36,6.42,6.16,6.63,6.35,6.42
"2024-02-05 18:36",5.36,6.78,6.61,6.43,6.8,6.35,6.23,6.21
"2024-02-06 08:56",6.22,6.23,6.17,6.33,6.44,6.25,6.45,6.21,6.21
"NCNN 20230517 - Target: Vulkan GPU - Model: efficientnet-b0",
Lower Results Are Better
"2024-02-05 13:58",8.62,9.44,8.69,8.2,8.92,8.49,8.24,9.84,8.47,8.64,8.94,8.19,8.67,8.45,8.51
"2024-02-05 18:36",7.55,8.91,8.67,8.54,9.25,8.35,8.19,8.18
"2024-02-06 08:56",8.05,8.13,8.14,8.25,8.27,8.17,8.26,8.4,8.21
"NCNN 20230517 - Target: Vulkan GPU - Model: blazeface",
Lower Results Are Better
"2024-02-05 13:58",3.13,3.18,2.99,2.83,2.8,2.8,2.92,3,3.05,3.14,3.09,2.97,3.26,2.89,3.16
"2024-02-05 18:36",2.37,2.72,3.18,3.15,3.08,3.01,3.01,3.01
"2024-02-06 08:56",2.93,2.99,3,3,3.02,3.01,3.01,3,2.98
"NCNN 20230517 - Target: Vulkan GPU - Model: googlenet",
Lower Results Are Better
"2024-02-05 13:58",17.05,17.45,16.3,15.75,16.9,16.47,16.27,17.24,16.52,16.95,16.47,16.07,16.67,17.51,16.6
"2024-02-05 18:36",14.5,16.68,16.83,16.98,16.47,16.29,16.02,15.99
"2024-02-06 08:56",15.88,15.8,16.05,15.98,16.04,16.29,16.36,16.23,16.08
"NCNN 20230517 - Target: Vulkan GPU - Model: vgg16",
Lower Results Are Better
"2024-02-05 13:58",41.37,42.81,41.88,43.63,42.57,44.58,42.39,43.37,41.86,42.89,48.59,43.31,47.46,40.91,42.68
"2024-02-05 18:36",633.63,643,640.15,653.13,653.59,650.73,73.74,65.35
"2024-02-06 08:56",73.57,147.55,64.41,81.2,70.77,69.04,91.9,77.34,90.64
"NCNN 20230517 - Target: Vulkan GPU - Model: resnet18",
Lower Results Are Better
"2024-02-05 13:58",10.16,10.18,9.86,9.68,10.79,9.65,9.79,9.63,9.91,9.93,10.71,9.54,9.85,10.71,9.72
"2024-02-05 18:36",8.94,10.68,10.06,10.17,9.98,9.87,9.57,9.54
"2024-02-06 08:56",9.59,9.59,9.55,9.58,9.69,9.87,9.75,9.85,9.7
"NCNN 20230517 - Target: Vulkan GPU - Model: alexnet",
Lower Results Are Better
"2024-02-05 13:58",6.87,6.68,6.51,6.71,6.29,6.79,6.27,6.59,6.63,6.77,6.71,6.68,6.64,6.93,6.72
"2024-02-05 18:36",6.71,6.97,7.04,6.9,6.91,6.79,6.74,6.6
"2024-02-06 08:56",6.77,6.6,6.64,6.56,6.66,6.59,6.66,6.61
"NCNN 20230517 - Target: Vulkan GPU - Model: resnet50",
Lower Results Are Better
"2024-02-05 13:58",16.72,18.46,18.2,18.62,18.6,17.07,18.7,18.01,18.38,17.18,18.46,18.67,18.45,18.22,18.57
"2024-02-05 18:36",19.82,1662.09,17.5,771.23,619.22,1396.57,18.21,18.5
"2024-02-06 08:56",18.65,18.36,18.01,16.39,20.2,18.17,17.11,17.04,18.37
"NCNN 20230517 - Target: Vulkan GPU - Model: yolov4-tiny",
Lower Results Are Better
"2024-02-05 13:58",30.44,32.3,30.21,30.19,31.02,32.81,29.3,29.89,30.08,28.72,31.2,30.15,32.2,44.76,29.82
"2024-02-05 18:36",38.01,778.63,731.17,617.6,749.96,392.18,30.55,37.58
"2024-02-06 08:56",33.03,41.4,59.79,28.04,42.67,49.84,32.79,31.03,30.58
"NCNN 20230517 - Target: Vulkan GPU - Model: squeezenet_ssd",
Lower Results Are Better
"2024-02-05 13:58",13.72,16.26,16.18,15.29,15.1,14.42,14.39,15.75,15.41,13.96,16.95,16.36,16.23,15.84,15.99
"2024-02-05 18:36",17.16,1840.98,13.82,14.99,17.35,14.26,14.63,21.65
"2024-02-06 08:56",14.57,15.63,15.73,13.33,17.07,15.5,13.9,13.4,15.28
"NCNN 20230517 - Target: Vulkan GPU - Model: regnety_400m",
Lower Results Are Better
"2024-02-05 13:58",21.83,21.39,21.16,21.65,21.19,21.29,19.99,21.45,21.11,21.33,22.2,20.68,23.74,21.03,22
"2024-02-05 18:36",19.88,20.84,21.95,22.05,751.97,21.02,20.76,21.01
"2024-02-06 08:56",20.43,20.69,20.9,20.62,20.69,20.78,20.75,20.73,20.77
"NCNN 20230517 - Target: Vulkan GPU - Model: vision_transformer",
Lower Results Are Better
"2024-02-05 13:58",66.46,70.54,71.96,68.42,69.58,65.81,66,72.29,69.42,72.17,63.42,66.44,63.89,72.65,68.09
"2024-02-05 18:36",1539.22,1752.16,1748.82,1666.88,1749.16,1502.82,74.27,71.36
"2024-02-06 08:56",93.07,76.38,125.17,60.84,85.24,81.93,67.92,111.51,62.75
"NCNN 20230517 - Target: Vulkan GPU - Model: FastestDet",
Lower Results Are Better
"2024-02-05 13:58",6.65,6.65,9.29,9.35,6.51,8.5,7.53,9.7,8.69,8.88,6.87,7.92,8.19,8.15,9.5
"2024-02-05 18:36",1565.5,1600.04,247.04,108.18,1693.63,6,8.09,9.36
"2024-02-06 08:56",8.43,6.4,6.65,6.54,7.73,6.55,6.62,8.63,8.29
"PlaidML - FP16: No - Mode: Training - Network: VGG16 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Training - Network: VGG19 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Inference - Network: VGG16 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Inference - Network: VGG19 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Training - Network: VGG16 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Training - Network: VGG19 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: VGG16 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: VGG19 - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Training - Network: IMDB LSTM - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Training - Network: Mobilenet - Device: CPU",
Higher Results Are Better
"2024-02-05 13:58",
"2024-02-05 18:36",
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Training - Network: ResNet 50 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",0.37,0.37,0.36
"PlaidML - FP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Inference - Network: Mobilenet - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",5.04,4.98,5.06
"PlaidML - FP16: Yes - Mode: Training - Network: IMDB LSTM - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Training - Network: Mobilenet - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Training - Network: ResNet 50 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: IMDB LSTM - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: Mobilenet - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Training - Network: DenseNet 201 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Training - Network: Inception V3 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Training - Network: NASNer Large - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Inference - Network: Inception V3 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: No - Mode: Inference - Network: NASNer Large - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Training - Network: DenseNet 201 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Training - Network: Inception V3 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Training - Network: NASNer Large - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: Inception V3 - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",
"PlaidML - FP16: Yes - Mode: Inference - Network: NASNer Large - Device: CPU",
Higher Results Are Better
"2024-02-06 08:56",