2 x Intel Xeon Gold 6244 testing with a Dell 060K5C (2.4.1 BIOS) and NVIDIA Quadro GV100 32GB on Ubuntu 20.04.6 LTS via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2402069-NE-RESTXT08482 res.txt - Phoronix Test Suite res.txt 2 x Intel Xeon Gold 6244 testing with a Dell 060K5C (2.4.1 BIOS) and NVIDIA Quadro GV100 32GB on Ubuntu 20.04.6 LTS via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2402069-NE-RESTXT08482&grt .
res.txt Processor Motherboard Memory Disk Graphics OS Kernel Display Driver Vulkan Compiler File-System Screen Resolution 2024-02-05 13:53 2024-02-05 13:58 2024-02-05 18:03 2024-02-05 18:36 2024-02-06 08:56 2 x Intel Xeon Gold 6244 @ 4.40GHz (16 Cores / 32 Threads) Dell 060K5C (2.4.1 BIOS) 128GB PM981a NVMe SAMSUNG 2048GB + 4 x 8002GB TOSHIBA MG06ACA8 NVIDIA Quadro GV100 32GB Ubuntu 20.04.6 LTS 3.10.0-1160.95.1.el7.x86_64 (x86_64) NVIDIA 1.1.182 GCC 9.4.0 + CUDA 12.0 xfs 800x600 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-9QDOt0/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - 2024-02-05 13:53: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x5003604 - 2024-02-05 13:58: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x5003604 - 2024-02-05 18:03: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x5003604 - 2024-02-05 18:36: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x5003604 - 2024-02-06 08:56: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x5003604 Python Details - Python 3.8.10
res.txt ncnn: CPU - mobilenet ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU - shufflenet-v2 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - vgg16 ncnn: CPU - resnet18 ncnn: CPU - alexnet ncnn: CPU - resnet50 ncnn: CPU - yolov4-tiny ncnn: CPU - squeezenet_ssd ncnn: CPU - regnety_400m ncnn: CPU - vision_transformer ncnn: CPU - FastestDet ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - vision_transformer ncnn: Vulkan GPU - FastestDet plaidml: No - Training - ResNet 50 - CPU plaidml: No - Inference - ResNet 50 - CPU plaidml: Yes - Inference - NASNer Large - CPU 2024-02-05 13:53 2024-02-05 13:58 2024-02-05 18:03 2024-02-05 18:36 2024-02-06 08:56 16.92 7.18 6.72 7.38 6.41 8.47 2.91 16.21 43.20 9.98 6.80 18.46 30.89 15.34 21.42 67.77 8.27 16.73 7.06 6.67 7.52 6.46 8.69 3.01 16.68 43.35 10.01 6.65 18.15 31.54 15.46 21.47 68.48 8.16 29.71 373.65 459.15 181.58 131.20 8.53 2.83 120.62 594.96 104.14 74.46 1279.57 254.60 1029.95 25.33 1647.77 1112.16 181.76 84.63 81.53 7.29 6.35 8.46 2.94 16.22 501.67 9.85 6.83 565.39 421.96 244.36 112.44 1263.09 654.73 17.13 7.03 6.57 7.22 6.38 8.37 3.02 19.81 78.54 9.95 6.72 17.98 42.97 16.01 20.72 87.12 8.09 18.16 6.98 6.53 7.21 6.28 8.21 2.99 16.08 85.16 9.69 6.64 18.03 38.80 14.93 20.71 84.98 7.32 0.37 5.03 OpenBenchmarking.org
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: mobilenet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 7 14 21 28 35 SE +/- 0.30, N = 15 SE +/- 12.39, N = 9 SE +/- 0.29, N = 11 16.92 29.71 17.13 MIN: 13.75 / MAX: 53.31 MIN: 15.53 / MAX: 1342.94 MIN: 14.45 / MAX: 20.43 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v2-v2 - Model: mobilenet-v2 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 80 160 240 320 400 SE +/- 0.12, N = 15 SE +/- 175.05, N = 9 SE +/- 0.05, N = 11 7.18 373.65 7.03 MIN: 5.54 / MAX: 1167 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3 - Model: mobilenet-v3 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 100 200 300 400 500 SE +/- 0.08, N = 15 SE +/- 224.10, N = 9 SE +/- 0.04, N = 11 6.72 459.15 6.57 MIN: 5.6 / MAX: 1369.7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: shufflenet-v2 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 40 80 120 160 200 SE +/- 0.04, N = 15 SE +/- 174.29, N = 9 SE +/- 0.03, N = 11 7.38 181.58 7.22 MIN: 6.15 / MAX: 1598.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: mnasnet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 30 60 90 120 150 SE +/- 0.09, N = 15 SE +/- 124.99, N = 9 SE +/- 0.10, N = 11 6.41 131.20 6.38 MIN: 4.8 / MAX: 1145.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: efficientnet-b0 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 2 4 6 8 10 SE +/- 0.10, N = 15 SE +/- 0.14, N = 9 SE +/- 0.07, N = 11 8.47 8.53 8.37 MIN: 7.07 / MAX: 42.9 MIN: 7.16 / MAX: 13.3 MIN: 8.01 / MAX: 11.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: blazeface 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 0.6795 1.359 2.0385 2.718 3.3975 SE +/- 0.08, N = 15 SE +/- 0.12, N = 9 SE +/- 0.02, N = 11 2.91 2.83 3.02 MIN: 2.16 / MAX: 5.98 MIN: 2.13 / MAX: 5.08 MIN: 2.84 / MAX: 22.6 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: googlenet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 30 60 90 120 150 SE +/- 0.28, N = 15 SE +/- 104.57, N = 9 SE +/- 3.51, N = 11 16.21 120.62 19.81 MIN: 12.89 / MAX: 38.38 MIN: 13.63 / MAX: 1852.64 MIN: 15.64 / MAX: 1809.29 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: vgg16 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 130 260 390 520 650 SE +/- 0.31, N = 15 SE +/- 34.48, N = 9 SE +/- 4.72, N = 11 43.20 594.96 78.54 MIN: 39.51 / MAX: 679.59 MIN: 39.02 / MAX: 663.86 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: resnet18 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 20 40 60 80 100 SE +/- 0.16, N = 15 SE +/- 94.16, N = 9 SE +/- 0.14, N = 11 9.98 104.14 9.95 MIN: 8.07 / MAX: 48.75 MIN: 8.47 / MAX: 867.98 MIN: 9.3 / MAX: 13.2 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: alexnet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 20 40 60 80 100 SE +/- 0.08, N = 15 SE +/- 46.29, N = 9 SE +/- 0.05, N = 11 6.80 74.46 6.72 MIN: 6.37 / MAX: 397.08 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: resnet50 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 300 600 900 1200 1500 SE +/- 0.18, N = 15 SE +/- 237.42, N = 9 SE +/- 0.20, N = 11 18.46 1279.57 17.98 MIN: 17.05 / MAX: 1680.15 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: yolov4-tiny 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 60 120 180 240 300 SE +/- 0.37, N = 15 SE +/- 110.09, N = 9 SE +/- 5.42, N = 11 30.89 254.60 42.97 MIN: 25.55 / MAX: 393.68 MIN: 26.15 / MAX: 793.43 MIN: 25.46 / MAX: 767.17 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: squeezenet_ssd 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 200 400 600 800 1000 SE +/- 0.25, N = 15 SE +/- 320.29, N = 9 SE +/- 0.62, N = 11 15.34 1029.95 16.01 MIN: 13 / MAX: 1860.66 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: regnety_400m 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 6 12 18 24 30 SE +/- 0.17, N = 15 SE +/- 4.36, N = 9 SE +/- 0.08, N = 11 21.42 25.33 20.72 MIN: 18.61 / MAX: 50.31 MIN: 18.49 / MAX: 8765.4 MIN: 20.11 / MAX: 89.15 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: vision_transformer 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 400 800 1200 1600 2000 SE +/- 0.47, N = 15 SE +/- 36.79, N = 9 SE +/- 7.53, N = 11 67.77 1647.77 87.12 MIN: 60.22 / MAX: 1773.37 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: FastestDet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 200 400 600 800 1000 SE +/- 0.33, N = 15 SE +/- 194.42, N = 9 SE +/- 0.36, N = 11 8.27 1112.16 8.09 MIN: 5.89 / MAX: 1712.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mobilenet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 40 80 120 160 200 SE +/- 0.31, N = 15 SE +/- 164.65, N = 8 SE +/- 1.91, N = 9 16.73 181.76 18.16 MIN: 14.72 / MAX: 1345.89 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 20 40 60 80 100 SE +/- 0.08, N = 15 SE +/- 77.74, N = 8 SE +/- 0.02, N = 9 7.06 84.63 6.98 MIN: 5.23 / MAX: 1181.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 20 40 60 80 100 SE +/- 0.05, N = 15 SE +/- 74.95, N = 8 SE +/- 0.03, N = 9 6.67 81.53 6.53 MIN: 5.52 / MAX: 1367.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 2 4 6 8 10 SE +/- 0.06, N = 15 SE +/- 0.11, N = 8 SE +/- 0.03, N = 9 7.52 7.29 7.21 MIN: 6.49 / MAX: 70.78 MIN: 6.09 / MAX: 9.72 MIN: 6.9 / MAX: 9.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mnasnet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 2 4 6 8 10 SE +/- 0.06, N = 15 SE +/- 0.16, N = 8 SE +/- 0.03, N = 9 6.46 6.35 6.28 MIN: 5.63 / MAX: 121.66 MIN: 5.01 / MAX: 10.28 MIN: 6.07 / MAX: 8.66 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 2 4 6 8 10 SE +/- 0.12, N = 15 SE +/- 0.18, N = 8 SE +/- 0.03, N = 9 8.69 8.46 8.21 MIN: 7.5 / MAX: 90.56 MIN: 7.17 / MAX: 12.2 MIN: 7.9 / MAX: 14.11 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: blazeface 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 0.6773 1.3546 2.0319 2.7092 3.3865 SE +/- 0.04, N = 15 SE +/- 0.10, N = 8 SE +/- 0.01, N = 9 3.01 2.94 2.99 MIN: 2.56 / MAX: 5.33 MIN: 2.2 / MAX: 5.14 MIN: 2.86 / MAX: 5.34 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: googlenet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 4 8 12 16 20 SE +/- 0.13, N = 15 SE +/- 0.28, N = 8 SE +/- 0.06, N = 9 16.68 16.22 16.08 MIN: 14.68 / MAX: 41.63 MIN: 13.66 / MAX: 19.49 MIN: 15.44 / MAX: 19.02 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vgg16 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 110 220 330 440 550 SE +/- 0.55, N = 15 SE +/- 94.33, N = 8 SE +/- 8.40, N = 9 43.35 501.67 85.16 MIN: 38.99 / MAX: 680.92 MIN: 38.78 / MAX: 657.39 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet18 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 3 6 9 12 15 SE +/- 0.11, N = 15 SE +/- 0.18, N = 8 SE +/- 0.04, N = 9 10.01 9.85 9.69 MIN: 8.29 / MAX: 66.34 MIN: 8.54 / MAX: 12.61 MIN: 9.24 / MAX: 12.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: alexnet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 2 4 6 8 10 SE +/- 0.05, N = 15 SE +/- 0.05, N = 8 SE +/- 0.02, N = 8 6.65 6.83 6.64 MIN: 5.83 / MAX: 17.95 MIN: 6.38 / MAX: 9.35 MIN: 6.38 / MAX: 44.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet50 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 120 240 360 480 600 SE +/- 0.16, N = 15 SE +/- 236.61, N = 8 SE +/- 0.37, N = 9 18.15 565.39 18.03 MIN: 16.76 / MAX: 1675.59 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 90 180 270 360 450 SE +/- 0.99, N = 15 SE +/- 120.86, N = 8 SE +/- 3.53, N = 9 31.54 421.96 38.80 MIN: 26.32 / MAX: 796.07 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 50 100 150 200 250 SE +/- 0.25, N = 15 SE +/- 228.09, N = 8 SE +/- 0.41, N = 9 15.46 244.36 14.93 MIN: 13.25 / MAX: 1854.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 30 60 90 120 150 SE +/- 0.21, N = 15 SE +/- 91.36, N = 8 SE +/- 0.04, N = 9 21.47 112.44 20.71 MIN: 18.78 / MAX: 94.51 MIN: 18.72 / MAX: 8799.8 MIN: 20.11 / MAX: 57.59 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 300 600 900 1200 1500 SE +/- 0.79, N = 15 SE +/- 261.92, N = 8 SE +/- 7.30, N = 9 68.48 1263.09 84.98 MIN: 59.44 / MAX: 1769.56 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: FastestDet 2024-02-05 13:58 2024-02-05 18:36 2024-02-06 08:56 140 280 420 560 700 SE +/- 0.29, N = 15 SE +/- 284.19, N = 8 SE +/- 0.31, N = 9 8.16 654.73 7.32 MIN: 5.88 / MAX: 1709.7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
PlaidML FP16: No - Mode: Training - Network: ResNet 50 - Device: CPU OpenBenchmarking.org FPS, More Is Better PlaidML FP16: No - Mode: Training - Network: ResNet 50 - Device: CPU 2024-02-06 08:56 0.0833 0.1666 0.2499 0.3332 0.4165 SE +/- 0.00, N = 3 0.37
PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU OpenBenchmarking.org FPS, More Is Better PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU 2024-02-06 08:56 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.02, N = 3 5.03
Phoronix Test Suite v10.8.5