res.txt

2 x Intel Xeon Gold 6244 testing with a Dell 060K5C (2.4.1 BIOS) and NVIDIA Quadro GV100 32GB on Ubuntu 20.04.6 LTS via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2402069-NE-RESTXT08482
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests
NVIDIA GPU Compute 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
2024-02-05 13:53
February 05
 
2024-02-05 13:58
February 05
  15 Hours, 3 Minutes
2024-02-05 18:03
February 05
 
2024-02-05 18:36
February 05
  7 Days, 1 Minute
2024-02-06 08:56
February 06
  16 Hours, 53 Minutes
Invert Hiding All Results Option
  1 Day, 16 Hours

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


res.txtOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon Gold 6244 @ 4.40GHz (16 Cores / 32 Threads)Dell 060K5C (2.4.1 BIOS)128GBPM981a NVMe SAMSUNG 2048GB + 4 x 8002GB TOSHIBA MG06ACA8NVIDIA Quadro GV100 32GBUbuntu 20.04.6 LTS3.10.0-1160.95.1.el7.x86_64 (x86_64)NVIDIA1.1.182GCC 9.4.0 + CUDA 12.0xfs800x600ProcessorMotherboardMemoryDiskGraphicsOSKernelDisplay DriverVulkanCompilerFile-SystemScreen ResolutionRes.txt BenchmarksSystem Logs- Transparent Huge Pages: always- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-9QDOt0/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - 2024-02-05 13:53: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x5003604 - 2024-02-05 13:58: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x5003604 - 2024-02-05 18:03: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x5003604 - 2024-02-05 18:36: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x5003604 - 2024-02-06 08:56: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x5003604 - Python 3.8.10

res.txtncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetplaidml: No - Training - ResNet 50 - CPUplaidml: No - Inference - ResNet 50 - CPUplaidml: Yes - Inference - NASNer Large - CPU2024-02-05 13:532024-02-05 13:582024-02-05 18:032024-02-05 18:362024-02-06 08:5616.927.186.727.386.418.472.9116.2143.209.986.8018.4630.8915.3421.4267.778.2716.737.066.677.526.468.693.0116.6843.3510.016.6518.1531.5415.4621.4768.488.1629.71373.65459.15181.58131.208.532.83120.62594.96104.1474.461279.57254.601029.9525.331647.771112.16181.7684.6381.537.296.358.462.9416.22501.679.856.83565.39421.96244.36112.441263.09654.7317.137.036.577.226.388.373.0219.8178.549.956.7217.9842.9716.0120.7287.128.0918.166.986.537.216.288.212.9916.0885.169.696.6418.0338.8014.9320.7184.987.320.375.03OpenBenchmarking.org

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenet2024-02-05 13:582024-02-05 18:362024-02-06 08:56714212835SE +/- 0.30, N = 15SE +/- 12.39, N = 9SE +/- 0.29, N = 1116.9229.7117.13MIN: 13.75 / MAX: 53.31MIN: 15.53 / MAX: 1342.94MIN: 14.45 / MAX: 20.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenet2024-02-05 13:582024-02-05 18:362024-02-06 08:56714212835Min: 14.87 / Avg: 16.92 / Max: 18.37Min: 16.17 / Avg: 29.71 / Max: 128.82Min: 14.62 / Avg: 17.13 / Max: 18.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:5680160240320400SE +/- 0.12, N = 15SE +/- 175.05, N = 9SE +/- 0.05, N = 117.18373.657.03MIN: 5.54 / MAX: 11671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:5670140210280350Min: 6.02 / Avg: 7.18 / Max: 7.69Min: 5.97 / Avg: 373.65 / Max: 1154.29Min: 6.88 / Avg: 7.03 / Max: 7.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v32024-02-05 13:582024-02-05 18:362024-02-06 08:56100200300400500SE +/- 0.08, N = 15SE +/- 224.10, N = 9SE +/- 0.04, N = 116.72459.156.57MIN: 5.6 / MAX: 1369.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v32024-02-05 13:582024-02-05 18:362024-02-06 08:5680160240320400Min: 6 / Avg: 6.72 / Max: 7.1Min: 6.01 / Avg: 459.15 / Max: 1355.78Min: 6.42 / Avg: 6.57 / Max: 6.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:564080120160200SE +/- 0.04, N = 15SE +/- 174.29, N = 9SE +/- 0.03, N = 117.38181.587.22MIN: 6.15 / MAX: 1598.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:56306090120150Min: 7.04 / Avg: 7.38 / Max: 7.58Min: 6.72 / Avg: 181.58 / Max: 1575.92Min: 7.08 / Avg: 7.22 / Max: 7.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnet2024-02-05 13:582024-02-05 18:362024-02-06 08:56306090120150SE +/- 0.09, N = 15SE +/- 124.99, N = 9SE +/- 0.10, N = 116.41131.206.38MIN: 4.8 / MAX: 1145.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnet2024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100Min: 5.61 / Avg: 6.41 / Max: 7.02Min: 5.23 / Avg: 131.2 / Max: 1131.1Min: 6.17 / Avg: 6.38 / Max: 7.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b02024-02-05 13:582024-02-05 18:362024-02-06 08:56246810SE +/- 0.10, N = 15SE +/- 0.14, N = 9SE +/- 0.07, N = 118.478.538.37MIN: 7.07 / MAX: 42.9MIN: 7.16 / MAX: 13.3MIN: 8.01 / MAX: 11.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b02024-02-05 13:582024-02-05 18:362024-02-06 08:563691215Min: 7.75 / Avg: 8.47 / Max: 9.12Min: 7.75 / Avg: 8.53 / Max: 9.19Min: 8.15 / Avg: 8.37 / Max: 8.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazeface2024-02-05 13:582024-02-05 18:362024-02-06 08:560.67951.3592.03852.7183.3975SE +/- 0.08, N = 15SE +/- 0.12, N = 9SE +/- 0.02, N = 112.912.833.02MIN: 2.16 / MAX: 5.98MIN: 2.13 / MAX: 5.08MIN: 2.84 / MAX: 22.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazeface2024-02-05 13:582024-02-05 18:362024-02-06 08:56246810Min: 2.42 / Avg: 2.91 / Max: 3.27Min: 2.29 / Avg: 2.83 / Max: 3.17Min: 2.94 / Avg: 3.02 / Max: 3.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenet2024-02-05 13:582024-02-05 18:362024-02-06 08:56306090120150SE +/- 0.28, N = 15SE +/- 104.57, N = 9SE +/- 3.51, N = 1116.21120.6219.81MIN: 12.89 / MAX: 38.38MIN: 13.63 / MAX: 1852.64MIN: 15.64 / MAX: 1809.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenet2024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100Min: 13.88 / Avg: 16.21 / Max: 17.25Min: 14.42 / Avg: 120.62 / Max: 957.17Min: 16.01 / Avg: 19.81 / Max: 54.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg162024-02-05 13:582024-02-05 18:362024-02-06 08:56130260390520650SE +/- 0.31, N = 15SE +/- 34.48, N = 9SE +/- 4.72, N = 1143.20594.9678.54MIN: 39.51 / MAX: 679.59MIN: 39.02 / MAX: 663.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg162024-02-05 13:582024-02-05 18:362024-02-06 08:56110220330440550Min: 41.91 / Avg: 43.2 / Max: 45.69Min: 325.77 / Avg: 594.96 / Max: 655.16Min: 63.2 / Avg: 78.54 / Max: 114.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet182024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100SE +/- 0.16, N = 15SE +/- 94.16, N = 9SE +/- 0.14, N = 119.98104.149.95MIN: 8.07 / MAX: 48.75MIN: 8.47 / MAX: 867.98MIN: 9.3 / MAX: 13.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet182024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100Min: 8.62 / Avg: 9.98 / Max: 11.22Min: 9.03 / Avg: 104.14 / Max: 857.4Min: 9.62 / Avg: 9.95 / Max: 10.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnet2024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100SE +/- 0.08, N = 15SE +/- 46.29, N = 9SE +/- 0.05, N = 116.8074.466.72MIN: 6.37 / MAX: 397.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnet2024-02-05 13:582024-02-05 18:362024-02-06 08:561428425670Min: 5.87 / Avg: 6.8 / Max: 7.08Min: 6.7 / Avg: 74.46 / Max: 383.02Min: 6.56 / Avg: 6.72 / Max: 7.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet502024-02-05 13:582024-02-05 18:362024-02-06 08:5630060090012001500SE +/- 0.18, N = 15SE +/- 237.42, N = 9SE +/- 0.20, N = 1118.461279.5717.98MIN: 17.05 / MAX: 1680.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet502024-02-05 13:582024-02-05 18:362024-02-06 08:562004006008001000Min: 16.85 / Avg: 18.46 / Max: 19.62Min: 17.78 / Avg: 1279.57 / Max: 1661.32Min: 16.17 / Avg: 17.98 / Max: 18.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tiny2024-02-05 13:582024-02-05 18:362024-02-06 08:5660120180240300SE +/- 0.37, N = 15SE +/- 110.09, N = 9SE +/- 5.42, N = 1130.89254.6042.97MIN: 25.55 / MAX: 393.68MIN: 26.15 / MAX: 793.43MIN: 25.46 / MAX: 767.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tiny2024-02-05 13:582024-02-05 18:362024-02-06 08:5650100150200250Min: 28.64 / Avg: 30.89 / Max: 32.71Min: 31.41 / Avg: 254.6 / Max: 753.47Min: 30.38 / Avg: 42.97 / Max: 88.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssd2024-02-05 13:582024-02-05 18:362024-02-06 08:562004006008001000SE +/- 0.25, N = 15SE +/- 320.29, N = 9SE +/- 0.62, N = 1115.341029.9516.01MIN: 13 / MAX: 1860.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssd2024-02-05 13:582024-02-05 18:362024-02-06 08:562004006008001000Min: 13.47 / Avg: 15.34 / Max: 16.4Min: 13.54 / Avg: 1029.95 / Max: 1841.11Min: 13.12 / Avg: 16.01 / Max: 21.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400m2024-02-05 13:582024-02-05 18:362024-02-06 08:56612182430SE +/- 0.17, N = 15SE +/- 4.36, N = 9SE +/- 0.08, N = 1121.4225.3320.72MIN: 18.61 / MAX: 50.31MIN: 18.49 / MAX: 8765.4MIN: 20.11 / MAX: 89.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400m2024-02-05 13:582024-02-05 18:362024-02-06 08:56612182430Min: 20.28 / Avg: 21.42 / Max: 23.45Min: 19.88 / Avg: 25.33 / Max: 60.16Min: 20.41 / Avg: 20.72 / Max: 21.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformer2024-02-05 13:582024-02-05 18:362024-02-06 08:56400800120016002000SE +/- 0.47, N = 15SE +/- 36.79, N = 9SE +/- 7.53, N = 1167.771647.7787.12MIN: 60.22 / MAX: 1773.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformer2024-02-05 13:582024-02-05 18:362024-02-06 08:5630060090012001500Min: 64.79 / Avg: 67.77 / Max: 70.29Min: 1477.78 / Avg: 1647.77 / Max: 1751.68Min: 62.61 / Avg: 87.12 / Max: 135.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDet2024-02-05 13:582024-02-05 18:362024-02-06 08:562004006008001000SE +/- 0.33, N = 15SE +/- 194.42, N = 9SE +/- 0.36, N = 118.271112.168.09MIN: 5.89 / MAX: 1712.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDet2024-02-05 13:582024-02-05 18:362024-02-06 08:562004006008001000Min: 5.79 / Avg: 8.27 / Max: 10.19Min: 220.54 / Avg: 1112.16 / Max: 1693.41Min: 6.09 / Avg: 8.09 / Max: 9.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenet2024-02-05 13:582024-02-05 18:362024-02-06 08:564080120160200SE +/- 0.31, N = 15SE +/- 164.65, N = 8SE +/- 1.91, N = 916.73181.7618.16MIN: 14.72 / MAX: 1345.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenet2024-02-05 13:582024-02-05 18:362024-02-06 08:56306090120150Min: 15.04 / Avg: 16.73 / Max: 18.51Min: 15.25 / Avg: 181.76 / Max: 1334.28Min: 14.75 / Avg: 18.16 / Max: 33.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100SE +/- 0.08, N = 15SE +/- 77.74, N = 8SE +/- 0.02, N = 97.0684.636.98MIN: 5.23 / MAX: 1181.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:561632486480Min: 6.42 / Avg: 7.06 / Max: 7.43Min: 5.61 / Avg: 84.63 / Max: 628.79Min: 6.91 / Avg: 6.98 / Max: 7.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v32024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100SE +/- 0.05, N = 15SE +/- 74.95, N = 8SE +/- 0.03, N = 96.6781.536.53MIN: 5.52 / MAX: 1367.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v32024-02-05 13:582024-02-05 18:362024-02-06 08:561632486480Min: 6.27 / Avg: 6.67 / Max: 6.96Min: 5.91 / Avg: 81.53 / Max: 606.21Min: 6.39 / Avg: 6.53 / Max: 6.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:56246810SE +/- 0.06, N = 15SE +/- 0.11, N = 8SE +/- 0.03, N = 97.527.297.21MIN: 6.49 / MAX: 70.78MIN: 6.09 / MAX: 9.72MIN: 6.9 / MAX: 9.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v22024-02-05 13:582024-02-05 18:362024-02-06 08:563691215Min: 7.26 / Avg: 7.52 / Max: 8.11Min: 6.65 / Avg: 7.29 / Max: 7.6Min: 7.11 / Avg: 7.21 / Max: 7.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnet2024-02-05 13:582024-02-05 18:362024-02-06 08:56246810SE +/- 0.06, N = 15SE +/- 0.16, N = 8SE +/- 0.03, N = 96.466.356.28MIN: 5.63 / MAX: 121.66MIN: 5.01 / MAX: 10.28MIN: 6.07 / MAX: 8.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnet2024-02-05 13:582024-02-05 18:362024-02-06 08:563691215Min: 6.1 / Avg: 6.46 / Max: 7.1Min: 5.36 / Avg: 6.35 / Max: 6.8Min: 6.17 / Avg: 6.28 / Max: 6.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b02024-02-05 13:582024-02-05 18:362024-02-06 08:56246810SE +/- 0.12, N = 15SE +/- 0.18, N = 8SE +/- 0.03, N = 98.698.468.21MIN: 7.5 / MAX: 90.56MIN: 7.17 / MAX: 12.2MIN: 7.9 / MAX: 14.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b02024-02-05 13:582024-02-05 18:362024-02-06 08:563691215Min: 8.19 / Avg: 8.69 / Max: 9.84Min: 7.55 / Avg: 8.46 / Max: 9.25Min: 8.05 / Avg: 8.21 / Max: 8.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazeface2024-02-05 13:582024-02-05 18:362024-02-06 08:560.67731.35462.03192.70923.3865SE +/- 0.04, N = 15SE +/- 0.10, N = 8SE +/- 0.01, N = 93.012.942.99MIN: 2.56 / MAX: 5.33MIN: 2.2 / MAX: 5.14MIN: 2.86 / MAX: 5.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazeface2024-02-05 13:582024-02-05 18:362024-02-06 08:56246810Min: 2.8 / Avg: 3.01 / Max: 3.26Min: 2.37 / Avg: 2.94 / Max: 3.18Min: 2.93 / Avg: 2.99 / Max: 3.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenet2024-02-05 13:582024-02-05 18:362024-02-06 08:5648121620SE +/- 0.13, N = 15SE +/- 0.28, N = 8SE +/- 0.06, N = 916.6816.2216.08MIN: 14.68 / MAX: 41.63MIN: 13.66 / MAX: 19.49MIN: 15.44 / MAX: 19.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenet2024-02-05 13:582024-02-05 18:362024-02-06 08:5648121620Min: 15.75 / Avg: 16.68 / Max: 17.51Min: 14.5 / Avg: 16.22 / Max: 16.98Min: 15.8 / Avg: 16.08 / Max: 16.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg162024-02-05 13:582024-02-05 18:362024-02-06 08:56110220330440550SE +/- 0.55, N = 15SE +/- 94.33, N = 8SE +/- 8.40, N = 943.35501.6785.16MIN: 38.99 / MAX: 680.92MIN: 38.78 / MAX: 657.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg162024-02-05 13:582024-02-05 18:362024-02-06 08:5690180270360450Min: 40.91 / Avg: 43.35 / Max: 48.59Min: 65.35 / Avg: 501.67 / Max: 653.59Min: 64.41 / Avg: 85.16 / Max: 147.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet182024-02-05 13:582024-02-05 18:362024-02-06 08:563691215SE +/- 0.11, N = 15SE +/- 0.18, N = 8SE +/- 0.04, N = 910.019.859.69MIN: 8.29 / MAX: 66.34MIN: 8.54 / MAX: 12.61MIN: 9.24 / MAX: 12.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet182024-02-05 13:582024-02-05 18:362024-02-06 08:563691215Min: 9.54 / Avg: 10.01 / Max: 10.79Min: 8.94 / Avg: 9.85 / Max: 10.68Min: 9.55 / Avg: 9.69 / Max: 9.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnet2024-02-05 13:582024-02-05 18:362024-02-06 08:56246810SE +/- 0.05, N = 15SE +/- 0.05, N = 8SE +/- 0.02, N = 86.656.836.64MIN: 5.83 / MAX: 17.95MIN: 6.38 / MAX: 9.35MIN: 6.38 / MAX: 44.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnet2024-02-05 13:582024-02-05 18:362024-02-06 08:563691215Min: 6.27 / Avg: 6.65 / Max: 6.93Min: 6.6 / Avg: 6.83 / Max: 7.04Min: 6.56 / Avg: 6.64 / Max: 6.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet502024-02-05 13:582024-02-05 18:362024-02-06 08:56120240360480600SE +/- 0.16, N = 15SE +/- 236.61, N = 8SE +/- 0.37, N = 918.15565.3918.03MIN: 16.76 / MAX: 1675.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet502024-02-05 13:582024-02-05 18:362024-02-06 08:56100200300400500Min: 16.72 / Avg: 18.15 / Max: 18.7Min: 17.5 / Avg: 565.39 / Max: 1662.09Min: 16.39 / Avg: 18.03 / Max: 20.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tiny2024-02-05 13:582024-02-05 18:362024-02-06 08:5690180270360450SE +/- 0.99, N = 15SE +/- 120.86, N = 8SE +/- 3.53, N = 931.54421.9638.80MIN: 26.32 / MAX: 796.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tiny2024-02-05 13:582024-02-05 18:362024-02-06 08:5680160240320400Min: 28.72 / Avg: 31.54 / Max: 44.76Min: 30.55 / Avg: 421.96 / Max: 778.63Min: 28.04 / Avg: 38.8 / Max: 59.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssd2024-02-05 13:582024-02-05 18:362024-02-06 08:5650100150200250SE +/- 0.25, N = 15SE +/- 228.09, N = 8SE +/- 0.41, N = 915.46244.3614.93MIN: 13.25 / MAX: 1854.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssd2024-02-05 13:582024-02-05 18:362024-02-06 08:564080120160200Min: 13.72 / Avg: 15.46 / Max: 16.95Min: 13.82 / Avg: 244.36 / Max: 1840.98Min: 13.33 / Avg: 14.93 / Max: 17.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400m2024-02-05 13:582024-02-05 18:362024-02-06 08:56306090120150SE +/- 0.21, N = 15SE +/- 91.36, N = 8SE +/- 0.04, N = 921.47112.4420.71MIN: 18.78 / MAX: 94.51MIN: 18.72 / MAX: 8799.8MIN: 20.11 / MAX: 57.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400m2024-02-05 13:582024-02-05 18:362024-02-06 08:5620406080100Min: 19.99 / Avg: 21.47 / Max: 23.74Min: 19.88 / Avg: 112.44 / Max: 751.97Min: 20.43 / Avg: 20.71 / Max: 20.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformer2024-02-05 13:582024-02-05 18:362024-02-06 08:5630060090012001500SE +/- 0.79, N = 15SE +/- 261.92, N = 8SE +/- 7.30, N = 968.481263.0984.98MIN: 59.44 / MAX: 1769.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformer2024-02-05 13:582024-02-05 18:362024-02-06 08:562004006008001000Min: 63.42 / Avg: 68.48 / Max: 72.65Min: 71.36 / Avg: 1263.09 / Max: 1752.16Min: 60.84 / Avg: 84.98 / Max: 125.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDet2024-02-05 13:582024-02-05 18:362024-02-06 08:56140280420560700SE +/- 0.29, N = 15SE +/- 284.19, N = 8SE +/- 0.31, N = 98.16654.737.32MIN: 5.88 / MAX: 1709.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDet2024-02-05 13:582024-02-05 18:362024-02-06 08:56120240360480600Min: 6.51 / Avg: 8.16 / Max: 9.7Min: 6 / Avg: 654.73 / Max: 1693.63Min: 6.4 / Avg: 7.32 / Max: 8.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

PlaidML

This test profile uses PlaidML deep learning framework developed by Intel for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.

FP16: No - Mode: Training - Network: VGG16 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Training - Network: VGG19 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Inference - Network: VGG16 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Inference - Network: VGG19 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Training - Network: VGG16 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Training - Network: VGG19 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: VGG16 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: VGG19 - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Training - Network: IMDB LSTM - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Training - Network: Mobilenet - Device: CPU

2024-02-05 13:58: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-05 18:36: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Training - Network: ResNet 50 - Device: CPU2024-02-06 08:560.08330.16660.24990.33320.4165SE +/- 0.00, N = 30.37

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Inference - Network: Mobilenet - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU2024-02-06 08:561.13182.26363.39544.52725.659SE +/- 0.02, N = 35.03

FP16: Yes - Mode: Training - Network: IMDB LSTM - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Training - Network: Mobilenet - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Training - Network: ResNet 50 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: IMDB LSTM - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: Mobilenet - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Training - Network: DenseNet 201 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Training - Network: Inception V3 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Training - Network: NASNer Large - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Inference - Network: Inception V3 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: No - Mode: Inference - Network: NASNer Large - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Training - Network: DenseNet 201 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Training - Network: Inception V3 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Training - Network: NASNer Large - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: Inception V3 - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

FP16: Yes - Mode: Inference - Network: NASNer Large - Device: CPU

2024-02-06 08:56: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.