Nvidia

KVM testing on Ubuntu 24.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2410088-NE-2407208NE20
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 2 Tests
CPU Massive 3 Tests
Creator Workloads 2 Tests
HPC - High Performance Computing 6 Tests
Machine Learning 4 Tests
Multi-Core 4 Tests
NVIDIA GPU Compute 17 Tests
OpenCL 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
ASPEED - 2 x Intel Xeon Gold 6226R
July 19
  10 Hours, 49 Minutes
5x A5000 kw-dl580-3-4 NVIDIA
October 07
  1 Day, 4 Hours, 11 Minutes
Invert Hiding All Results Option
  19 Hours, 30 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


NvidiaProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDisplay ServerDisplay DriverOpenCLCompilerFile-SystemScreen ResolutionSystem LayerASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA2 x Intel Xeon Gold 6226R @ 3.90GHz (32 Cores / 64 Threads)(5.14 BIOS)Intel Sky Lake-E DMI3 Registers512GB2 x 8002GB INTEL SSDPE2KX080T8ASPEED 16GBNVIDIA GA104 HD Audio27B2G52 x Intel X722 for 1GbE + 2 x Broadcom BCM57414 NetXtreme-E 10Gb/25GbUbuntu 24.046.8.0-38-generic (x86_64)X ServerNVIDIAOpenCL 3.0 CUDA 12.4.131GCC 13.2.0 + CUDA 12.4ext41920x10804 x Intel Xeon E7-4880 v2 (60 Cores / 120 Threads)QEMU Standard PC (Q35 + ICH9 2009) (edk2-20240813-1.fc40 BIOS)Intel 82G33/G31/P35/P31 + ICH916 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 16 GB + 4 GB RAM21GB VIRTUAL-DISKRed Hat QXL paravirtual graphic card 22GBQEMU Generic2 x Red Hat Virtio 1.0 device6.8.0-45-generic (x86_64)GCC 13.2.0 + CUDA 12.01024x768KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- ASPEED - 2 x Intel Xeon Gold 6226R: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x5003605- 5x A5000 kw-dl580-3-4 NVIDIA: CPU Microcode: 0x715Graphics Details- ASPEED - 2 x Intel Xeon Gold 6226R: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 94.04.57.00.08- 5x A5000 kw-dl580-3-4 NVIDIA: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 94.02.6d.00.0dPython Details- ASPEED - 2 x Intel Xeon Gold 6226R: Python 3.8.13- 5x A5000 kw-dl580-3-4 NVIDIA: Python 3.12.3Security Details- ASPEED - 2 x Intel Xeon Gold 6226R: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Mitigation of Enhanced IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: SW sequence; BHI: SW loop KVM: SW loop + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - 5x A5000 kw-dl580-3-4 NVIDIA: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Mitigation of PTE Inversion; VMX: flush not necessary SMT vulnerable + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Unknown: No mitigations + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Retpoline + srbds: Not affected + tsx_async_abort: Not affected

ASPEED - 2 x Intel Xeon Gold 6226R vs. 5x A5000 kw-dl580-3-4 NVIDIA ComparisonPhoronix Test SuiteBaseline+148.3%+148.3%+296.6%+296.6%+444.9%+444.9%54.5%53.7%48.7%45.4%44.3%42.6%38.7%32.2%31.8%31.3%30%30%27.9%27.3%26.7%26.4%24.5%16.8%16.2%15.8%6.1%2.9%2.2%Vulkan GPU - regnety_400m593.1%Vulkan GPU - mnasnet442.2%Vulkan GPU - efficientnet-b0418.3%Vulkan GPU - blazeface409.9%Vulkan GPU - googlenet397%Vulkan GPU - shufflenet-v2393.6%Vulkan GPU - FastestDet382.9%Vulkan GPU-v2-v2 - mobilenet-v2379.8%Vulkan GPU-v3-v3 - mobilenet-v3373.1%Vulkan GPU - resnet50328.7%Vulkan GPU - mobilenet307%Vulkan GPU - resnet18296.3%Vulkan GPU - vision_transformer290.3%Vulkan GPU - squeezenet_ssd280.8%Vulkan GPU - alexnet253.3%Vulkan GPU - yolov4-tiny218%CPU BLAS - dDOT209.2%Vulkan GPU - vgg16208%CPU BLAS - dAXPY169.9%CPU BLAS - dCOPY155.7%CPU BLAS - dGEMV-N109.3%LuxCore Benchmark - GPU60%R.C.a.P - GPU59.8%G.M.BReadOpenCL - Single PrecisionOrange Juice - GPU47%WriteDanish Mood - GPU44.9%S.P.FI.C.IOpenCL BLAS - dAXPYD.P.DOpenCL BLAS - dCOPYCPU BLAS - sCOPYCPU BLAS - sDOT30.6%OpenCL BLAS - dGEMM-TTB.S.O29.6%OpenCL BLAS - dGEMM-NNOpenCL BLAS - dGEMM-NTOpenCL - Double PrecisionOpenCL - IntegerOpenCL BLAS - dDOTSHA-51221.8%SHA121.5%T.R.X21%7-Zip20%DLSC - GPU18.2%OpenCL BLAS - sAXPYOpenCL BLAS - sCOPYCopyMD513.9%OpenCL BLAS - sDOT7.2%CPU BLAS - dGEMM-TN6.7%O.P.FCPU BLAS - dGEMM-NT5.9%CPU BLAS - dGEMM-NN4.7%OpenCL BLAS - dGEMV-N3.7%CPU BLAS - sAXPYCPU BLAS - dGEMV-T2.5%OpenCL BLAS - dGEMV-TNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNViennaCLNCNNViennaCLViennaCLViennaCLLuxCoreRenderLuxCoreRenderclpeakcl-memMixbenchLuxCoreRendercl-memLuxCoreRenderclpeakclpeakViennaCLclpeakViennaCLViennaCLViennaCLViennaCLFinanceBenchFAHBenchViennaCLViennaCLMixbenchMixbenchViennaCLHashcatHashcatHashcatHashcatLuxCoreRenderViennaCLViennaCLcl-memHashcatViennaCLViennaCLRodiniaViennaCLViennaCLViennaCLViennaCLViennaCLViennaCLASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA

Nvidiancnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - vgg16clpeak: Global Memory Bandwidthcl-mem: Readmixbench: OpenCL - Single Precisionluxcorerender: Orange Juice - GPUcl-mem: Writeluxcorerender: Danish Mood - GPUclpeak: Single-Precision Floatclpeak: Integer Compute INTviennacl: OpenCL BLAS - dAXPYclpeak: Double-Precision Doubleviennacl: OpenCL BLAS - dCOPYviennacl: OpenCL BLAS - dGEMM-TTfinancebench: Black-Scholes OpenCLfahbench: viennacl: OpenCL BLAS - dGEMM-NNviennacl: OpenCL BLAS - dGEMM-NTmixbench: OpenCL - Double Precisionmixbench: OpenCL - Integerviennacl: OpenCL BLAS - dDOThashcat: SHA-512hashcat: SHA1hashcat: TrueCrypt RIPEMD160 + XTShashcat: 7-Zipviennacl: OpenCL BLAS - sAXPYviennacl: OpenCL BLAS - sCOPYcl-mem: Copyviennacl: OpenCL BLAS - sDOTrodinia: OpenCL Particle Filterviennacl: OpenCL BLAS - dGEMV-Nviennacl: OpenCL BLAS - dGEMV-Tviennacl: OpenCL BLAS - dGEMM-TNplaidml: No - Inference - DenseNet 201 - OpenCLplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLshoc: OpenCL - Texture Read Bandwidthshoc: OpenCL - Bus Speed Readbackshoc: OpenCL - Bus Speed Downloadshoc: OpenCL - Max SP Flopsshoc: OpenCL - GEMM SGEMM_Nshoc: OpenCL - Reductionshoc: OpenCL - MD5 Hashshoc: OpenCL - FFT SPshoc: OpenCL - Triadshoc: OpenCL - S3Dncnn: Vulkan GPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3ncnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - googlenetncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU - mobilenetviennacl: CPU BLAS - dGEMM-TTviennacl: CPU BLAS - dGEMM-TNviennacl: CPU BLAS - dGEMM-NTviennacl: CPU BLAS - dGEMM-NNviennacl: CPU BLAS - dGEMV-Tviennacl: CPU BLAS - dGEMV-Nviennacl: CPU BLAS - dDOTviennacl: CPU BLAS - dAXPYviennacl: CPU BLAS - dCOPYviennacl: CPU BLAS - sDOTviennacl: CPU BLAS - sAXPYviennacl: CPU BLAS - sCOPYluxcorerender: Rainbow Colors and Prism - GPUluxcorerender: LuxCore Benchmark - GPUluxcorerender: DLSC - GPUhashcat: MD5ASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA58.4633.4345.73377.04380.118670.2850.64376.435.8218602.659617.49385365.8335934010.460240.1385344348309.3911601.09383133080000009194003333334542004224700345266283.43127.105170317179.212201.611898.70751.931998.5813.152712.325021619.93630.55324.18222.56551094.6612.1173211.90410.3932.7720.3221.907.9710.9218.154.1311.027.309.728.528.3718.9358.362.259.459.7196108175183117.9261382228122.0626.7057.44156178112500228.16106.30140.86582.46584.427753.4034.46547.424.7226836.3813718.21534483.574734428.049185.2797440443391.9114663.50477109234333337569863333328539333519467403309328.22916.69416432444377.0550.17227.1477.3793.8928.1643.2890.2121.0657.1239.5847.9840.3140.1677.0557.258.356.157.0191.351.656.667.846.1199.8392.9299.376.3916.6948.60137067950000OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformer5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R50100150200250SE +/- 3.18, N = 9SE +/- 0.72, N = 12228.1658.46MIN: 122.48 / MAX: 1174.54MIN: 52.56 / MAX: 125.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tiny5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R20406080100SE +/- 1.69, N = 9SE +/- 0.49, N = 12106.3033.43MIN: 52.73 / MAX: 505.17MIN: 29.11 / MAX: 256.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg165x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R306090120150SE +/- 1.79, N = 9SE +/- 0.42, N = 12140.8645.73MIN: 71.64 / MAX: 393.59MIN: 41.81 / MAX: 716.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

clpeak

Clpeak is designed to test the peak capabilities of OpenCL devices. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGBPS, More Is Betterclpeak 1.1.2OpenCL Test: Global Memory BandwidthASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA130260390520650SE +/- 0.01, N = 3SE +/- 0.02, N = 3377.04582.461. (CXX) g++ options: -O3

cl-mem

A basic OpenCL memory benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: ReadASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA130260390520650SE +/- 0.03, N = 3SE +/- 0.43, N = 3380.1584.41. (CC) gcc options: -O2 -flto -lOpenCL

Mixbench

A benchmark suite for GPUs on mixed operational intensity kernels. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPS, More Is BetterMixbench 2020-06-23Backend: OpenCL - Benchmark: Single PrecisionASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA6K12K18K24K30KSE +/- 27.29, N = 3SE +/- 327.84, N = 1518670.2827753.401. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: GPU5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1122334455SE +/- 0.29, N = 15SE +/- 0.09, N = 334.4650.64MIN: 0.45 / MAX: 47.01MIN: 44.98 / MAX: 64.06

cl-mem

A basic OpenCL memory benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: WriteASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA120240360480600SE +/- 0.10, N = 3SE +/- 0.17, N = 3376.4547.41. (CC) gcc options: -O2 -flto -lOpenCL

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Danish Mood - Acceleration: GPU5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R816243240SE +/- 0.08, N = 3SE +/- 0.26, N = 324.7235.82MIN: 2.11 / MAX: 34.96MIN: 12.8 / MAX: 46.64

clpeak

Clpeak is designed to test the peak capabilities of OpenCL devices. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Single-Precision FloatASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA6K12K18K24K30KSE +/- 76.05, N = 3SE +/- 0.40, N = 318602.6526836.381. (CXX) g++ options: -O3

OpenBenchmarking.orgGIOPS, More Is Betterclpeak 1.1.2OpenCL Test: Integer Compute INTASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA3K6K9K12K15KSE +/- 87.03, N = 3SE +/- 26.25, N = 39617.4913718.211. (CXX) g++ options: -O3

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dAXPYASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA120240360480600SE +/- 0.00, N = 3SE +/- 1.15, N = 33855341. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

clpeak

Clpeak is designed to test the peak capabilities of OpenCL devices. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Double-Precision DoubleASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA100200300400500SE +/- 0.36, N = 3SE +/- 1.64, N = 3365.83483.571. (CXX) g++ options: -O3

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dCOPYASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA100200300400500SE +/- 0.58, N = 3SE +/- 1.45, N = 33594731. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TTASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA100200300400500SE +/- 2.03, N = 33404421. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

FinanceBench

FinanceBench is a collection of financial program benchmarks with support for benchmarking on the GPU via OpenCL and CPU benchmarking with OpenMP. The FinanceBench test cases are focused on Black-Sholes-Merton Process with Analytic European Option engine, QMC (Sobol) Monte-Carlo method (Equity Option Example), Bonds Fixed-rate bond with flat forward curve, and Repo Securities repurchase agreement. FinanceBench was originally written by the Cavazos Lab at University of Delaware. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Black-Scholes OpenCLASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA3691215SE +/- 0.016, N = 3SE +/- 0.107, N = 310.4608.0491. (CXX) g++ options: -O3 -march=native -fopenmp

FAHBench

FAHBench is a Folding@Home benchmark on the GPU. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterFAHBench 2.3.25x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R50100150200250SE +/- 2.24, N = 3SE +/- 0.31, N = 3185.28240.14

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NNASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA100200300400500SE +/- 1.45, N = 3SE +/- 1.15, N = 33444401. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NTASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA100200300400500SE +/- 2.03, N = 33484431. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

Mixbench

A benchmark suite for GPUs on mixed operational intensity kernels. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPS, More Is BetterMixbench 2020-06-23Backend: OpenCL - Benchmark: Double PrecisionASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA90180270360450SE +/- 0.92, N = 3SE +/- 4.99, N = 15309.39391.911. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2

OpenBenchmarking.orgGIOPS, More Is BetterMixbench 2020-06-23Backend: OpenCL - Benchmark: IntegerASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA3K6K9K12K15KSE +/- 4.62, N = 3SE +/- 174.42, N = 1511601.0914663.501. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dDOTASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA100200300400500SE +/- 0.33, N = 3SE +/- 0.33, N = 33834771. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

Hashcat

Hashcat is an open-source, advanced password recovery tool supporting GPU acceleration with OpenCL, NVIDIA CUDA, and Radeon ROCm. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA-5125x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R3000M6000M9000M12000M15000MSE +/- 27986087.81, N = 3SE +/- 26463244.95, N = 31092343333313308000000

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA15x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R20000M40000M60000M80000M100000MSE +/- 133865807.60, N = 3SE +/- 113680610.09, N = 37569863333391940033333

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: TrueCrypt RIPEMD160 + XTS5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R700K1400K2100K2800K3500KSE +/- 4272.52, N = 3SE +/- 1039.23, N = 328539333454200

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: 7-Zip5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R900K1800K2700K3600K4500KSE +/- 9837.57, N = 3SE +/- 9462.73, N = 335194674224700

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sAXPYASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA90180270360450SE +/- 0.33, N = 3SE +/- 1.53, N = 33454031. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sCOPYASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA70140210280350SE +/- 0.67, N = 3SE +/- 0.67, N = 32663091. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

cl-mem

A basic OpenCL memory benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA70140210280350SE +/- 0.07, N = 3SE +/- 0.32, N = 3283.4328.21. (CC) gcc options: -O2 -flto -lOpenCL

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sDOT5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R70140210280350SE +/- 0.67, N = 3SE +/- 0.67, N = 32913121. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

Rodinia

Rodinia is a suite focused upon accelerating compute-intensive applications with accelerators. CUDA, OpenMP, and OpenCL parallel models are supported by the included applications. This profile utilizes select OpenCL, NVIDIA CUDA and OpenMP test binaries at the moment. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenCL Particle FilterASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA246810SE +/- 0.096, N = 3SE +/- 0.079, N = 157.1056.694-m64 -lm -lcuda -lcudart -lcudadevrt -lcudart_static -lrt -lpthread -ldl-O2 -lOpenCL1. (CXX) g++ options:

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-N5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R4080120160200SE +/- 0.58, N = 3SE +/- 0.00, N = 31641701. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-TASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA70140210280350SE +/- 1.76, N = 3SE +/- 0.88, N = 33173241. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TN5x A5000 kw-dl580-3-4 NVIDIA100200300400500SE +/- 1.76, N = 34431. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

PlaidML

This test profile uses PlaidML deep learning framework developed by Intel for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLASPEED - 2 x Intel Xeon Gold 6226R4080120160200SE +/- 0.34, N = 3179.21

FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'tensorflow'

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLASPEED - 2 x Intel Xeon Gold 6226R5001000150020002500SE +/- 0.40, N = 32201.61

FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'tensorflow'

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLASPEED - 2 x Intel Xeon Gold 6226R400800120016002000SE +/- 2.99, N = 31898.70

FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'tensorflow'

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLASPEED - 2 x Intel Xeon Gold 6226R160320480640800SE +/- 1.13, N = 3751.93

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'tensorflow'

SHOC Scalable HeterOgeneous Computing

The CUDA and OpenCL version of Vetter's Scalable HeterOgeneous Computing benchmark suite. SHOC provides a number of different benchmark programs for evaluating the performance and stability of compute devices. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Texture Read BandwidthASPEED - 2 x Intel Xeon Gold 6226R400800120016002000SE +/- 4.68, N = 31998.581. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: Texture Read Bandwidth

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Bus Speed ReadbackASPEED - 2 x Intel Xeon Gold 6226R3691215SE +/- 0.00, N = 313.151. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: Bus Speed Readback

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Bus Speed DownloadASPEED - 2 x Intel Xeon Gold 6226R3691215SE +/- 0.00, N = 312.331. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: Bus Speed Download

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Max SP FlopsASPEED - 2 x Intel Xeon Gold 6226R5K10K15K20K25KSE +/- 305.65, N = 321619.91. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: Max SP Flops

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: GEMM SGEMM_NASPEED - 2 x Intel Xeon Gold 6226R8001600240032004000SE +/- 44.25, N = 43630.551. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: GEMM SGEMM_N

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: ReductionASPEED - 2 x Intel Xeon Gold 6226R70140210280350SE +/- 0.27, N = 3324.181. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: Reduction

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGHash/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: MD5 HashASPEED - 2 x Intel Xeon Gold 6226R510152025SE +/- 0.00, N = 322.571. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: MD5 Hash

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: FFT SPASPEED - 2 x Intel Xeon Gold 6226R2004006008001000SE +/- 0.17, N = 31094.661. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: FFT SP

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: TriadASPEED - 2 x Intel Xeon Gold 6226R3691215SE +/- 0.00, N = 312.121. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: Triad

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: S3DASPEED - 2 x Intel Xeon Gold 6226R50100150200250SE +/- 0.07, N = 3211.901. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

Target: OpenCL - Benchmark: S3D

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./shoc: 3: ./bin/shocdriver: not found

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov35x A5000 kw-dl580-3-4 NVIDIA20406080100SE +/- 2.12, N = 977.05MIN: 37.56 / MAX: 842.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NeatBench

NeatBench is a benchmark of the cross-platform Neat Video software on the CPU and optional GPU (OpenCL / CUDA) support. Learn more via the OpenBenchmarking.org test page.

Acceleration: GPU

ASPEED - 2 x Intel Xeon Gold 6226R: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

5x A5000 kw-dl580-3-4 NVIDIA: The test run did not produce a result.

MandelGPU

MandelGPU is an OpenCL benchmark and this test runs with the OpenCL rendering float4 kernel with a maximum of 4096 iterations. Learn more via the OpenBenchmarking.org test page.

OpenCL Device: GPU

ASPEED - 2 x Intel Xeon Gold 6226R: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status.

PlaidML

This test profile uses PlaidML deep learning framework developed by Intel for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.

FP16: No - Mode: Training - Network: Mobilenet - Device: OpenCL

ASPEED - 2 x Intel Xeon Gold 6226R: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'tensorflow'

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDet5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1122334455SE +/- 1.46, N = 9SE +/- 0.41, N = 1150.1710.39MIN: 22.35 / MAX: 948.14MIN: 8.52 / MAX: 30.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400m5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R50100150200250SE +/- 27.31, N = 9SE +/- 0.23, N = 12227.1432.77MIN: 93.69 / MAX: 5948.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssd5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R20406080100SE +/- 3.32, N = 9SE +/- 0.34, N = 1277.3720.32MIN: 35.36 / MAX: 1176.72MIN: 18.17 / MAX: 30.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet505x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R20406080100SE +/- 2.01, N = 9SE +/- 0.24, N = 1293.8921.90MIN: 44.98 / MAX: 1038.18MIN: 20.15 / MAX: 31.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnet5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R714212835SE +/- 0.75, N = 9SE +/- 0.10, N = 1228.167.97MIN: 13.44 / MAX: 256.84MIN: 7.31 / MAX: 10.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet185x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1020304050SE +/- 1.32, N = 9SE +/- 0.11, N = 1243.2810.92MIN: 20.79 / MAX: 504.17MIN: 10.17 / MAX: 12.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenet5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R20406080100SE +/- 3.17, N = 9SE +/- 0.33, N = 1290.2118.15MIN: 41.1 / MAX: 1221.73MIN: 15.73 / MAX: 36.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazeface5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R510152025SE +/- 1.40, N = 9SE +/- 0.07, N = 1221.064.13MIN: 10.19 / MAX: 621.35MIN: 3.7 / MAX: 4.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b05x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1326395265SE +/- 1.20, N = 9SE +/- 0.13, N = 1257.1211.02MIN: 26.93 / MAX: 1232.95MIN: 9.86 / MAX: 77.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnet5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R918273645SE +/- 1.96, N = 9SE +/- 0.12, N = 1239.587.30MIN: 17.71 / MAX: 715.88MIN: 6.57 / MAX: 71.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v25x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1122334455SE +/- 2.22, N = 9SE +/- 0.08, N = 1247.989.72MIN: 22.19 / MAX: 949.82MIN: 8.97 / MAX: 16.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v35x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R918273645SE +/- 1.76, N = 9SE +/- 0.06, N = 1240.318.52MIN: 19.09 / MAX: 864.81MIN: 7.93 / MAX: 87.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v25x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R918273645SE +/- 1.67, N = 9SE +/- 0.10, N = 1240.168.37MIN: 19.36 / MAX: 731.71MIN: 7.43 / MAX: 30.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenet5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R20406080100SE +/- 2.12, N = 9SE +/- 0.22, N = 1277.0518.93MIN: 37.56 / MAX: 842.19MIN: 17.49 / MAX: 22.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TT5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1326395265SE +/- 0.14, N = 12SE +/- 1.46, N = 1557.258.31. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TN5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1428425670SE +/- 0.13, N = 12SE +/- 1.35, N = 1458.362.21. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NT5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1326395265SE +/- 0.35, N = 12SE +/- 1.11, N = 1456.159.41. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NN5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1326395265SE +/- 0.22, N = 12SE +/- 1.20, N = 1557.059.71. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-T5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R4080120160200SE +/- 20.15, N = 12SE +/- 1.22, N = 15191.3196.01. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-N5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R20406080100SE +/- 1.70, N = 12SE +/- 0.64, N = 1551.6108.01. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dDOT5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R4080120160200SE +/- 2.95, N = 12SE +/- 1.40, N = 1556.6175.01. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dAXPY5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R4080120160200SE +/- 2.44, N = 12SE +/- 1.77, N = 1567.8183.01. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dCOPY5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R306090120150SE +/- 1.21, N = 12SE +/- 2.79, N = 1546.1117.91. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sDOT5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R60120180240300SE +/- 23.95, N = 12SE +/- 1.23, N = 15199.8261.01. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sAXPYASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA90180270360450SE +/- 5.93, N = 15SE +/- 53.50, N = 12382.0392.91. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sCOPYASPEED - 2 x Intel Xeon Gold 6226R5x A5000 kw-dl580-3-4 NVIDIA70140210280350SE +/- 3.89, N = 15SE +/- 34.09, N = 12228.0299.31. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ArrayFire

Test: Conjugate Gradient OpenCL

ASPEED - 2 x Intel Xeon Gold 6226R: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./arrayfire: 7: ./cg_opencl: not found

5x A5000 kw-dl580-3-4 NVIDIA: The test run did not produce a result. E: ./arrayfire: 7: ./cg_opencl: not found

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Rainbow Colors and Prism - Acceleration: GPU5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R306090120150SE +/- 2.42, N = 12SE +/- 0.62, N = 376.39122.06MIN: 61.59 / MAX: 129.05MIN: 106.98 / MAX: 141.43

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: GPU5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R612182430SE +/- 1.54, N = 12SE +/- 2.44, N = 1216.6926.70MAX: 33.09MAX: 43.01

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: GPU5x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R1326395265SE +/- 0.60, N = 3SE +/- 5.22, N = 1248.6057.44MIN: 29.6 / MAX: 52.28MAX: 65.49

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

Backend: OpenCL

ASPEED - 2 x Intel Xeon Gold 6226R: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./lczero: line 4: ./lc0: No such file or directory

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./lczero: line 4: ./lc0: No such file or directory

RedShift Demo

This is a test of MAXON's RedShift demo build that currently requires NVIDIA GPU acceleration. Learn more via the OpenBenchmarking.org test page.

ASPEED - 2 x Intel Xeon Gold 6226R: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./redshift: 3: /usr/redshift/bin/redshiftBenchmark: not found

5x A5000 kw-dl580-3-4 NVIDIA: The test quit with a non-zero exit status. E: ./redshift: 3: /usr/redshift/bin/redshiftBenchmark: not found

Hashcat

Hashcat is an open-source, advanced password recovery tool supporting GPU acceleration with OpenCL, NVIDIA CUDA, and Radeon ROCm. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: MD55x A5000 kw-dl580-3-4 NVIDIAASPEED - 2 x Intel Xeon Gold 6226R30000M60000M90000M120000M150000MSE +/- 23688235109.70, N = 16SE +/- 31239876948.73, N = 16137067950000156178112500

79 Results Shown

NCNN:
  Vulkan GPU - vision_transformer
  Vulkan GPU - yolov4-tiny
  Vulkan GPU - vgg16
clpeak
cl-mem
Mixbench
LuxCoreRender
cl-mem
LuxCoreRender
clpeak:
  Single-Precision Float
  Integer Compute INT
ViennaCL
clpeak
ViennaCL:
  OpenCL BLAS - dCOPY
  OpenCL BLAS - dGEMM-TT
FinanceBench
FAHBench
ViennaCL:
  OpenCL BLAS - dGEMM-NN
  OpenCL BLAS - dGEMM-NT
Mixbench:
  OpenCL - Double Precision
  OpenCL - Integer
ViennaCL
Hashcat:
  SHA-512
  SHA1
  TrueCrypt RIPEMD160 + XTS
  7-Zip
ViennaCL:
  OpenCL BLAS - sAXPY
  OpenCL BLAS - sCOPY
cl-mem
ViennaCL
Rodinia
ViennaCL:
  OpenCL BLAS - dGEMV-N
  OpenCL BLAS - dGEMV-T
  OpenCL BLAS - dGEMM-TN
PlaidML:
  No - Inference - DenseNet 201 - OpenCL
  Yes - Inference - Mobilenet - OpenCL
  No - Inference - Mobilenet - OpenCL
  No - Inference - IMDB LSTM - OpenCL
SHOC Scalable HeterOgeneous Computing:
  OpenCL - Texture Read Bandwidth
  OpenCL - Bus Speed Readback
  OpenCL - Bus Speed Download
  OpenCL - Max SP Flops
  OpenCL - GEMM SGEMM_N
  OpenCL - Reduction
  OpenCL - MD5 Hash
  OpenCL - FFT SP
  OpenCL - Triad
  OpenCL - S3D
NCNN:
  Vulkan GPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3
  Vulkan GPU - FastestDet
  Vulkan GPU - regnety_400m
  Vulkan GPU - squeezenet_ssd
  Vulkan GPU - resnet50
  Vulkan GPU - alexnet
  Vulkan GPU - resnet18
  Vulkan GPU - googlenet
  Vulkan GPU - blazeface
  Vulkan GPU - efficientnet-b0
  Vulkan GPU - mnasnet
  Vulkan GPU - shufflenet-v2
  Vulkan GPU-v3-v3 - mobilenet-v3
  Vulkan GPU-v2-v2 - mobilenet-v2
  Vulkan GPU - mobilenet
ViennaCL:
  CPU BLAS - dGEMM-TT
  CPU BLAS - dGEMM-TN
  CPU BLAS - dGEMM-NT
  CPU BLAS - dGEMM-NN
  CPU BLAS - dGEMV-T
  CPU BLAS - dGEMV-N
  CPU BLAS - dDOT
  CPU BLAS - dAXPY
  CPU BLAS - dCOPY
  CPU BLAS - sDOT
  CPU BLAS - sAXPY
  CPU BLAS - sCOPY
LuxCoreRender:
  Rainbow Colors and Prism - GPU
  LuxCore Benchmark - GPU
  DLSC - GPU
Hashcat