2307020-PTS-GPUREVIEW1

RTX 4080 16GB PNY REVIEW

HTML result view exported from: https://openbenchmarking.org/result/2307077-NE-2307020PT71&grs&sro.

2307020-PTS-GPUREVIEW1ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionRTX 3090 24GB -ZotacRTX 2080 Ti 22GB -DellRTX 4090 24GB -NvidiaRTX 4080 16GB -PnyIntel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads)ASUS Pro WS W790E-SAGE SE (0506 BIOS)Intel Device 7aa78 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N6401GB Micron_9300_MTFDHAL6T4TDR + 0GB Virtual HDisk0NVIDIA GeForce RTX 3090 24GBRealtek ALC1220BenQ PD2720U2 x Intel X710 for 10GBASE-TUbuntu 22.046.3.0-060300-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.4NVIDIA 530.41.034.6.0OpenCL 3.0 CUDA 12.1.981.3.236GCC 11.3.0 + CUDA 12.1ext43840x2160NVIDIA GeForce RTX 2080 Ti 22GBNVIDIA GeForce RTX 4090 24GBNVIDIA GeForce RTX 4080 16GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-aYxV0E/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-aYxV0E/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b000390Graphics Details- RTX 3090 24GB -Zotac: BAR1 / Visible vRAM Size: 32768 MiB - vBIOS Version: 94.02.26.48.65- RTX 2080 Ti 22GB -Dell: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 90.02.30.40.4d- RTX 4090 24GB -Nvidia: BAR1 / Visible vRAM Size: 32768 MiB - vBIOS Version: 95.02.20.00.03- RTX 4080 16GB -Pny: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.03.0e.00.67OpenCL Details- RTX 3090 24GB -Zotac: GPU Compute Cores: 10496- RTX 2080 Ti 22GB -Dell: GPU Compute Cores: 4352- RTX 4090 24GB -Nvidia: GPU Compute Cores: 16384- RTX 4080 16GB -Pny: GPU Compute Cores: 9728Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

2307020-PTS-GPUREVIEW1ncnn: Vulkan GPU - squeezenet_ssdclpeak: Single-Precision Floatshoc: OpenCL - GEMM SGEMM_Nshoc: OpenCL - Max SP Flopsncnn: Vulkan GPU - googlenetncnn: Vulkan GPU - resnet18v-ray: NVIDIA CUDA GPUncnn: Vulkan GPU - alexnetv-ray: NVIDIA RTX GPUncnn: Vulkan GPU - mobilenetoctanebench: Total Scorevkpeak: fp32-vec4clpeak: Integer Compute INThashcat: 7-Zipblender: Pabellon Barcelona - NVIDIA OptiXhashcat: TrueCrypt RIPEMD160 + XTSindigobench: OpenCL GPU - Bedroomhashcat: SHA-512financebench: Black-Scholes OpenCLblender: Barbershop - NVIDIA OptiXblender: Classroom - NVIDIA OptiXhashcat: SHA1vkpeak: int16-vec4hashcat: MD5blender: Fishy Cat - NVIDIA OptiXviennacl: OpenCL BLAS - dGEMM-TTshoc: OpenCL - MD5 Hashvkpeak: int16-scalarvkpeak: fp16-vec4vkpeak: fp16-scalargromacs: NVIDIA CUDA GPU - water_GMX50_bareviennacl: OpenCL BLAS - dGEMM-TNvkpeak: int32-vec4shoc: OpenCL - Reductionvkpeak: fp64-scalarviennacl: OpenCL BLAS - dGEMM-NTvkpeak: fp32-scalarvkpeak: int32-scalarvkpeak: fp64-vec4clpeak: Double-Precision Doublevkresample: 2x - Doubleshoc: OpenCL - Texture Read Bandwidthrealsr-ncnn: 4x - Yesviennacl: OpenCL BLAS - dGEMM-NNindigobench: OpenCL GPU - Supercarshoc: OpenCL - S3Dmandelgpu: GPUshoc: OpenCL - Bus Speed Readbackshoc: OpenCL - Triadneatbench: GPUshoc: OpenCL - Bus Speed Downloadarrayfire: Conjugate Gradient OpenCLvkresample: 2x - Singleshoc: OpenCL - FFT SPrealsr-ncnn: 4x - Novkfft: cl-mem: Writewaifu2x-ncnn: 2x - 3 - Yesclpeak: Global Memory Bandwidthcl-mem: Readviennacl: OpenCL BLAS - dGEMV-Ncaffe: AlexNet - NVIDIA CUDA - 1000caffe: AlexNet - NVIDIA CUDA - 200viennacl: OpenCL BLAS - dAXPYncnn: Vulkan GPU - yolov4-tinycaffe: AlexNet - NVIDIA CUDA - 100caffe: GoogleNet - NVIDIA CUDA - 1000caffe: GoogleNet - NVIDIA CUDA - 200caffe: GoogleNet - NVIDIA CUDA - 100viennacl: OpenCL BLAS - sDOTviennacl: OpenCL BLAS - sCOPYfahbench: viennacl: OpenCL BLAS - sAXPYviennacl: OpenCL BLAS - dCOPYviennacl: OpenCL BLAS - dDOTcl-mem: Copyncnn: Vulkan GPU - vision_transformerviennacl: OpenCL BLAS - dGEMV-Tlczero: OpenCLviennacl: CPU BLAS - dCOPYviennacl: CPU BLAS - dDOTviennacl: CPU BLAS - dAXPYviennacl: CPU BLAS - sCOPYviennacl: CPU BLAS - sAXPYviennacl: CPU BLAS - dGEMV-Tviennacl: CPU BLAS - sDOTncnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU-v2-v2 - mobilenet-v2blender: BMW27 - NVIDIA OptiXviennacl: CPU BLAS - dGEMM-TTviennacl: CPU BLAS - dGEMM-TNviennacl: CPU BLAS - dGEMM-NTviennacl: CPU BLAS - dGEMM-NNviennacl: CPU BLAS - dGEMV-Nrodinia: OpenCL Particle Filternamd-cuda: ATPase Simulation - 327,506 AtomsRTX 3090 24GB -ZotacRTX 2080 Ti 22GB -DellRTX 4090 24GB -NvidiaRTX 4080 16GB -Pny57.2735000.447912.5937738.428.4421.45205221.31287837.93669.37102626392.0917864.54109595016.0773132720.77225952500005.79652.2814.252063405000016205.986370092666710.8458441.332413295.7240002.9320161.5923.74358720074.10392.804645.2458820403.3520305.75645.31640.15121.3532148.8631.17058551.701427.491568293355.526.397524.5486309025.19301.5839.3592349.396.50941547734.33.536814.92823.31856584.811321.3671649.10664.59724142.84830.592418.86372363316.5721495600658359.2324.88371143168346069841842227274976413.5225.046.354.405.3823.9719.1617.5718.7818.256.131431411201071723.7680.0674261.7414076.714858.1316106.428.2222.1395021.50130638.20349.49018515859.1211826.7684027527.4258026011.15220471833338.84092.8722.691630090000012975.655150325000016.8945832.518110270.2630649.1315521.1215.37746015752.98366.058500.9146115974.2215963.59503.53506.01153.1461147.2652.75545932.598270.801442866316.913.204612.6064208012.85301.67914.7901504.879.23933404452.24.307504.66543.829751852.48305306292.6940392475524318.1363.75370132289236581058175522617427476.8023.135.857.075.4926.097.036.1118.776.358.93145142119106.81794.5270.095158.9979463.3627175.988606.05.774.5042655.0854789.211326.23767458607.4640697.7327469388.42185780035.29662977666672.89030.557.474939336666739280.821543333333335.73134093.901929507.1787698.3944269.7943.470129344062.52967.1421394.44128044315.3544276.721396.261391.5155.9252980.1520.187115078.445644.603951815274.226.372425.0717409025.13110.88037.7992779.485.10959427785.82.490871.56886.02204379.70883.95377235.23447.34116499.33304.151660.01446444423.2069568661719410.3289.04443150979466711098187423607717845.085.467.2825.143.956.424.394.854.974.423.701441371151201882.0850.048509.1347802.8716952.655455.85.714.78312617.5740809.36977.5281436655.6924524.34174735010.41114656026.08039363500004.40437.979.323088153333324616.84968919666677.5984960.558118441.4654827.6627669.3732.04483127595.511020.235873.5279527771.8827758.93873.67869.2589.2373065.7624.37477466.030423.578772392077.326.393524.7590408025.10071.12211.5431831.865.63048201567.72.761611.67623.22245228.001053.8860835.87537.49116310.53279.171649.29417385424.3492487540597382.0290.15435153169566781085190124227877835.185.325.167.903.896.304.374.785.024.324.43137135122103.51872.6850.05427OpenBenchmarking.org

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: squeezenet_ssdRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1428425670SE +/- 0.50, N = 3SE +/- 0.43, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 361.7457.279.138.99MIN: 23.2 / MAX: 85.24MIN: 16.86 / MAX: 94.95MIN: 7.71 / MAX: 66.82MIN: 8.18 / MAX: 62.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Single-Precision FloatRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia20K40K60K80K100KSE +/- 80.60, N = 11SE +/- 10.34, N = 15SE +/- 50.90, N = 14SE +/- 103.68, N = 1414076.7135000.4447802.8779463.361. (CXX) g++ options: -O3

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: GEMM SGEMM_N

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: GEMM SGEMM_NRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia6K12K18K24K30KSE +/- 33.05, N = 10SE +/- 16.79, N = 11SE +/- 224.54, N = 15SE +/- 164.66, N = 134858.137912.5916952.6027175.901. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Max SP Flops

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Max SP FlopsRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia20K40K60K80K100KSE +/- 102.77, N = 3SE +/- 292.47, N = 3SE +/- 73.47, N = 3SE +/- 19.25, N = 316106.437738.455455.888606.01. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: googlenetRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia714212835SE +/- 0.49, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 328.2228.445.715.77MIN: 15.18 / MAX: 38.54MIN: 14.74 / MAX: 44.82MIN: 5.03 / MAX: 22.85MIN: 4.99 / MAX: 22.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: resnet18RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia510152025SE +/- 0.55, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 322.1321.454.784.50MIN: 9.01 / MAX: 43.23MIN: 8.94 / MAX: 40.36MIN: 4.18 / MAX: 28.49MIN: 3.89 / MAX: 21.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Chaos Group V-RAY

Mode: NVIDIA CUDA GPU

OpenBenchmarking.orgvpaths, More Is BetterChaos Group V-RAY 5.02Mode: NVIDIA CUDA GPURTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia9001800270036004500SE +/- 0.67, N = 3SE +/- 2.85, N = 3SE +/- 2.73, N = 3SE +/- 2.33, N = 3950205231264265

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: alexnetRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia510152025SE +/- 0.30, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 321.5021.3117.575.08MIN: 3.33 / MAX: 40.17MIN: 7.31 / MAX: 35.87MIN: 7.8 / MAX: 33.45MIN: 3.13 / MAX: 27.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Chaos Group V-RAY

Mode: NVIDIA RTX GPU

OpenBenchmarking.orgvrays, More Is BetterChaos Group V-RAY 5.02Mode: NVIDIA RTX GPURTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia12002400360048006000SE +/- 10.17, N = 3SE +/- 18.12, N = 3SE +/- 30.20, N = 3SE +/- 63.00, N = 31306287840805478

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: mobilenetRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia918273645SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 338.2037.939.369.21MIN: 10.75 / MAX: 66.72MIN: 14.41 / MAX: 61.76MIN: 8.28 / MAX: 49.63MIN: 8.39 / MAX: 47.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OctaneBench

Total Score

OpenBenchmarking.orgScore, More Is BetterOctaneBench 2020.1Total ScoreRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500349.49669.37977.531326.24

vkpeak

fp32-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20210424fp32-vec4RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia13K26K39K52K65KSE +/- 77.45, N = 3SE +/- 43.15, N = 3SE +/- 13.71, N = 3SE +/- 13.83, N = 315859.1226392.0936655.6958607.46

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS, More Is Betterclpeak 1.1.2OpenCL Test: Integer Compute INTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia9K18K27K36K45KSE +/- 86.60, N = 15SE +/- 36.29, N = 15SE +/- 20.64, N = 14SE +/- 49.03, N = 1411826.7617864.5424524.3440697.731. (CXX) g++ options: -O3

Hashcat

Benchmark: 7-Zip

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: 7-ZipRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia600K1200K1800K2400K3000KSE +/- 1608.10, N = 8SE +/- 1997.77, N = 8SE +/- 1869.68, N = 8SE +/- 1870.54, N = 8840275109595017473502746938

Blender

Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: NVIDIA OptiXRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia612182430SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 5SE +/- 0.02, N = 527.4216.0710.418.42

Hashcat

Benchmark: TrueCrypt RIPEMD160 + XTS

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: TrueCrypt RIPEMD160 + XTSRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia400K800K1200K1600K2000KSE +/- 4392.30, N = 10SE +/- 5945.49, N = 15SE +/- 8051.58, N = 15SE +/- 13557.46, N = 758026073132711465601857800

IndigoBench

Acceleration: OpenCL GPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: BedroomRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia816243240SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 311.1520.7726.0835.30

Hashcat

Benchmark: SHA-512

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA-512RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1300M2600M3900M5200M6500MSE +/- 6223365.47, N = 6SE +/- 2013247.79, N = 6SE +/- 1634982.16, N = 6SE +/- 2101057.93, N = 62047183333259525000039363500006297766667

FinanceBench

Benchmark: Black-Scholes OpenCL

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Black-Scholes OpenCLRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia246810SE +/- 0.110, N = 15SE +/- 0.002, N = 14SE +/- 0.013, N = 15SE +/- 0.005, N = 158.8405.7964.4042.8901. (CXX) g++ options: -O3 -march=native -fopenmp

Blender

Blend File: Barbershop - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: NVIDIA OptiXRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia20406080100SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 392.8752.2837.9730.55

Blender

Blend File: Classroom - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: NVIDIA OptiXRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia510152025SE +/- 0.03, N = 3SE +/- 0.01, N = 4SE +/- 0.02, N = 5SE +/- 0.01, N = 622.6914.259.327.47

Hashcat

Benchmark: SHA1

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA1RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia11000M22000M33000M44000M55000MSE +/- 39682498.24, N = 6SE +/- 15661518.66, N = 6SE +/- 19028429.02, N = 6SE +/- 18148896.51, N = 616300900000206340500003088153333349393366667

vkpeak

int16-vec4

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20210424int16-vec4RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia8K16K24K32K40KSE +/- 4.25, N = 3SE +/- 4.87, N = 3SE +/- 0.85, N = 3SE +/- 1.77, N = 312975.6516205.9824616.8439280.82

Hashcat

Benchmark: MD5

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: MD5RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30000M60000M90000M120000M150000MSE +/- 232076903.56, N = 6SE +/- 474267340.07, N = 15SE +/- 34207656.71, N = 6SE +/- 243127767.05, N = 6515032500006370092666796891966667154333333333

Blender

Blend File: Fishy Cat - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: NVIDIA OptiXRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia48121620SE +/- 0.21, N = 4SE +/- 0.07, N = 15SE +/- 0.07, N = 15SE +/- 0.07, N = 1516.8910.847.595.73

ViennaCL

Test: OpenCL BLAS - dGEMM-TT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500SE +/- 1.45, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 345858484913401. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: MD5 Hash

OpenBenchmarking.orgGHash/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: MD5 HashRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia20406080100SE +/- 0.06, N = 14SE +/- 0.05, N = 14SE +/- 0.65, N = 15SE +/- 0.95, N = 1532.5241.3360.5693.901. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

vkpeak

int16-scalar

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20210424int16-scalarRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia6K12K18K24K30KSE +/- 0.89, N = 3SE +/- 0.25, N = 3SE +/- 0.34, N = 3SE +/- 4.42, N = 310270.2613295.7218441.4629507.17

vkpeak

fp16-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20210424fp16-vec4RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia20K40K60K80K100KSE +/- 26.46, N = 3SE +/- 64.52, N = 3SE +/- 0.37, N = 3SE +/- 98.17, N = 330649.1340002.9354827.6687698.39

vkpeak

fp16-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20210424fp16-scalarRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia9K18K27K36K45KSE +/- 61.99, N = 3SE +/- 30.30, N = 3SE +/- 0.86, N = 3SE +/- 7.21, N = 315521.1220161.5927669.3744269.79

GROMACS

Implementation: NVIDIA CUDA GPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: NVIDIA CUDA GPU - Input: water_GMX50_bareRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1020304050SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 315.3823.7432.0443.471. (CXX) g++ options: -O3

ViennaCL

Test: OpenCL BLAS - dGEMM-TN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TNRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500SE +/- 0.50, N = 2SE +/- 1.67, N = 3SE +/- 0.67, N = 3SE +/- 3.33, N = 346058783112931. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

vkpeak

int32-vec4

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20210424int32-vec4RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia9K18K27K36K45KSE +/- 15.45, N = 3SE +/- 27.49, N = 3SE +/- 37.47, N = 3SE +/- 3.11, N = 315752.9820074.1027595.5144062.52

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Reduction

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: ReductionRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 0.06, N = 12SE +/- 0.11, N = 13SE +/- 13.90, N = 15SE +/- 9.75, N = 15366.06392.801020.24967.141. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

vkpeak

fp64-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20210424fp64-scalarRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500SE +/- 1.28, N = 3SE +/- 1.62, N = 3SE +/- 0.08, N = 3SE +/- 0.73, N = 3500.91645.24873.521394.44

ViennaCL

Test: OpenCL BLAS - dGEMM-NT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500SE +/- 0.58, N = 3SE +/- 1.67, N = 3SE +/- 1.00, N = 3SE +/- 0.00, N = 346158879512801. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

vkpeak

fp32-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20210424fp32-scalarRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia9K18K27K36K45KSE +/- 136.44, N = 3SE +/- 34.37, N = 3SE +/- 35.38, N = 3SE +/- 10.09, N = 315974.2220403.3527771.8844315.35

vkpeak

int32-scalar

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20210424int32-scalarRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia9K18K27K36K45KSE +/- 39.60, N = 3SE +/- 10.90, N = 3SE +/- 2.25, N = 3SE +/- 25.10, N = 315963.5920305.7527758.9344276.72

vkpeak

fp64-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20210424fp64-vec4RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500SE +/- 0.03, N = 3SE +/- 1.70, N = 3SE +/- 0.01, N = 3SE +/- 1.25, N = 3503.53645.31873.671396.26

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Double-Precision DoubleRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500SE +/- 1.50, N = 4SE +/- 0.46, N = 5SE +/- 1.29, N = 6SE +/- 1.85, N = 6506.01640.15869.251391.511. (CXX) g++ options: -O3

VkResample

Upscale: 2x - Precision: Double

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: DoubleRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia306090120150SE +/- 0.26, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3153.15121.3589.2455.931. (CXX) g++ options: -O3

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Texture Read Bandwidth

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Texture Read BandwidthRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia7001400210028003500SE +/- 0.54, N = 3SE +/- 0.38, N = 3SE +/- 2.39, N = 7SE +/- 0.95, N = 61147.262148.863065.762980.151. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

RealSR-NCNN

Scale: 4x - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: YesRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1224364860SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 352.7631.1724.3720.19

ViennaCL

Test: OpenCL BLAS - dGEMM-NN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NNRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 0.88, N = 3SE +/- 1.67, N = 3SE +/- 0.88, N = 3SE +/- 0.00, N = 345958577411501. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

IndigoBench

Acceleration: OpenCL GPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: SupercarRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia20406080100SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 332.6051.7066.0378.45

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: S3D

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: S3DRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia140280420560700SE +/- 0.15, N = 12SE +/- 0.35, N = 12SE +/- 0.38, N = 13SE +/- 0.22, N = 12270.80427.49423.58644.601. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

MandelGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec, More Is BetterMandelGPU 1.3pts1OpenCL Device: GPURTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia200M400M600M800M1000MSE +/- 1540493.49, N = 10SE +/- 959338.71, N = 11SE +/- 1340958.21, N = 12SE +/- 3825360.26, N = 12442866316.9568293355.5772392077.3951815274.21. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Bus Speed Readback

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Bus Speed ReadbackRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia612182430SE +/- 0.00, N = 12SE +/- 0.00, N = 13SE +/- 0.00, N = 14SE +/- 0.00, N = 1313.2026.4026.3926.371. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Triad

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: TriadRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia612182430SE +/- 0.00, N = 12SE +/- 0.00, N = 12SE +/- 0.01, N = 12SE +/- 0.01, N = 1212.6124.5524.7625.071. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

NeatBench

Acceleration: GPU

OpenBenchmarking.orgFPS, More Is BetterNeatBench 5Acceleration: GPURTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia9001800270036004500SE +/- 0.00, N = 13SE +/- 0.00, N = 13SE +/- 0.00, N = 14SE +/- 0.00, N = 142080309040804090

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Bus Speed Download

OpenBenchmarking.orgGB/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: Bus Speed DownloadRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia612182430SE +/- 0.00, N = 12SE +/- 0.02, N = 13SE +/- 0.02, N = 13SE +/- 0.02, N = 1312.8525.1925.1025.131. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

ArrayFire

Test: Conjugate Gradient OpenCL

OpenBenchmarking.orgms, Fewer Is BetterArrayFire 3.7Test: Conjugate Gradient OpenCLRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia0.37780.75561.13341.51121.889SE +/- 0.0055, N = 9SE +/- 0.0020, N = 9SE +/- 0.0013, N = 10SE +/- 0.0014, N = 91.67901.58301.12200.88031. (CXX) g++ options: -rdynamic

VkResample

Upscale: 2x - Precision: Single

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: SingleRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia48121620SE +/- 0.023, N = 5SE +/- 0.008, N = 5SE +/- 0.003, N = 5SE +/- 0.003, N = 514.7909.35911.5437.7991. (CXX) g++ options: -O3

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: FFT SP

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17Target: OpenCL - Benchmark: FFT SPRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia6001200180024003000SE +/- 0.70, N = 11SE +/- 0.59, N = 12SE +/- 2.58, N = 12SE +/- 1.36, N = 121504.872349.391831.862779.481. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -lmpi_cxx -lmpi

RealSR-NCNN

Scale: 4x - TAA: No

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: NoRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia3691215SE +/- 0.025, N = 5SE +/- 0.015, N = 6SE +/- 0.015, N = 7SE +/- 0.018, N = 79.2396.5095.6305.109

VkFFT

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.1.1RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia13K26K39K52K65KSE +/- 163.05, N = 3SE +/- 475.08, N = 9SE +/- 213.00, N = 3SE +/- 72.97, N = 3334044154748201594271. (CXX) g++ options: -O3

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: WriteRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 0.85, N = 8SE +/- 0.49, N = 10SE +/- 0.54, N = 9SE +/- 0.36, N = 10452.2734.3567.7785.81. (CC) gcc options: -O2 -flto -lOpenCL

Waifu2x-NCNN Vulkan

Scale: 2x - Denoise: 3 - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818Scale: 2x - Denoise: 3 - TAA: YesRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia0.96911.93822.90733.87644.8455SE +/- 0.007, N = 8SE +/- 0.005, N = 9SE +/- 0.004, N = 10SE +/- 0.003, N = 104.3073.5362.7612.490

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS, More Is Betterclpeak 1.1.2OpenCL Test: Global Memory BandwidthRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 0.36, N = 9SE +/- 0.01, N = 10SE +/- 0.17, N = 10SE +/- 0.04, N = 10504.66814.92611.67871.561. (CXX) g++ options: -O3

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: ReadRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 0.15, N = 8SE +/- 0.81, N = 9SE +/- 0.71, N = 9SE +/- 0.31, N = 10543.8823.3623.2886.01. (CC) gcc options: -O2 -flto -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMV-N

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-NRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia60120180240300SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32971852242201. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

Caffe

Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 1000

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 1000RTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia14002800420056007000SE +/- 2.76, N = 6SE +/- 3.07, N = 6SE +/- 2.74, N = 76584.815228.004379.701. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 200RTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia30060090012001500SE +/- 1.00, N = 10SE +/- 1.43, N = 10SE +/- 0.87, N = 111321.361053.88883.951. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

ViennaCL

Test: OpenCL BLAS - dAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dAXPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia170340510680850SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 35187166087721. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: yolov4-tinyRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1224364860SE +/- 0.13, N = 3SE +/- 0.40, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 352.4849.1035.8735.23MIN: 20.11 / MAX: 75.46MIN: 17.59 / MAX: 76.07MIN: 11.56 / MAX: 61.96MIN: 11.4 / MAX: 59.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Caffe

Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 100RTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia140280420560700SE +/- 1.37, N = 11SE +/- 1.06, N = 11SE +/- 1.11, N = 11664.60537.49447.341. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 1000

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 1000RTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia5K10K15K20K25KSE +/- 30.41, N = 3SE +/- 18.97, N = 3SE +/- 24.30, N = 324142.816310.516499.31. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 200RTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia10002000300040005000SE +/- 2.81, N = 7SE +/- 3.25, N = 8SE +/- 3.64, N = 84830.593279.173304.151. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 100RTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia5001000150020002500SE +/- 1.69, N = 9SE +/- 2.33, N = 10SE +/- 1.34, N = 102418.861649.291660.011. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

ViennaCL

Test: OpenCL BLAS - sDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sDOTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia100200300400500SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 33053724174461. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - sCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sCOPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia100200300400500SE +/- 1.73, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 33063633854441. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

FAHBench

OpenBenchmarking.orgNs Per Day, More Is BetterFAHBench 2.3.2RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia90180270360450SE +/- 0.79, N = 3SE +/- 0.41, N = 3SE +/- 0.63, N = 3SE +/- 0.24, N = 3292.69316.57424.35423.21

ViennaCL

Test: OpenCL BLAS - sAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sAXPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia120240360480600SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 33924954875681. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dCOPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia140280420560700SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 34756005406611. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dDOTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia160320480640800SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 35246585977191. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia90180270360450SE +/- 0.27, N = 8SE +/- 0.21, N = 10SE +/- 0.03, N = 9SE +/- 0.05, N = 10318.1359.2382.0410.31. (CC) gcc options: -O2 -flto -lOpenCL

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: vision_transformerRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia80160240320400SE +/- 0.57, N = 3SE +/- 0.55, N = 3SE +/- 3.05, N = 3SE +/- 1.34, N = 3363.75324.88290.15289.04MIN: 316.04 / MAX: 471.43MIN: 283.26 / MAX: 423.43MIN: 247.6 / MAX: 837.91MIN: 260.04 / MAX: 661.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

ViennaCL

Test: OpenCL BLAS - dGEMV-T

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-TRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia100200300400500SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 23703714354431. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

LeelaChessZero

Backend: OpenCL

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: OpenCLRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia3K6K9K12K15KSE +/- 135.58, N = 4SE +/- 52.37, N = 3SE +/- 126.87, N = 3SE +/- 198.64, N = 3132281431615316150971. (CXX) g++ options: -flto -pthread

ViennaCL

Test: CPU BLAS - dCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dCOPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 8.86, N = 15SE +/- 7.74, N = 15SE +/- 9.35, N = 12SE +/- 11.59, N = 59238349569461. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dDOTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia150300450600750SE +/- 4.70, N = 15SE +/- 1.68, N = 15SE +/- 8.14, N = 12SE +/- 6.71, N = 56586066786711. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dAXPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 5.45, N = 15SE +/- 6.89, N = 15SE +/- 7.44, N = 12SE +/- 22.23, N = 51058984108510981. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sCOPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia400800120016002000SE +/- 17.80, N = 15SE +/- 12.27, N = 15SE +/- 13.45, N = 12SE +/- 19.65, N = 517551842190118741. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sAXPYRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia5001000150020002500SE +/- 16.08, N = 15SE +/- 18.29, N = 15SE +/- 31.16, N = 12SE +/- 13.04, N = 522612272242223601. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMV-T

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-TRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 6.17, N = 14SE +/- 4.88, N = 15SE +/- 7.65, N = 12SE +/- 2.58, N = 57427497877711. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sDOTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia2004006008001000SE +/- 4.44, N = 15SE +/- 6.38, N = 15SE +/- 5.06, N = 12SE +/- 7.38, N = 57477647837841. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

GPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1632486480Min: 44 / Avg: 69.38 / Max: 83Min: 41 / Avg: 65.62 / Max: 84Min: 31 / Avg: 44.05 / Max: 73Min: 32 / Avg: 43.13 / Max: 66

GPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsGPU Power Consumption MonitorPhoronix Test Suite System MonitoringRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia80160240320400Min: 18.41 / Avg: 148.08 / Max: 347.3Min: 18.42 / Avg: 170.36 / Max: 367.21Min: 4 / Avg: 92.31 / Max: 331.21Min: 6 / Avg: 110.92 / Max: 456.05

Waifu2x-NCNN Vulkan

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.068.275.0RTX 3090 24GB -Zotac47.061.273.0RTX 4080 16GB -Pny40.042.951.0RTX 4090 24GB -Nvidia39.041.646.0OpenBenchmarking.orgCelsius, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818GPU Temperature Monitor20406080100

Waifu2x-NCNN Vulkan

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.8138.6261.5RTX 3090 24GB -Zotac27.5154.7304.3RTX 4080 16GB -Pny14.072.7204.6RTX 4090 24GB -Nvidia7.193.5229.6OpenBenchmarking.orgWatts, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818GPU Power Consumption Monitor80160240320400

RealSR-NCNN

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.069.376.0RTX 3090 24GB -Zotac48.061.777.0RTX 4080 16GB -Pny42.047.658.0RTX 4090 24GB -Nvidia42.045.153.0OpenBenchmarking.orgCelsius, Fewer Is BetterRealSR-NCNN 20200818GPU Temperature Monitor20406080100

RealSR-NCNN

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.3150.8256.7RTX 3090 24GB -Zotac28.7166.5354.3RTX 4080 16GB -Pny14.1102.2294.6RTX 4090 24GB -Nvidia7.1105.0327.6OpenBenchmarking.orgWatts, Fewer Is BetterRealSR-NCNN 20200818GPU Power Consumption Monitor100200300400500

RealSR-NCNN

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell46.074.280.0RTX 3090 24GB -Zotac52.074.984.0RTX 4080 16GB -Pny42.057.364.0RTX 4090 24GB -Nvidia41.051.656.0OpenBenchmarking.orgCelsius, Fewer Is BetterRealSR-NCNN 20200818GPU Temperature Monitor20406080100

RealSR-NCNN

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell20.4225.5257.1RTX 3090 24GB -Zotac33.0292.5356.8RTX 4080 16GB -Pny13.9221.3300.8RTX 4090 24GB -Nvidia6.6234.7332.3OpenBenchmarking.orgWatts, Fewer Is BetterRealSR-NCNN 20200818GPU Power Consumption Monitor100200300400500

NCNN

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell46.049.861.0RTX 3090 24GB -Zotac42.051.664.0RTX 4080 16GB -Pny35.038.243.0RTX 4090 24GB -Nvidia33.037.445.0OpenBenchmarking.orgCelsius, Fewer Is BetterNCNN 20220729GPU Temperature Monitor20406080100

NCNN

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell19.231.7108.8RTX 3090 24GB -Zotac18.836.1148.3RTX 4080 16GB -Pny4.218.566.4RTX 4090 24GB -Nvidia6.413.659.6OpenBenchmarking.orgWatts, Fewer Is BetterNCNN 20220729GPU Power Consumption Monitor4080120160200

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: FastestDetRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia3691215SE +/- 0.10, N = 3SE +/- 3.64, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 36.8013.525.185.08MIN: 5.02 / MAX: 32.78MIN: 5.33 / MAX: 35.07MIN: 4.28 / MAX: 25.38MIN: 4.3 / MAX: 23.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: regnety_400mRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia612182430SE +/- 2.01, N = 3SE +/- 0.25, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 323.1325.045.325.46MIN: 8.74 / MAX: 39.68MIN: 11.25 / MAX: 44.6MIN: 4.68 / MAX: 22.84MIN: 4.78 / MAX: 28.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: resnet50RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia246810SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.77, N = 35.856.355.167.28MIN: 4.75 / MAX: 26.01MIN: 5 / MAX: 21.95MIN: 4.78 / MAX: 21.85MIN: 3.88 / MAX: 30.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: vgg16RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia612182430SE +/- 1.00, N = 3SE +/- 0.11, N = 3SE +/- 3.46, N = 3SE +/- 0.10, N = 37.074.407.9025.14MIN: 4.46 / MAX: 48.35MIN: 3.72 / MAX: 24.39MIN: 3.84 / MAX: 36.49MIN: 12.85 / MAX: 33.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: blazefaceRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1.23532.47063.70594.94126.1765SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 35.495.383.893.95MIN: 3.72 / MAX: 33.58MIN: 4.06 / MAX: 22.14MIN: 3.33 / MAX: 36.65MIN: 3.22 / MAX: 30.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: efficientnet-b0RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia612182430SE +/- 0.20, N = 3SE +/- 0.63, N = 3SE +/- 0.10, N = 3SE +/- 0.36, N = 326.0923.976.306.42MIN: 12.37 / MAX: 40.64MIN: 10.15 / MAX: 37.01MIN: 5.32 / MAX: 26.26MIN: 5.35 / MAX: 28.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: mnasnetRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia510152025SE +/- 0.73, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 27.0319.164.374.39MIN: 4.55 / MAX: 25.62MIN: 7.92 / MAX: 33.04MIN: 3.71 / MAX: 23.07MIN: 3.79 / MAX: 221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: shufflenet-v2RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia48121620SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 36.1117.574.784.85MIN: 4.77 / MAX: 33.2MIN: 8.24 / MAX: 39.36MIN: 4.03 / MAX: 23.06MIN: 4.28 / MAX: 25.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia510152025SE +/- 0.83, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 318.7718.785.024.97MIN: 7.68 / MAX: 35.81MIN: 8.92 / MAX: 34.42MIN: 4.12 / MAX: 23.74MIN: 4.23 / MAX: 23.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2RTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia48121620SE +/- 0.39, N = 3SE +/- 0.28, N = 3SE +/- 0.10, N = 3SE +/- 0.01, N = 36.3518.254.324.42MIN: 4.5 / MAX: 27.11MIN: 7.4 / MAX: 39.06MIN: 3.68 / MAX: 23.77MIN: 3.68 / MAX: 20.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

vkpeak

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell56.077.383.0RTX 3090 24GB -Zotac42.071.379.0RTX 4080 16GB -Pny43.057.366.0RTX 4090 24GB -Nvidia42.053.965.0OpenBenchmarking.orgCelsius, Fewer Is Bettervkpeak 20210424GPU Temperature Monitor20406080100

vkpeak

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.4217.8258.8RTX 3090 24GB -Zotac24.9265.1330.5RTX 4080 16GB -Pny13.6171.1245.8RTX 4090 24GB -Nvidia6.6203.4347.2OpenBenchmarking.orgWatts, Fewer Is Bettervkpeak 20210424GPU Power Consumption Monitor100200300400500

VkResample

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell55.065.473.0RTX 3090 24GB -Zotac47.059.274.0RTX 4080 16GB -Pny38.043.650.0RTX 4090 24GB -Nvidia38.041.647.0OpenBenchmarking.orgCelsius, Fewer Is BetterVkResample 1.0GPU Temperature Monitor20406080100

VkResample

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.1114.5208.0RTX 3090 24GB -Zotac19.1124.7254.8RTX 4080 16GB -Pny4.259.1135.5RTX 4090 24GB -Nvidia6.758.1182.3OpenBenchmarking.orgWatts, Fewer Is BetterVkResample 1.0GPU Power Consumption Monitor70140210280350

VkResample

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell57.059.769.0RTX 3090 24GB -Zotac48.053.573.0RTX 4080 16GB -Pny36.038.146.0RTX 4090 24GB -Nvidia35.037.043.0OpenBenchmarking.orgCelsius, Fewer Is BetterVkResample 1.0GPU Temperature Monitor20406080100

VkResample

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.460.8255.9RTX 3090 24GB -Zotac19.278.0357.0RTX 4080 16GB -Pny4.335.1203.1RTX 4090 24GB -Nvidia6.537.5270.4OpenBenchmarking.orgWatts, Fewer Is BetterVkResample 1.0GPU Power Consumption Monitor100200300400500

VkFFT

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell54.068.677.0RTX 3090 24GB -Zotac47.062.874.0RTX 4080 16GB -Pny37.039.646.0RTX 4090 24GB -Nvidia35.036.943.0OpenBenchmarking.orgCelsius, Fewer Is BetterVkFFT 1.1.1GPU Temperature Monitor20406080100

VkFFT

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.5119.5264.1RTX 3090 24GB -Zotac19.1140.5367.2RTX 4080 16GB -Pny11.253.2215.9RTX 4090 24GB -Nvidia6.961.1277.8OpenBenchmarking.orgWatts, Fewer Is BetterVkFFT 1.1.1GPU Power Consumption Monitor100200300400500

Caffe

GPU Temperature Monitor

MinAvgMaxRTX 3090 24GB -Zotac47.072.878.0RTX 4080 16GB -Pny37.046.150.0RTX 4090 24GB -Nvidia37.042.345.0OpenBenchmarking.orgCelsius, Fewer Is BetterCaffe 2020-02-13GPU Temperature Monitor20406080100

Caffe

GPU Power Consumption Monitor

MinAvgMaxRTX 3090 24GB -Zotac18.5252.8299.7RTX 4080 16GB -Pny13.4121.4156.0RTX 4090 24GB -Nvidia6.9129.1162.7OpenBenchmarking.orgWatts, Fewer Is BetterCaffe 2020-02-13GPU Power Consumption Monitor80160240320400

Caffe

GPU Temperature Monitor

MinAvgMaxRTX 3090 24GB -Zotac47.064.676.0RTX 4080 16GB -Pny37.041.848.0RTX 4090 24GB -Nvidia36.039.343.0OpenBenchmarking.orgCelsius, Fewer Is BetterCaffe 2020-02-13GPU Temperature Monitor20406080100

Caffe

GPU Power Consumption Monitor

MinAvgMaxRTX 3090 24GB -Zotac25.4184.4290.0RTX 4080 16GB -Pny12.678.5154.8RTX 4090 24GB -Nvidia7.087.3162.9OpenBenchmarking.orgWatts, Fewer Is BetterCaffe 2020-02-13GPU Power Consumption Monitor70140210280350

Caffe

GPU Temperature Monitor

MinAvgMaxRTX 3090 24GB -Zotac47.061.374.0RTX 4080 16GB -Pny38.040.847.0RTX 4090 24GB -Nvidia37.038.542.0OpenBenchmarking.orgCelsius, Fewer Is BetterCaffe 2020-02-13GPU Temperature Monitor20406080100

Caffe

GPU Power Consumption Monitor

MinAvgMaxRTX 3090 24GB -Zotac19.3154.8289.3RTX 4080 16GB -Pny13.462.2154.8RTX 4090 24GB -Nvidia7.071.0160.9OpenBenchmarking.orgWatts, Fewer Is BetterCaffe 2020-02-13GPU Power Consumption Monitor70140210280350

Caffe

GPU Temperature Monitor

MinAvgMaxRTX 3090 24GB -Zotac48.068.980.0RTX 4080 16GB -Pny37.043.950.0RTX 4090 24GB -Nvidia36.040.745.0OpenBenchmarking.orgCelsius, Fewer Is BetterCaffe 2020-02-13GPU Temperature Monitor20406080100

Caffe

GPU Power Consumption Monitor

MinAvgMaxRTX 3090 24GB -Zotac19.1224.3341.6RTX 4080 16GB -Pny10.7104.4178.5RTX 4090 24GB -Nvidia7.0114.8203.5OpenBenchmarking.orgWatts, Fewer Is BetterCaffe 2020-02-13GPU Power Consumption Monitor80160240320400

Caffe

GPU Temperature Monitor

MinAvgMaxRTX 3090 24GB -Zotac50.061.477.0RTX 4080 16GB -Pny38.040.348.0RTX 4090 24GB -Nvidia38.039.544.0OpenBenchmarking.orgCelsius, Fewer Is BetterCaffe 2020-02-13GPU Temperature Monitor20406080100

Caffe

GPU Power Consumption Monitor

MinAvgMaxRTX 3090 24GB -Zotac19.3144.4336.9RTX 4080 16GB -Pny13.460.0179.5RTX 4090 24GB -Nvidia6.869.2202.4OpenBenchmarking.orgWatts, Fewer Is BetterCaffe 2020-02-13GPU Power Consumption Monitor80160240320400

Caffe

GPU Temperature Monitor

MinAvgMaxRTX 3090 24GB -Zotac47.060.175.0RTX 4080 16GB -Pny39.042.150.0RTX 4090 24GB -Nvidia40.042.449.0OpenBenchmarking.orgCelsius, Fewer Is BetterCaffe 2020-02-13GPU Temperature Monitor20406080100

Caffe

GPU Power Consumption Monitor

MinAvgMaxRTX 3090 24GB -Zotac18.7125.3335.1RTX 4080 16GB -Pny14.048.0178.0RTX 4090 24GB -Nvidia7.056.9202.9OpenBenchmarking.orgWatts, Fewer Is BetterCaffe 2020-02-13GPU Power Consumption Monitor80160240320400

Blender

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.078.782.0RTX 3090 24GB -Zotac47.075.682.0RTX 4080 16GB -Pny40.051.056.0RTX 4090 24GB -Nvidia40.048.554.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 3.6GPU Temperature Monitor20406080100

Blender

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.8226.2257.6RTX 3090 24GB -Zotac18.6292.2358.2RTX 4080 16GB -Pny13.7161.8215.2RTX 4090 24GB -Nvidia6.8189.4276.9OpenBenchmarking.orgWatts, Fewer Is BetterBlender 3.6GPU Power Consumption Monitor100200300400500

Blender

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.075.880.0RTX 3090 24GB -Zotac47.071.980.0RTX 4080 16GB -Pny39.048.054.0RTX 4090 24GB -Nvidia39.045.350.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 3.6GPU Temperature Monitor20406080100

Blender

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.7212.9257.2RTX 3090 24GB -Zotac20.5264.0361.3RTX 4080 16GB -Pny12.8140.8239.5RTX 4090 24GB -Nvidia6.9172.2302.0OpenBenchmarking.orgWatts, Fewer Is BetterBlender 3.6GPU Power Consumption Monitor100200300400500

Blender

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.074.480.0RTX 3090 24GB -Zotac48.070.782.0RTX 4080 16GB -Pny40.048.257.0RTX 4090 24GB -Nvidia41.045.854.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 3.6GPU Temperature Monitor20406080100

Blender

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.9195.0256.9RTX 3090 24GB -Zotac19.4234.9344.1RTX 4080 16GB -Pny13.4116.8223.6RTX 4090 24GB -Nvidia6.9136.7303.2OpenBenchmarking.orgWatts, Fewer Is BetterBlender 3.6GPU Power Consumption Monitor80160240320400

Blender

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.075.481.0RTX 3090 24GB -Zotac48.073.081.0RTX 4080 16GB -Pny39.048.355.0RTX 4090 24GB -Nvidia40.046.552.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 3.6GPU Temperature Monitor20406080100

Blender

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.5212.6255.0RTX 3090 24GB -Zotac19.2267.4353.6RTX 4080 16GB -Pny5.3142.2230.1RTX 4090 24GB -Nvidia7.1162.1291.8OpenBenchmarking.orgWatts, Fewer Is BetterBlender 3.6GPU Power Consumption Monitor100200300400500

Blender

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.072.678.0RTX 3090 24GB -Zotac46.067.379.0RTX 4080 16GB -Pny41.045.351.0RTX 4090 24GB -Nvidia42.044.850.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 3.6GPU Temperature Monitor20406080100

Blender

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.3173.8254.3RTX 3090 24GB -Zotac19.2215.9349.9RTX 4080 16GB -Pny14.395.0198.6RTX 4090 24GB -Nvidia7.0107.7242.2OpenBenchmarking.orgWatts, Fewer Is BetterBlender 3.6GPU Power Consumption Monitor100200300400500

Blender

Blend File: BMW27 - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: NVIDIA OptiXRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia246810SE +/- 0.06, N = 15SE +/- 0.06, N = 15SE +/- 0.06, N = 15SE +/- 0.06, N = 158.936.134.433.70

Chaos Group V-RAY

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell55.071.782.0RTX 3090 24GB -Zotac47.068.380.0RTX 4080 16GB -Pny39.048.054.0RTX 4090 24GB -Nvidia41.048.654.0OpenBenchmarking.orgCelsius, Fewer Is BetterChaos Group V-RAY 5.02GPU Temperature Monitor20406080100

Chaos Group V-RAY

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.6167.9253.1RTX 3090 24GB -Zotac18.9235.8358.0RTX 4080 16GB -Pny4.5130.0211.7RTX 4090 24GB -Nvidia6.8169.0272.7OpenBenchmarking.orgWatts, Fewer Is BetterChaos Group V-RAY 5.02GPU Power Consumption Monitor100200300400500

Chaos Group V-RAY

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell57.073.582.0RTX 3090 24GB -Zotac48.071.582.0RTX 4080 16GB -Pny42.051.857.0RTX 4090 24GB -Nvidia42.050.857.0OpenBenchmarking.orgCelsius, Fewer Is BetterChaos Group V-RAY 5.02GPU Temperature Monitor20406080100

Chaos Group V-RAY

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.7181.0256.4RTX 3090 24GB -Zotac19.2250.0356.2RTX 4080 16GB -Pny13.4159.5227.6RTX 4090 24GB -Nvidia7.2199.1296.3OpenBenchmarking.orgWatts, Fewer Is BetterChaos Group V-RAY 5.02GPU Power Consumption Monitor100200300400500

IndigoBench

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell61.076.682.0RTX 3090 24GB -Zotac50.077.784.0RTX 4080 16GB -Pny42.054.059.0RTX 4090 24GB -Nvidia41.051.757.0OpenBenchmarking.orgCelsius, Fewer Is BetterIndigoBench 4.4GPU Temperature Monitor20406080100

IndigoBench

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.1213.7254.5RTX 3090 24GB -Zotac20.2287.2353.5RTX 4080 16GB -Pny14.0180.5230.3RTX 4090 24GB -Nvidia6.7211.2296.7OpenBenchmarking.orgWatts, Fewer Is BetterIndigoBench 4.4GPU Power Consumption Monitor100200300400500

IndigoBench

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell57.076.081.0RTX 3090 24GB -Zotac52.077.683.0RTX 4080 16GB -Pny40.051.956.0RTX 4090 24GB -Nvidia42.049.452.0OpenBenchmarking.orgCelsius, Fewer Is BetterIndigoBench 4.4GPU Temperature Monitor20406080100

IndigoBench

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.3211.7259.5RTX 3090 24GB -Zotac20.9282.9356.8RTX 4080 16GB -Pny13.0159.4207.9RTX 4090 24GB -Nvidia6.7172.9252.7OpenBenchmarking.orgWatts, Fewer Is BetterIndigoBench 4.4GPU Power Consumption Monitor100200300400500

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell56.058.060.0RTX 3090 24GB -Zotac52.058.162.0RTX 4080 16GB -Pny38.039.541.0RTX 4090 24GB -Nvidia40.041.543.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.356.580.7RTX 3090 24GB -Zotac19.885.0125.6RTX 4080 16GB -Pny12.230.647.0RTX 4090 24GB -Nvidia6.639.858.8OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor4080120160200

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell57.059.462.0RTX 3090 24GB -Zotac52.056.260.0RTX 4080 16GB -Pny35.037.038.0RTX 4090 24GB -Nvidia38.039.240.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.053.476.5RTX 3090 24GB -Zotac19.872.1117.2RTX 4080 16GB -Pny12.128.540.3RTX 4090 24GB -Nvidia6.533.855.0OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor4080120160200

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell57.062.968.0RTX 3090 24GB -Zotac52.062.972.0RTX 4080 16GB -Pny36.036.739.0RTX 4090 24GB -Nvidia34.036.440.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.793.4198.2RTX 3090 24GB -Zotac20.0125.2273.7RTX 4080 16GB -Pny13.339.398.6RTX 4090 24GB -Nvidia6.441.6108.0OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor70140210280350

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.062.468.0RTX 3090 24GB -Zotac50.060.273.0RTX 4080 16GB -Pny36.038.655.0RTX 4090 24GB -Nvidia35.035.637.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.184.4261.2RTX 3090 24GB -Zotac19.5105.9323.3RTX 4080 16GB -Pny12.844.7278.8RTX 4090 24GB -Nvidia7.041.7150.7OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor80160240320400

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell56.064.471.0RTX 3090 24GB -Zotac53.063.874.0RTX 4080 16GB -Pny36.038.546.0RTX 4090 24GB -Nvidia36.037.142.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.3107.8225.4RTX 3090 24GB -Zotac25.8138.9317.8RTX 4080 16GB -Pny11.951.2195.6RTX 4090 24GB -Nvidia7.059.0207.2OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor80160240320400

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell58.060.764.0RTX 3090 24GB -Zotac49.058.065.0RTX 4080 16GB -Pny37.038.140.0RTX 4090 24GB -Nvidia37.038.039.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.273.4184.7RTX 3090 24GB -Zotac24.998.4223.7RTX 4080 16GB -Pny12.238.772.2RTX 4090 24GB -Nvidia7.045.5106.3OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor60120180240300

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.074.078.0RTX 3090 24GB -Zotac50.072.279.0RTX 4080 16GB -Pny37.043.149.0RTX 4090 24GB -Nvidia37.041.847.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.2184.6246.0RTX 3090 24GB -Zotac22.8253.9357.5RTX 4080 16GB -Pny13.598.3224.9RTX 4090 24GB -Nvidia7.0125.0250.8OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor100200300400500

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature MonitorRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1632486480Min: 55 / Avg: 73.85 / Max: 82Min: 52 / Avg: 70.48 / Max: 82Min: 38 / Avg: 43.44 / Max: 73Min: 39 / Avg: 43.63 / Max: 66

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption MonitorRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia80160240320400Min: 21.69 / Avg: 175.84 / Max: 257.38Min: 20.35 / Avg: 201.61 / Max: 329.19Min: 13.84 / Avg: 90.17 / Max: 331.21Min: 6.77 / Avg: 116.7 / Max: 447.83

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell51.055.159.0RTX 3090 24GB -Zotac52.058.865.0RTX 4080 16GB -Pny41.042.745.0RTX 4090 24GB -Nvidia37.039.141.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell20.666.6107.8RTX 3090 24GB -Zotac19.786.6154.5RTX 4080 16GB -Pny13.938.262.5RTX 4090 24GB -Nvidia6.643.872.7OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor4080120160200

SHOC Scalable HeterOgeneous Computing

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell44.049.754.0RTX 3090 24GB -Zotac55.061.168.0RTX 4080 16GB -Pny38.040.142.0RTX 4090 24GB -Nvidia34.036.138.0OpenBenchmarking.orgCelsius, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Temperature Monitor20406080100

SHOC Scalable HeterOgeneous Computing

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell20.163.6102.9RTX 3090 24GB -Zotac20.393.5158.5RTX 4080 16GB -Pny13.737.060.9RTX 4090 24GB -Nvidia6.443.472.8OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2020-04-17GPU Power Consumption Monitor50100150200250

ViennaCL

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell44.049.258.0RTX 3090 24GB -Zotac48.053.357.0RTX 4080 16GB -Pny34.035.738.0RTX 4090 24GB -Nvidia32.033.937.0OpenBenchmarking.orgCelsius, Fewer Is BetterViennaCL 1.7.1GPU Temperature Monitor1632486480

ViennaCL

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell18.421.643.4RTX 3090 24GB -Zotac19.026.237.2RTX 4080 16GB -Pny4.012.118.8RTX 4090 24GB -Nvidia6.08.015.8OpenBenchmarking.orgWatts, Fewer Is BetterViennaCL 1.7.1GPU Power Consumption Monitor1224364860

ViennaCL

Test: CPU BLAS - dGEMM-TT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia306090120150SE +/- 4.93, N = 15SE +/- 5.83, N = 15SE +/- 6.46, N = 11SE +/- 9.73, N = 51451431371441. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-TN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TNRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia306090120150SE +/- 4.47, N = 15SE +/- 5.51, N = 15SE +/- 4.72, N = 12SE +/- 9.50, N = 51421411351371. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-NT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NTRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia306090120150SE +/- 2.19, N = 15SE +/- 4.37, N = 15SE +/- 4.18, N = 12SE +/- 0.48, N = 41191201221151. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-NN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NNRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia306090120150SE +/- 1.59, N = 15SE +/- 1.05, N = 15SE +/- 1.29, N = 12SE +/- 10.59, N = 5106.8107.0103.5120.01. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMV-N

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-NRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia4080120160200SE +/- 1.84, N = 15SE +/- 8.48, N = 15SE +/- 0.91, N = 12SE +/- 1.74, N = 51791721871881. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.072.278.0RTX 3090 24GB -Zotac49.070.883.0RTX 4080 16GB -Pny37.044.054.0RTX 4090 24GB -Nvidia36.041.548.0OpenBenchmarking.orgCelsius, Fewer Is BetterViennaCL 1.7.1GPU Temperature Monitor20406080100

ViennaCL

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.4173.6255.0RTX 3090 24GB -Zotac28.9232.9357.9RTX 4080 16GB -Pny13.4109.2223.4RTX 4090 24GB -Nvidia6.9128.0256.4OpenBenchmarking.orgWatts, Fewer Is BetterViennaCL 1.7.1GPU Power Consumption Monitor100200300400500

MandelGPU

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.067.674.0RTX 3090 24GB -Zotac50.062.979.0RTX 4080 16GB -Pny37.040.952.0RTX 4090 24GB -Nvidia36.038.846.0OpenBenchmarking.orgCelsius, Fewer Is BetterMandelGPU 1.3pts1GPU Temperature Monitor20406080100

MandelGPU

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.6126.4254.8RTX 3090 24GB -Zotac19.7149.1321.4RTX 4080 16GB -Pny14.265.5184.4RTX 4090 24GB -Nvidia6.968.6215.0OpenBenchmarking.orgWatts, Fewer Is BetterMandelGPU 1.3pts1GPU Power Consumption Monitor80160240320400

cl-mem

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.067.673.0RTX 3090 24GB -Zotac50.064.474.0RTX 4080 16GB -Pny37.040.343.0RTX 4090 24GB -Nvidia35.038.040.0OpenBenchmarking.orgCelsius, Fewer Is Bettercl-mem 2017-01-13GPU Temperature Monitor20406080100

cl-mem

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.0127.1210.3RTX 3090 24GB -Zotac19.4168.8328.7RTX 4080 16GB -Pny10.780.4155.4RTX 4090 24GB -Nvidia6.890.7205.9OpenBenchmarking.orgWatts, Fewer Is Bettercl-mem 2017-01-13GPU Power Consumption Monitor80160240320400

cl-mem

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.067.773.0RTX 3090 24GB -Zotac49.064.574.0RTX 4080 16GB -Pny38.040.743.0RTX 4090 24GB -Nvidia36.037.940.0OpenBenchmarking.orgCelsius, Fewer Is Bettercl-mem 2017-01-13GPU Temperature Monitor20406080100

cl-mem

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.2126.9212.8RTX 3090 24GB -Zotac19.7171.2327.8RTX 4080 16GB -Pny12.877.9155.5RTX 4090 24GB -Nvidia6.887.4204.4OpenBenchmarking.orgWatts, Fewer Is Bettercl-mem 2017-01-13GPU Power Consumption Monitor80160240320400

cl-mem

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.067.873.0RTX 3090 24GB -Zotac48.063.973.0RTX 4080 16GB -Pny39.041.644.0RTX 4090 24GB -Nvidia38.039.642.0OpenBenchmarking.orgCelsius, Fewer Is Bettercl-mem 2017-01-13GPU Temperature Monitor20406080100

cl-mem

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.9130.3212.4RTX 3090 24GB -Zotac19.8166.2329.4RTX 4080 16GB -Pny12.978.5155.7RTX 4090 24GB -Nvidia6.892.1205.2OpenBenchmarking.orgWatts, Fewer Is Bettercl-mem 2017-01-13GPU Power Consumption Monitor80160240320400

LeelaChessZero

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28GPU Temperature MonitorRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1632486480Min: 55 / Avg: 79.42 / Max: 82Min: 53 / Avg: 75.37 / Max: 83Min: 38 / Avg: 46.95 / Max: 50Min: 36 / Avg: 43.56 / Max: 46

LeelaChessZero

GPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28GPU Power Consumption MonitorRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia60120180240300Min: 21.91 / Avg: 229.31 / Max: 264.57Min: 28.54 / Avg: 263.63 / Max: 349.64Min: 13.99 / Avg: 117.32 / Max: 160.59Min: 6.5 / Avg: 122.59 / Max: 165.25

FinanceBench

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell55.056.858.0RTX 3090 24GB -Zotac52.055.860.0RTX 4080 16GB -Pny35.036.438.0RTX 4090 24GB -Nvidia33.034.736.0OpenBenchmarking.orgCelsius, Fewer Is BetterFinanceBench 2016-07-25GPU Temperature Monitor1632486480

FinanceBench

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.345.473.1RTX 3090 24GB -Zotac19.566.6119.2RTX 4080 16GB -Pny13.026.639.8RTX 4090 24GB -Nvidia6.429.351.3OpenBenchmarking.orgWatts, Fewer Is BetterFinanceBench 2016-07-25GPU Power Consumption Monitor4080120160200

NeatBench

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell56.058.361.0RTX 3090 24GB -Zotac50.057.363.0RTX 4080 16GB -Pny34.034.937.0RTX 4090 24GB -Nvidia33.034.436.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeatBench 5GPU Temperature Monitor20406080100

NeatBench

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.168.0119.6RTX 3090 24GB -Zotac23.685.4168.2RTX 4080 16GB -Pny4.627.989.5RTX 4090 24GB -Nvidia6.936.373.8OpenBenchmarking.orgWatts, Fewer Is BetterNeatBench 5GPU Power Consumption Monitor50100150200250

clpeak

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.062.568.0RTX 3090 24GB -Zotac50.061.672.0RTX 4080 16GB -Pny35.038.556.0RTX 4090 24GB -Nvidia36.038.555.0OpenBenchmarking.orgCelsius, Fewer Is Betterclpeak 1.1.2GPU Temperature Monitor20406080100

clpeak

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.390.1254.1RTX 3090 24GB -Zotac23.7127.5323.8RTX 4080 16GB -Pny14.858.3297.3RTX 4090 24GB -Nvidia7.183.9421.2OpenBenchmarking.orgWatts, Fewer Is Betterclpeak 1.1.2GPU Power Consumption Monitor110220330440550

clpeak

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.070.075.0RTX 3090 24GB -Zotac52.067.173.0RTX 4080 16GB -Pny35.039.241.0RTX 4090 24GB -Nvidia36.039.541.0OpenBenchmarking.orgCelsius, Fewer Is Betterclpeak 1.1.2GPU Temperature Monitor20406080100

clpeak

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.4145.6183.3RTX 3090 24GB -Zotac20.3170.7209.4RTX 4080 16GB -Pny12.870.593.0RTX 4090 24GB -Nvidia7.090.3122.6OpenBenchmarking.orgWatts, Fewer Is Betterclpeak 1.1.2GPU Power Consumption Monitor60120180240300

clpeak

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.065.973.0RTX 3090 24GB -Zotac50.061.173.0RTX 4080 16GB -Pny36.038.052.0RTX 4090 24GB -Nvidia36.038.852.0OpenBenchmarking.orgCelsius, Fewer Is Betterclpeak 1.1.2GPU Temperature Monitor20406080100

clpeak

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.8109.9254.5RTX 3090 24GB -Zotac22.4114.3268.7RTX 4080 16GB -Pny14.356.1255.4RTX 4090 24GB -Nvidia6.970.4356.0OpenBenchmarking.orgWatts, Fewer Is Betterclpeak 1.1.2GPU Power Consumption Monitor100200300400500

clpeak

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.066.474.0RTX 3090 24GB -Zotac50.062.075.0RTX 4080 16GB -Pny36.038.443.0RTX 4090 24GB -Nvidia35.037.440.0OpenBenchmarking.orgCelsius, Fewer Is Betterclpeak 1.1.2GPU Temperature Monitor20406080100

clpeak

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.0120.7246.3RTX 3090 24GB -Zotac20.3147.9355.6RTX 4080 16GB -Pny14.668.3177.2RTX 4090 24GB -Nvidia6.879.8231.0OpenBenchmarking.orgWatts, Fewer Is Betterclpeak 1.1.2GPU Power Consumption Monitor100200300400500

ArrayFire

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.064.471.0RTX 3090 24GB -Zotac49.061.972.0RTX 4080 16GB -Pny37.039.442.0RTX 4090 24GB -Nvidia36.038.541.0OpenBenchmarking.orgCelsius, Fewer Is BetterArrayFire 3.7GPU Temperature Monitor20406080100

ArrayFire

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.4103.9212.7RTX 3090 24GB -Zotac24.2149.2279.0RTX 4080 16GB -Pny14.758.6132.1RTX 4090 24GB -Nvidia6.747.6113.6OpenBenchmarking.orgWatts, Fewer Is BetterArrayFire 3.7GPU Power Consumption Monitor70140210280350

Rodinia

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell62.069.274.0RTX 3090 24GB -Zotac52.064.977.0RTX 4080 16GB -Pny39.043.849.0RTX 4090 24GB -Nvidia41.044.650.0OpenBenchmarking.orgCelsius, Fewer Is BetterRodinia 3.1GPU Temperature Monitor20406080100

Rodinia

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.3133.0219.9RTX 3090 24GB -Zotac19.9148.1254.9RTX 4080 16GB -Pny14.563.1123.6RTX 4090 24GB -Nvidia6.867.5167.3OpenBenchmarking.orgWatts, Fewer Is BetterRodinia 3.1GPU Power Consumption Monitor70140210280350

Rodinia

Test: OpenCL Particle Filter

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenCL Particle FilterRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia1.01862.03723.05584.07445.093SE +/- 0.031, N = 8SE +/- 0.029, N = 10SE +/- 0.005, N = 10SE +/- 0.080, N = 34.5273.7682.6852.0851. (CXX) g++ options: -m64 -lm -lcuda -lcudart -lcudadevrt -lcudart_static -lrt -lpthread -ldl

OctaneBench

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell58.080.083.0RTX 3090 24GB -Zotac50.079.382.0RTX 4080 16GB -Pny35.054.759.0RTX 4090 24GB -Nvidia35.055.060.0OpenBenchmarking.orgCelsius, Fewer Is BetterOctaneBench 2020.1GPU Temperature Monitor20406080100

OctaneBench

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.6242.0259.3RTX 3090 24GB -Zotac28.6337.3362.8RTX 4080 16GB -Pny12.7220.4259.6RTX 4090 24GB -Nvidia6.8279.5322.5OpenBenchmarking.orgWatts, Fewer Is BetterOctaneBench 2020.1GPU Power Consumption Monitor100200300400500

NAMD CUDA

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell60.067.374.0RTX 3090 24GB -Zotac47.054.378.0RTX 4080 16GB -Pny36.039.552.0RTX 4090 24GB -Nvidia34.037.344.0OpenBenchmarking.orgCelsius, Fewer Is BetterNAMD CUDA 2.14GPU Temperature Monitor20406080100

NAMD CUDA

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell23.6127.2297.8RTX 3090 24GB -Zotac19.068.9327.9RTX 4080 16GB -Pny13.469.1263.4RTX 4090 24GB -Nvidia6.454.4281.7OpenBenchmarking.orgWatts, Fewer Is BetterNAMD CUDA 2.14GPU Power Consumption Monitor80160240320400

NAMD CUDA

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD CUDA 2.14ATPase Simulation - 327,506 AtomsRTX 2080 Ti 22GB -DellRTX 3090 24GB -ZotacRTX 4080 16GB -PnyRTX 4090 24GB -Nvidia0.02140.04280.06420.08560.107SE +/- 0.00074, N = 15SE +/- 0.00094, N = 3SE +/- 0.00113, N = 15SE +/- 0.00119, N = 150.095150.067420.054270.04850

GROMACS

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.073.680.0RTX 3090 24GB -Zotac48.071.182.0RTX 4080 16GB -Pny35.048.962.0RTX 4090 24GB -Nvidia36.045.657.0OpenBenchmarking.orgCelsius, Fewer Is BetterGROMACS 2023GPU Temperature Monitor20406080100

GROMACS

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.7194.8276.3RTX 3090 24GB -Zotac28.0243.2365.1RTX 4080 16GB -Pny12.5176.8317.1RTX 4090 24GB -Nvidia6.7182.8404.4OpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2023GPU Power Consumption Monitor110220330440550

FAHBench

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell55.069.581.0RTX 3090 24GB -Zotac46.066.880.0RTX 4080 16GB -Pny33.039.746.0RTX 4090 24GB -Nvidia35.040.044.0OpenBenchmarking.orgCelsius, Fewer Is BetterFAHBench 2.3.2GPU Temperature Monitor20406080100

FAHBench

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.7160.0255.5RTX 3090 24GB -Zotac19.0192.6299.0RTX 4080 16GB -Pny10.488.1141.6RTX 4090 24GB -Nvidia6.596.4148.8OpenBenchmarking.orgWatts, Fewer Is BetterFAHBench 2.3.2GPU Power Consumption Monitor80160240320400

Hashcat

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.065.373.0RTX 3090 24GB -Zotac47.060.777.0RTX 4080 16GB -Pny35.042.863.0RTX 4090 24GB -Nvidia39.044.862.0OpenBenchmarking.orgCelsius, Fewer Is BetterHashcat 6.2.4GPU Temperature Monitor20406080100

Hashcat

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.8115.4347.3RTX 3090 24GB -Zotac19.1138.5326.4RTX 4080 16GB -Pny12.494.7308.4RTX 4090 24GB -Nvidia6.6136.8444.0OpenBenchmarking.orgWatts, Fewer Is BetterHashcat 6.2.4GPU Power Consumption Monitor120240360480600

Hashcat

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell59.065.673.0RTX 3090 24GB -Zotac45.060.476.0RTX 4080 16GB -Pny36.043.063.0RTX 4090 24GB -Nvidia41.046.662.0OpenBenchmarking.orgCelsius, Fewer Is BetterHashcat 6.2.4GPU Temperature Monitor20406080100

Hashcat

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.9121.2333.4RTX 3090 24GB -Zotac19.1155.4349.1RTX 4080 16GB -Pny13.2101.3323.7RTX 4090 24GB -Nvidia6.8144.6456.1OpenBenchmarking.orgWatts, Fewer Is BetterHashcat 6.2.4GPU Power Consumption Monitor120240360480600

Hashcat

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell58.069.276.0RTX 3090 24GB -Zotac45.065.278.0RTX 4080 16GB -Pny35.048.964.0RTX 4090 24GB -Nvidia41.052.565.0OpenBenchmarking.orgCelsius, Fewer Is BetterHashcat 6.2.4GPU Temperature Monitor20406080100

Hashcat

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.3156.5321.2RTX 3090 24GB -Zotac20.5192.6326.5RTX 4080 16GB -Pny12.9157.1290.4RTX 4090 24GB -Nvidia6.8231.7417.6OpenBenchmarking.orgWatts, Fewer Is BetterHashcat 6.2.4GPU Power Consumption Monitor110220330440550

Hashcat

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell58.068.876.0RTX 3090 24GB -Zotac46.065.478.0RTX 4080 16GB -Pny34.047.562.0RTX 4090 24GB -Nvidia40.050.864.0OpenBenchmarking.orgCelsius, Fewer Is BetterHashcat 6.2.4GPU Temperature Monitor20406080100

Hashcat

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell22.5154.3261.7RTX 3090 24GB -Zotac19.1192.7330.0RTX 4080 16GB -Pny12.7148.9281.6RTX 4090 24GB -Nvidia6.7190.1401.1OpenBenchmarking.orgWatts, Fewer Is BetterHashcat 6.2.4GPU Power Consumption Monitor110220330440550

Hashcat

GPU Temperature Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell50.065.074.0RTX 3090 24GB -Zotac50.067.582.0RTX 4080 16GB -Pny31.045.763.0RTX 4090 24GB -Nvidia36.049.165.0OpenBenchmarking.orgCelsius, Fewer Is BetterHashcat 6.2.4GPU Temperature Monitor20406080100

Hashcat

GPU Power Consumption Monitor

MinAvgMaxRTX 2080 Ti 22GB -Dell21.1147.0255.1RTX 3090 24GB -Zotac20.4191.9326.0RTX 4080 16GB -Pny6.8142.4304.5RTX 4090 24GB -Nvidia6.7197.8444.1OpenBenchmarking.orgWatts, Fewer Is BetterHashcat 6.2.4GPU Power Consumption Monitor120240360480600

Phoronix Test Suite v10.8.4