RTX 30 Compute September AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3090 24GB on Ubuntu 21.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2109061-TJ-RTX30COMP69&sro&grr .
RTX 30 Compute September Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution RTX 3070 RTX 3090 GeForce RTX 3090 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 1000GB Western Digital WD_BLACK SN850 1TB + 2000GB NVIDIA GeForce RTX 3070 8GB NVIDIA GA104 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 21.10 5.13.0-14-generic (x86_64) GNOME Shell 40.2 X Server 1.20.11 NVIDIA 470.63.01 4.6.0 OpenCL 3.0 CUDA 11.4.112 1.2.175 GCC 11.2.0 ext4 3840x2160 NVIDIA GeForce RTX 3090 24GB NVIDIA GA102 HD Audio OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 OpenCL Details - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - GeForce RTX 3090: GPU Compute Cores: 10496 Python Details - Python 3.9.6 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
RTX 30 Compute September shoc: OpenCL - Max SP Flops blender: Barbershop - CUDA lczero: OpenCL vkfft: octanebench: Total Score redshift: vkpeak: fp64-vec4 vkpeak: int16-vec4 vkpeak: int16-scalar vkpeak: int32-vec4 vkpeak: int32-scalar vkpeak: fp64-scalar vkpeak: fp16-vec4 vkpeak: fp16-scalar vkpeak: fp32-vec4 vkpeak: fp32-scalar fahbench: blender: Classroom - CUDA luxcorerender: Orange Juice - GPU luxcorerender: Danish Mood - GPU luxcorerender: LuxCore Benchmark - GPU indigobench: OpenCL GPU - Bedroom luxcorerender: DLSC - GPU indigobench: OpenCL GPU - Supercar blender: Fishy Cat - CUDA ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 blender: Classroom - NVIDIA OptiX ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - mobilenet vkresample: 2x - Double realsr-ncnn: 4x - Yes blender: Fishy Cat - NVIDIA OptiX blender: BMW27 - CUDA viennacl: CPU BLAS - dGEMM-TT viennacl: CPU BLAS - dGEMM-TN viennacl: CPU BLAS - dGEMM-NT viennacl: CPU BLAS - dGEMM-NN viennacl: CPU BLAS - dGEMV-T viennacl: CPU BLAS - dGEMV-N viennacl: CPU BLAS - dDOT viennacl: CPU BLAS - dAXPY viennacl: CPU BLAS - dCOPY viennacl: CPU BLAS - sDOT viennacl: CPU BLAS - sAXPY viennacl: CPU BLAS - sCOPY viennacl: OpenCL BLAS - dGEMM-TN viennacl: OpenCL BLAS - dGEMM-NT viennacl: OpenCL BLAS - dGEMM-NN viennacl: OpenCL BLAS - dGEMV-T viennacl: OpenCL BLAS - dGEMV-N viennacl: OpenCL BLAS - dDOT viennacl: OpenCL BLAS - dAXPY viennacl: OpenCL BLAS - dCOPY viennacl: OpenCL BLAS - sDOT viennacl: OpenCL BLAS - sAXPY viennacl: OpenCL BLAS - sCOPY shoc: OpenCL - Texture Read Bandwidth blender: BMW27 - NVIDIA OptiX namd-cuda: ATPase Simulation - 327,506 Atoms vkresample: 2x - Single viennacl: OpenCL BLAS - dGEMM-TT luxcorerender: Rainbow Colors and Prism - GPU realsr-ncnn: 4x - No rodinia: OpenCL Particle Filter hashcat: SHA-512 hashcat: SHA1 hashcat: MD5 cl-mem: Copy cl-mem: Write cl-mem: Read hashcat: TrueCrypt RIPEMD160 + XTS waifu2x-ncnn: 2x - 3 - Yes arrayfire: Conjugate Gradient OpenCL shoc: OpenCL - Bus Speed Readback hashcat: 7-Zip shoc: OpenCL - GEMM SGEMM_N shoc: OpenCL - Triad shoc: OpenCL - Reduction shoc: OpenCL - FFT SP shoc: OpenCL - Bus Speed Download shoc: OpenCL - S3D financebench: Black-Scholes OpenCL shoc: OpenCL - MD5 Hash mixbench: OpenCL - Integer RTX 3070 RTX 3090 GeForce RTX 3090 23102.9 507.39 37790 31554 415.199251 226 364.29 10106.83 7644.32 11521.48 11571.35 363.75 22503.16 11590.48 15319.31 11589.59 265.5078 76.06 6.99 5.06 6.22 12.941 6.68 37.318 54.69 4.43 1.71 1.91 45.77 4.13 2.42 6.57 3.74 1.90 1.68 5.43 0.98 3.17 2.01 2.14 4.31 216.406 46.790 33.34 29.00 56.4 58.2 53.6 53.1 89.8 82.8 48.6 36.5 24.6 151 100.8 66.9 337 342 341 333 222 395 396 370 322 359 291 2130.04 15.82 0.12555 17.529 21.27 7.856 5.920 1673633333 13194833333 38925166667 296.8 382.0 393.3 503167 4.112 2.089 27.1135 689667 3732.87 24.6671 326.570 1134.82 26.2837 219.195 10.457 25.4087 40344.1 373.32 53653 43295 683.595999 139 655.31 16889.26 13646.56 20743.8 20836.32 655.42 40868.96 20954 27597.6 21074.89 344.0195 51.18 10.42 8.64 10.92 20.968 11.53 53.364 34.65 4.37 1.77 1.98 28.66 4.38 2.57 7.66 3.74 1.88 1.81 4.44 0.96 3.35 2.09 2.21 4.48 119.824 28.415 18.97 18.32 54 56.1 52 52.4 83.8 77.6 43.2 34.8 22.6 136 89.6 63 598 602 600 376 236 663 721 607 351 501 364 2228.01 9.52 0.13155 9.254 601 32.09 5.566 3.68 2884600000 22853700000 66739300000 364.3 745 826.6 857500 3.276 1.48 27.0785 1154600 8174.54 25.5289 391.211 2349.19 26.2571 427.935 6.357 44.4267 44567 651.2 16887.92 13655.97 20597.19 20687.55 651.31 40423.41 20714.14 27390.08 20871.36 28.421 5.595 2881300000 22798500000 66589100000 859400 3.275 1161100 8105.73 25.4496 391.091 2348.03 427.078 44.1942 OpenBenchmarking.org
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Max SP Flops OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Max SP Flops RTX 3070 RTX 3090 9K 18K 27K 36K 45K SE +/- 59.20, N = 3 23102.9 40344.1 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
Blender Blend File: Barbershop - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Barbershop - Compute: CUDA RTX 3070 RTX 3090 110 220 330 440 550 SE +/- 0.17, N = 3 507.39 373.32
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3070 RTX 3090 11K 22K 33K 44K 55K SE +/- 178.94, N = 3 37790 53653 1. (CXX) g++ options: -flto -pthread
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 GeForce RTX 3090 RTX 3070 RTX 3090 10K 20K 30K 40K 50K SE +/- 172.10, N = 3 44567 31554 43295 1. (CXX) g++ options: -O3 -pthread
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score RTX 3070 RTX 3090 150 300 450 600 750 415.20 683.60
RedShift Demo OpenBenchmarking.org Seconds, Fewer Is Better RedShift Demo 3.0 RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.33, N = 3 226 139
vkpeak fp64-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 140 280 420 560 700 SE +/- 0.42, N = 3 651.20 364.29 655.31
vkpeak int16-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 20.90, N = 3 16887.92 10106.83 16889.26
vkpeak int16-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-scalar GeForce RTX 3090 RTX 3070 RTX 3090 3K 6K 9K 12K 15K SE +/- 11.41, N = 3 13655.97 7644.32 13646.56
vkpeak int32-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 18.17, N = 3 20597.19 11521.48 20743.80
vkpeak int32-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-scalar GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 16.33, N = 3 20687.55 11571.35 20836.32
vkpeak fp64-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-scalar GeForce RTX 3090 RTX 3070 RTX 3090 140 280 420 560 700 SE +/- 0.36, N = 3 651.31 363.75 655.42
vkpeak fp16-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 9K 18K 27K 36K 45K SE +/- 71.70, N = 3 40423.41 22503.16 40868.96
vkpeak fp16-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-scalar GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 26.04, N = 3 20714.14 11590.48 20954.00
vkpeak fp32-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 6K 12K 18K 24K 30K SE +/- 35.81, N = 3 27390.08 15319.31 27597.60
vkpeak fp32-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-scalar GeForce RTX 3090 RTX 3070 RTX 3090 5K 10K 15K 20K 25K SE +/- 35.78, N = 3 20871.36 11589.59 21074.89
FAHBench OpenBenchmarking.org Ns Per Day, More Is Better FAHBench 2.3.2 RTX 3070 RTX 3090 70 140 210 280 350 SE +/- 0.05, N = 3 265.51 344.02
Blender Blend File: Classroom - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: CUDA RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.01, N = 3 76.06 51.18
LuxCoreRender Scene: Orange Juice - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Orange Juice - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.01, N = 3 6.99 10.42 MIN: 5.61 / MAX: 8.46 MIN: 8.45 / MAX: 13.57
LuxCoreRender Scene: Danish Mood - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Danish Mood - Acceleration: GPU RTX 3070 RTX 3090 2 4 6 8 10 SE +/- 0.00, N = 3 5.06 8.64 MIN: 1.5 / MAX: 6.12 MIN: 2.95 / MAX: 10.48
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: LuxCore Benchmark - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.01, N = 3 6.22 10.92 MIN: 2.05 / MAX: 7.38 MIN: 3.29 / MAX: 13.01
IndigoBench Acceleration: OpenCL GPU - Scene: Bedroom OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Bedroom RTX 3070 RTX 3090 5 10 15 20 25 SE +/- 0.02, N = 3 12.94 20.97
LuxCoreRender Scene: DLSC - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: DLSC - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.00, N = 3 6.68 11.53 MIN: 6.25 / MAX: 6.94 MIN: 11.29 / MAX: 11.68
IndigoBench Acceleration: OpenCL GPU - Scene: Supercar OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.04, N = 3 37.32 53.36
Blender Blend File: Fishy Cat - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: CUDA RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.04, N = 3 54.69 34.65
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3070 RTX 3090 0.9968 1.9936 2.9904 3.9872 4.984 SE +/- 0.13, N = 3 4.43 4.37 MIN: 4.1 / MAX: 7.62 MIN: 3.93 / MAX: 23.52 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 3070 RTX 3090 0.3983 0.7966 1.1949 1.5932 1.9915 SE +/- 0.01, N = 3 1.71 1.77 MIN: 1.68 / MAX: 3.55 MIN: 1.67 / MAX: 9.47 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 3070 RTX 3090 0.4455 0.891 1.3365 1.782 2.2275 SE +/- 0.01, N = 3 1.91 1.98 MIN: 1.88 / MAX: 3.42 MIN: 1.84 / MAX: 7.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX RTX 3070 RTX 3090 10 20 30 40 50 SE +/- 0.02, N = 3 45.77 28.66
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 3070 RTX 3090 0.9923 1.9846 2.9769 3.9692 4.9615 SE +/- 0.13, N = 2 4.13 4.38 MIN: 3.77 / MAX: 13.51 MIN: 3.61 / MAX: 17.92 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 3070 RTX 3090 0.5783 1.1566 1.7349 2.3132 2.8915 SE +/- 0.01, N = 3 2.42 2.52 MIN: 2.4 / MAX: 3.84 MIN: 2.38 / MAX: 10.9 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3070 RTX 3090 2 4 6 8 10 SE +/- 0.01, N = 3 6.57 7.20 MIN: 6.33 / MAX: 6.98 MIN: 6.44 / MAX: 31.2 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3070 RTX 3090 0.8415 1.683 2.5245 3.366 4.2075 SE +/- 0.01, N = 3 3.74 3.68 MIN: 3.71 / MAX: 4.06 MIN: 3.44 / MAX: 13.64 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3070 RTX 3090 0.4388 0.8776 1.3164 1.7552 2.194 SE +/- 0.01, N = 3 1.90 1.88 MIN: 1.86 / MAX: 5.12 MIN: 1.77 / MAX: 6.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 RTX 3070 RTX 3090 0.4073 0.8146 1.2219 1.6292 2.0365 SE +/- 0.01, N = 3 1.68 1.66 MIN: 1.66 / MAX: 1.97 MIN: 1.53 / MAX: 9.86 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3070 RTX 3090 1.2218 2.4436 3.6654 4.8872 6.109 SE +/- 0.01, N = 3 5.43 4.35 MIN: 5.38 / MAX: 9.58 MIN: 4.02 / MAX: 18.18 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface RTX 3070 RTX 3090 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.00, N = 3 0.98 0.96 MIN: 0.95 / MAX: 2.27 MIN: 0.88 / MAX: 8.42 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 3070 RTX 3090 0.7538 1.5076 2.2614 3.0152 3.769 SE +/- 0.01, N = 3 3.17 3.34 MIN: 3.14 / MAX: 5.06 MIN: 3.09 / MAX: 9.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 3070 RTX 3090 0.4815 0.963 1.4445 1.926 2.4075 SE +/- 0.01, N = 3 2.01 2.09 MIN: 1.98 / MAX: 4.82 MIN: 1.91 / MAX: 13.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 3070 RTX 3090 0.5198 1.0396 1.5594 2.0792 2.599 SE +/- 0.01, N = 3 2.14 2.21 MIN: 2.11 / MAX: 3.93 MIN: 2.05 / MAX: 17.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3070 RTX 3090 1.008 2.016 3.024 4.032 5.04 SE +/- 0.01, N = 3 4.31 4.47 MIN: 4.25 / MAX: 5.94 MIN: 4.1 / MAX: 24.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
VkResample Upscale: 2x - Precision: Double OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.03, N = 3 216.41 119.82 1. (CXX) g++ options: -O3 -pthread
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes GeForce RTX 3090 RTX 3070 RTX 3090 11 22 33 44 55 SE +/- 0.04, N = 3 28.42 46.79 28.42
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3070 RTX 3090 8 16 24 32 40 SE +/- 0.01, N = 3 33.34 18.97
Blender Blend File: BMW27 - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: CUDA RTX 3070 RTX 3090 7 14 21 28 35 SE +/- 0.04, N = 3 29.00 18.32
ViennaCL Test: CPU BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.09, N = 3 56.4 54.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.00, N = 3 58.2 56.1 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.12, N = 3 53.6 52.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.26, N = 3 53.1 52.4 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.10, N = 3 89.8 83.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.09, N = 3 82.8 77.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT RTX 3070 RTX 3090 11 22 33 44 55 SE +/- 0.50, N = 3 48.6 43.2 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY RTX 3070 RTX 3090 8 16 24 32 40 SE +/- 0.32, N = 3 36.5 34.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.03, N = 3 24.6 22.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT RTX 3070 RTX 3090 30 60 90 120 150 SE +/- 0.88, N = 3 151 136 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.73, N = 3 100.8 89.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY RTX 3070 RTX 3090 15 30 45 60 75 SE +/- 0.58, N = 3 66.9 63.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN RTX 3070 RTX 3090 130 260 390 520 650 337 598 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 342 602 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 341 600 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.67, N = 3 333 376 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.58, N = 3 222 236 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT RTX 3070 RTX 3090 140 280 420 560 700 SE +/- 0.00, N = 3 395 663 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY RTX 3070 RTX 3090 160 320 480 640 800 SE +/- 0.00, N = 3 396 721 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 0.33, N = 3 370 607 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.67, N = 3 322 351 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY RTX 3070 RTX 3090 110 220 330 440 550 SE +/- 0.33, N = 3 359 501 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.58, N = 3 291 364 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Texture Read Bandwidth OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Texture Read Bandwidth RTX 3070 RTX 3090 500 1000 1500 2000 2500 SE +/- 6.58, N = 3 2130.04 2228.01 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3070 RTX 3090 4 8 12 16 20 SE +/- 0.01, N = 3 15.82 9.52
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms RTX 3070 RTX 3090 0.0296 0.0592 0.0888 0.1184 0.148 SE +/- 0.00049, N = 3 0.12555 0.13155
VkResample Upscale: 2x - Precision: Single OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single RTX 3070 RTX 3090 4 8 12 16 20 SE +/- 0.013, N = 3 17.529 9.254 1. (CXX) g++ options: -O3 -pthread
ViennaCL Test: OpenCL BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT RTX 3090 130 260 390 520 650 601 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Rainbow Colors and Prism - Acceleration: GPU RTX 3070 RTX 3090 7 14 21 28 35 SE +/- 0.03, N = 3 21.27 32.09 MIN: 20.13 / MAX: 22.99 MIN: 28.96 / MAX: 34.45
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No GeForce RTX 3090 RTX 3070 RTX 3090 2 4 6 8 10 SE +/- 0.002, N = 3 5.595 7.856 5.566
Rodinia Test: OpenCL Particle Filter OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter RTX 3070 RTX 3090 1.332 2.664 3.996 5.328 6.66 SE +/- 0.007, N = 3 5.920 3.680 1. (CXX) g++ options: -O2 -lOpenCL
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA-512 GeForce RTX 3090 RTX 3070 RTX 3090 600M 1200M 1800M 2400M 3000M SE +/- 735602.55, N = 3 2881300000 1673633333 2884600000
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA1 GeForce RTX 3090 RTX 3070 RTX 3090 5000M 10000M 15000M 20000M 25000M SE +/- 7750340.49, N = 3 22798500000 13194833333 22853700000
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: MD5 GeForce RTX 3090 RTX 3070 RTX 3090 14000M 28000M 42000M 56000M 70000M SE +/- 41756290.28, N = 3 66589100000 38925166667 66739300000
cl-mem Benchmark: Copy OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Copy RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.45, N = 3 296.8 364.3 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Write OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write RTX 3070 RTX 3090 160 320 480 640 800 SE +/- 0.09, N = 3 382.0 745.0 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Read OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read RTX 3070 RTX 3090 200 400 600 800 1000 SE +/- 0.30, N = 3 393.3 826.6 1. (CC) gcc options: -O2 -flto -lOpenCL
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: TrueCrypt RIPEMD160 + XTS GeForce RTX 3090 RTX 3070 RTX 3090 200K 400K 600K 800K 1000K SE +/- 800.69, N = 3 859400 503167 857500
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes GeForce RTX 3090 RTX 3070 RTX 3090 0.9252 1.8504 2.7756 3.7008 4.626 SE +/- 0.006, N = 3 3.275 4.112 3.276
ArrayFire Test: Conjugate Gradient OpenCL OpenBenchmarking.org ms, Fewer Is Better ArrayFire 3.7 Test: Conjugate Gradient OpenCL RTX 3070 RTX 3090 0.47 0.94 1.41 1.88 2.35 SE +/- 0.001, N = 3 2.089 1.480 1. (CXX) g++ options: -rdynamic
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Readback OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Readback RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.01, N = 3 27.11 27.08 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: 7-Zip GeForce RTX 3090 RTX 3070 RTX 3090 200K 400K 600K 800K 1000K SE +/- 1128.91, N = 3 1161100 689667 1154600
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: GEMM SGEMM_N OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: GEMM SGEMM_N GeForce RTX 3090 RTX 3070 RTX 3090 2K 4K 6K 8K 10K SE +/- 26.69, N = 3 8105.73 3732.87 8174.54 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Triad OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Triad GeForce RTX 3090 RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.01, N = 3 25.45 24.67 25.53 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Reduction OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Reduction GeForce RTX 3090 RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.70, N = 3 391.09 326.57 391.21 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: FFT SP OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: FFT SP GeForce RTX 3090 RTX 3070 RTX 3090 500 1000 1500 2000 2500 SE +/- 0.78, N = 3 2348.03 1134.82 2349.19 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Download OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Download RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.02, N = 3 26.28 26.26 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: S3D OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: S3D GeForce RTX 3090 RTX 3070 RTX 3090 90 180 270 360 450 SE +/- 0.17, N = 3 427.08 219.20 427.94 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
FinanceBench Benchmark: Black-Scholes OpenCL OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.003, N = 3 10.457 6.357 1. (CXX) g++ options: -O3 -march=native -fopenmp
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: MD5 Hash OpenBenchmarking.org GHash/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: MD5 Hash GeForce RTX 3090 RTX 3070 RTX 3090 10 20 30 40 50 SE +/- 0.03, N = 3 44.19 25.41 44.43 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
Phoronix Test Suite v10.8.5