RTX 30 Compute September AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3090 24GB on Ubuntu 21.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2109061-TJ-RTX30COMP69&rdt&gru .
RTX 30 Compute September Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution RTX 3070 RTX 3090 GeForce RTX 3090 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 1000GB Western Digital WD_BLACK SN850 1TB + 2000GB NVIDIA GeForce RTX 3070 8GB NVIDIA GA104 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 21.10 5.13.0-14-generic (x86_64) GNOME Shell 40.2 X Server 1.20.11 NVIDIA 470.63.01 4.6.0 OpenCL 3.0 CUDA 11.4.112 1.2.175 GCC 11.2.0 ext4 3840x2160 NVIDIA GeForce RTX 3090 24GB NVIDIA GA102 HD Audio OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 OpenCL Details - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - GeForce RTX 3090: GPU Compute Cores: 10496 Python Details - Python 3.9.6 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
RTX 30 Compute September vkfft: shoc: OpenCL - Triad shoc: OpenCL - Reduction shoc: OpenCL - Bus Speed Download shoc: OpenCL - Bus Speed Readback shoc: OpenCL - Texture Read Bandwidth cl-mem: Copy cl-mem: Read cl-mem: Write viennacl: CPU BLAS - sCOPY viennacl: CPU BLAS - sAXPY viennacl: CPU BLAS - sDOT viennacl: CPU BLAS - dCOPY viennacl: CPU BLAS - dAXPY viennacl: CPU BLAS - dDOT viennacl: CPU BLAS - dGEMV-N viennacl: CPU BLAS - dGEMV-T viennacl: OpenCL BLAS - sCOPY viennacl: OpenCL BLAS - sAXPY viennacl: OpenCL BLAS - sDOT viennacl: OpenCL BLAS - dCOPY viennacl: OpenCL BLAS - dAXPY viennacl: OpenCL BLAS - dDOT viennacl: OpenCL BLAS - dGEMV-N viennacl: OpenCL BLAS - dGEMV-T vkpeak: fp32-scalar vkpeak: fp32-vec4 vkpeak: fp16-scalar vkpeak: fp16-vec4 vkpeak: fp64-scalar vkpeak: fp64-vec4 shoc: OpenCL - S3D shoc: OpenCL - FFT SP shoc: OpenCL - GEMM SGEMM_N shoc: OpenCL - Max SP Flops viennacl: CPU BLAS - dGEMM-NN viennacl: CPU BLAS - dGEMM-NT viennacl: CPU BLAS - dGEMM-TN viennacl: CPU BLAS - dGEMM-TT viennacl: OpenCL BLAS - dGEMM-NN viennacl: OpenCL BLAS - dGEMM-NT viennacl: OpenCL BLAS - dGEMM-TN viennacl: OpenCL BLAS - dGEMM-TT shoc: OpenCL - MD5 Hash vkpeak: int32-scalar vkpeak: int32-vec4 vkpeak: int16-scalar vkpeak: int16-vec4 hashcat: MD5 hashcat: SHA1 hashcat: 7-Zip hashcat: SHA-512 hashcat: TrueCrypt RIPEMD160 + XTS indigobench: OpenCL GPU - Bedroom indigobench: OpenCL GPU - Supercar luxcorerender: DLSC - GPU luxcorerender: Danish Mood - GPU luxcorerender: Orange Juice - GPU luxcorerender: LuxCore Benchmark - GPU luxcorerender: Rainbow Colors and Prism - GPU lczero: OpenCL fahbench: octanebench: Total Score namd-cuda: ATPase Simulation - 327,506 Atoms vkresample: 2x - Double vkresample: 2x - Single arrayfire: Conjugate Gradient OpenCL financebench: Black-Scholes OpenCL ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - googlenet realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes waifu2x-ncnn: 2x - 3 - Yes redshift: rodinia: OpenCL Particle Filter blender: BMW27 - CUDA blender: Classroom - CUDA blender: Fishy Cat - CUDA blender: Barbershop - CUDA blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX RTX 3070 RTX 3090 GeForce RTX 3090 31554 24.6671 326.570 26.2837 27.1135 2130.04 296.8 393.3 382.0 66.9 100.8 151 24.6 36.5 48.6 82.8 89.8 291 359 322 370 396 395 222 333 11589.59 15319.31 11590.48 22503.16 363.75 364.29 219.195 1134.82 3732.87 23102.9 53.1 53.6 58.2 56.4 341 342 337 25.4087 11571.35 11521.48 7644.32 10106.83 38925166667 13194833333 689667 1673633333 503167 12.941 37.318 6.68 5.06 6.99 6.22 21.27 37790 265.5078 415.199251 0.12555 216.406 17.529 2.089 10.457 4.31 1.91 2.14 1.71 2.01 3.17 0.98 5.43 1.68 1.90 3.74 6.57 4.43 2.42 4.13 7.856 46.790 4.112 226 5.920 29.00 76.06 54.69 507.39 15.82 45.77 33.34 43295 25.5289 391.211 26.2571 27.0785 2228.01 364.3 826.6 745 63 89.6 136 22.6 34.8 43.2 77.6 83.8 364 501 351 607 721 663 236 376 21074.89 27597.6 20954 40868.96 655.42 655.31 427.935 2349.19 8174.54 40344.1 52.4 52 56.1 54 600 602 598 601 44.4267 20836.32 20743.8 13646.56 16889.26 66739300000 22853700000 1154600 2884600000 857500 20.968 53.364 11.53 8.64 10.42 10.92 32.09 53653 344.0195 683.595999 0.13155 119.824 9.254 1.48 6.357 4.47 1.98 2.31 1.77 2.14 3.34 1.07 4.35 1.66 1.95 3.68 7.2 4.37 2.52 4.41 5.566 28.415 3.276 139 3.68 18.32 51.18 34.65 373.32 9.52 28.66 18.97 44567 25.4496 391.091 21146.01 27807.75 20953.65 40869.19 658.56 651.2 427.078 2348.03 8105.73 44.1942 20925.87 20746.67 13752.19 17006.61 66589100000 22798500000 1161100 2881300000 859400 5.595 28.421 3.275 OpenBenchmarking.org
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 RTX 3070 RTX 3090 GeForce RTX 3090 10K 20K 30K 40K 50K SE +/- 172.10, N = 3 31554 43295 44567 1. (CXX) g++ options: -O3 -pthread
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Triad OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Triad RTX 3070 RTX 3090 GeForce RTX 3090 6 12 18 24 30 SE +/- 0.01, N = 3 24.67 25.53 25.45 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Reduction OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Reduction RTX 3070 RTX 3090 GeForce RTX 3090 80 160 240 320 400 SE +/- 0.70, N = 3 326.57 391.21 391.09 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Download OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Download RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.02, N = 3 26.28 26.26 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Readback OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Readback RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.01, N = 3 27.11 27.08 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Texture Read Bandwidth OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Texture Read Bandwidth RTX 3070 RTX 3090 500 1000 1500 2000 2500 SE +/- 6.58, N = 3 2130.04 2228.01 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
cl-mem Benchmark: Copy OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Copy RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.45, N = 3 296.8 364.3 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Read OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read RTX 3070 RTX 3090 200 400 600 800 1000 SE +/- 0.30, N = 3 393.3 826.6 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Write OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write RTX 3070 RTX 3090 160 320 480 640 800 SE +/- 0.09, N = 3 382.0 745.0 1. (CC) gcc options: -O2 -flto -lOpenCL
ViennaCL Test: CPU BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY RTX 3070 RTX 3090 15 30 45 60 75 SE +/- 0.58, N = 3 66.9 63.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.73, N = 3 100.8 89.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT RTX 3070 RTX 3090 30 60 90 120 150 SE +/- 0.88, N = 3 151 136 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.03, N = 3 24.6 22.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY RTX 3070 RTX 3090 8 16 24 32 40 SE +/- 0.32, N = 3 36.5 34.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT RTX 3070 RTX 3090 11 22 33 44 55 SE +/- 0.50, N = 3 48.6 43.2 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.09, N = 3 82.8 77.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.10, N = 3 89.8 83.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.58, N = 3 291 364 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY RTX 3070 RTX 3090 110 220 330 440 550 SE +/- 0.33, N = 3 359 501 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.67, N = 3 322 351 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 0.33, N = 3 370 607 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY RTX 3070 RTX 3090 160 320 480 640 800 SE +/- 0.00, N = 3 396 721 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT RTX 3070 RTX 3090 140 280 420 560 700 SE +/- 0.00, N = 3 395 663 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.58, N = 3 222 236 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.67, N = 3 333 376 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
vkpeak fp32-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-scalar GeForce RTX 3090 RTX 3070 RTX 3090 5K 10K 15K 20K 25K SE +/- 35.78, N = 3 20871.36 11589.59 21074.89
vkpeak fp32-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 6K 12K 18K 24K 30K SE +/- 35.81, N = 3 27390.08 15319.31 27597.60
vkpeak fp16-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-scalar GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 26.04, N = 3 20714.14 11590.48 20954.00
vkpeak fp16-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 9K 18K 27K 36K 45K SE +/- 71.70, N = 3 40423.41 22503.16 40868.96
vkpeak fp64-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-scalar GeForce RTX 3090 RTX 3070 RTX 3090 140 280 420 560 700 SE +/- 0.36, N = 3 651.31 363.75 655.42
vkpeak fp64-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-vec4 RTX 3070 RTX 3090 GeForce RTX 3090 140 280 420 560 700 SE +/- 0.42, N = 3 364.29 655.31 651.20
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: S3D OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: S3D RTX 3070 RTX 3090 GeForce RTX 3090 90 180 270 360 450 SE +/- 0.17, N = 3 219.20 427.94 427.08 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: FFT SP OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: FFT SP RTX 3070 RTX 3090 GeForce RTX 3090 500 1000 1500 2000 2500 SE +/- 0.78, N = 3 1134.82 2349.19 2348.03 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: GEMM SGEMM_N OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: GEMM SGEMM_N RTX 3070 RTX 3090 GeForce RTX 3090 2K 4K 6K 8K 10K SE +/- 26.69, N = 3 3732.87 8174.54 8105.73 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Max SP Flops OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Max SP Flops RTX 3070 RTX 3090 9K 18K 27K 36K 45K SE +/- 59.20, N = 3 23102.9 40344.1 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
ViennaCL Test: CPU BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.26, N = 3 53.1 52.4 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.12, N = 3 53.6 52.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.00, N = 3 58.2 56.1 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.09, N = 3 56.4 54.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 341 600 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 342 602 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN RTX 3070 RTX 3090 130 260 390 520 650 337 598 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT RTX 3090 130 260 390 520 650 601 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: MD5 Hash OpenBenchmarking.org GHash/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: MD5 Hash RTX 3070 RTX 3090 GeForce RTX 3090 10 20 30 40 50 SE +/- 0.03, N = 3 25.41 44.43 44.19 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
vkpeak int32-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-scalar GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 16.33, N = 3 20687.55 11571.35 20836.32
vkpeak int32-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 18.17, N = 3 20597.19 11521.48 20743.80
vkpeak int16-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-scalar GeForce RTX 3090 RTX 3070 RTX 3090 3K 6K 9K 12K 15K SE +/- 11.41, N = 3 13655.97 7644.32 13646.56
vkpeak int16-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 20.90, N = 3 16887.92 10106.83 16889.26
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: MD5 RTX 3070 RTX 3090 GeForce RTX 3090 14000M 28000M 42000M 56000M 70000M SE +/- 41756290.28, N = 3 38925166667 66739300000 66589100000
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA1 RTX 3070 RTX 3090 GeForce RTX 3090 5000M 10000M 15000M 20000M 25000M SE +/- 7750340.49, N = 3 13194833333 22853700000 22798500000
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: 7-Zip RTX 3070 RTX 3090 GeForce RTX 3090 200K 400K 600K 800K 1000K SE +/- 1128.91, N = 3 689667 1154600 1161100
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA-512 RTX 3070 RTX 3090 GeForce RTX 3090 600M 1200M 1800M 2400M 3000M SE +/- 735602.55, N = 3 1673633333 2884600000 2881300000
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: TrueCrypt RIPEMD160 + XTS RTX 3070 RTX 3090 GeForce RTX 3090 200K 400K 600K 800K 1000K SE +/- 800.69, N = 3 503167 857500 859400
IndigoBench Acceleration: OpenCL GPU - Scene: Bedroom OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Bedroom RTX 3070 RTX 3090 5 10 15 20 25 SE +/- 0.02, N = 3 12.94 20.97
IndigoBench Acceleration: OpenCL GPU - Scene: Supercar OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.04, N = 3 37.32 53.36
LuxCoreRender Scene: DLSC - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: DLSC - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.00, N = 3 6.68 11.53 MIN: 6.25 / MAX: 6.94 MIN: 11.29 / MAX: 11.68
LuxCoreRender Scene: Danish Mood - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Danish Mood - Acceleration: GPU RTX 3070 RTX 3090 2 4 6 8 10 SE +/- 0.00, N = 3 5.06 8.64 MIN: 1.5 / MAX: 6.12 MIN: 2.95 / MAX: 10.48
LuxCoreRender Scene: Orange Juice - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Orange Juice - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.01, N = 3 6.99 10.42 MIN: 5.61 / MAX: 8.46 MIN: 8.45 / MAX: 13.57
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: LuxCore Benchmark - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.01, N = 3 6.22 10.92 MIN: 2.05 / MAX: 7.38 MIN: 3.29 / MAX: 13.01
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Rainbow Colors and Prism - Acceleration: GPU RTX 3070 RTX 3090 7 14 21 28 35 SE +/- 0.03, N = 3 21.27 32.09 MIN: 20.13 / MAX: 22.99 MIN: 28.96 / MAX: 34.45
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3070 RTX 3090 11K 22K 33K 44K 55K SE +/- 178.94, N = 3 37790 53653 1. (CXX) g++ options: -flto -pthread
FAHBench OpenBenchmarking.org Ns Per Day, More Is Better FAHBench 2.3.2 RTX 3070 RTX 3090 70 140 210 280 350 SE +/- 0.05, N = 3 265.51 344.02
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score RTX 3070 RTX 3090 150 300 450 600 750 415.20 683.60
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms RTX 3070 RTX 3090 0.0296 0.0592 0.0888 0.1184 0.148 SE +/- 0.00049, N = 3 0.12555 0.13155
VkResample Upscale: 2x - Precision: Double OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.03, N = 3 216.41 119.82 1. (CXX) g++ options: -O3 -pthread
VkResample Upscale: 2x - Precision: Single OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single RTX 3070 RTX 3090 4 8 12 16 20 SE +/- 0.013, N = 3 17.529 9.254 1. (CXX) g++ options: -O3 -pthread
ArrayFire Test: Conjugate Gradient OpenCL OpenBenchmarking.org ms, Fewer Is Better ArrayFire 3.7 Test: Conjugate Gradient OpenCL RTX 3070 RTX 3090 0.47 0.94 1.41 1.88 2.35 SE +/- 0.001, N = 3 2.089 1.480 1. (CXX) g++ options: -rdynamic
FinanceBench Benchmark: Black-Scholes OpenCL OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.003, N = 3 10.457 6.357 1. (CXX) g++ options: -O3 -march=native -fopenmp
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3090 RTX 3070 1.008 2.016 3.024 4.032 5.04 SE +/- 0.01, N = 3 4.48 4.31 MIN: 4.13 / MAX: 21.47 MIN: 4.25 / MAX: 5.94 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 3070 RTX 3090 0.4455 0.891 1.3365 1.782 2.2275 SE +/- 0.01, N = 3 1.91 1.98 MIN: 1.88 / MAX: 3.42 MIN: 1.84 / MAX: 7.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 3090 RTX 3070 0.5198 1.0396 1.5594 2.0792 2.599 SE +/- 0.01, N = 3 2.21 2.14 MIN: 2.05 / MAX: 17.77 MIN: 2.11 / MAX: 3.93 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 3070 RTX 3090 0.3983 0.7966 1.1949 1.5932 1.9915 SE +/- 0.01, N = 3 1.71 1.77 MIN: 1.68 / MAX: 3.55 MIN: 1.67 / MAX: 9.47 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 3090 RTX 3070 0.4815 0.963 1.4445 1.926 2.4075 SE +/- 0.01, N = 3 2.09 2.01 MIN: 1.91 / MAX: 13.69 MIN: 1.98 / MAX: 4.82 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 3090 RTX 3070 0.7538 1.5076 2.2614 3.0152 3.769 SE +/- 0.01, N = 3 3.35 3.17 MIN: 3.08 / MAX: 13.75 MIN: 3.14 / MAX: 5.06 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface RTX 3090 RTX 3070 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.00, N = 3 0.96 0.98 MIN: 0.88 / MAX: 8.42 MIN: 0.95 / MAX: 2.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3090 RTX 3070 1.2218 2.4436 3.6654 4.8872 6.109 SE +/- 0.01, N = 3 4.44 5.43 MIN: 4.12 / MAX: 17.46 MIN: 5.38 / MAX: 9.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 RTX 3090 RTX 3070 0.4073 0.8146 1.2219 1.6292 2.0365 SE +/- 0.01, N = 3 1.81 1.68 MIN: 1.52 / MAX: 16.46 MIN: 1.66 / MAX: 1.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3090 RTX 3070 0.4388 0.8776 1.3164 1.7552 2.194 SE +/- 0.01, N = 3 1.88 1.90 MIN: 1.77 / MAX: 6.33 MIN: 1.86 / MAX: 5.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3090 RTX 3070 0.8415 1.683 2.5245 3.366 4.2075 SE +/- 0.01, N = 3 3.74 3.74 MIN: 3.43 / MAX: 14.52 MIN: 3.71 / MAX: 4.06 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3090 RTX 3070 2 4 6 8 10 SE +/- 0.01, N = 3 7.66 6.57 MIN: 6.47 / MAX: 40.34 MIN: 6.33 / MAX: 6.98 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3070 RTX 3090 0.9968 1.9936 2.9904 3.9872 4.984 SE +/- 0.13, N = 3 4.43 4.37 MIN: 4.1 / MAX: 7.62 MIN: 3.93 / MAX: 23.52 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 3090 RTX 3070 0.5783 1.1566 1.7349 2.3132 2.8915 SE +/- 0.01, N = 3 2.57 2.42 MIN: 2.38 / MAX: 8.98 MIN: 2.4 / MAX: 3.84 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 3090 RTX 3070 0.9923 1.9846 2.9769 3.9692 4.9615 SE +/- 0.13, N = 2 4.38 4.13 MIN: 3.61 / MAX: 17.92 MIN: 3.77 / MAX: 13.51 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No RTX 3070 RTX 3090 GeForce RTX 3090 2 4 6 8 10 SE +/- 0.002, N = 3 7.856 5.566 5.595
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes RTX 3070 RTX 3090 GeForce RTX 3090 11 22 33 44 55 SE +/- 0.04, N = 3 46.79 28.42 28.42
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes RTX 3070 RTX 3090 GeForce RTX 3090 0.9252 1.8504 2.7756 3.7008 4.626 SE +/- 0.006, N = 3 4.112 3.276 3.275
RedShift Demo OpenBenchmarking.org Seconds, Fewer Is Better RedShift Demo 3.0 RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.33, N = 3 226 139
Rodinia Test: OpenCL Particle Filter OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter RTX 3070 RTX 3090 1.332 2.664 3.996 5.328 6.66 SE +/- 0.007, N = 3 5.920 3.680 1. (CXX) g++ options: -O2 -lOpenCL
Blender Blend File: BMW27 - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: CUDA RTX 3070 RTX 3090 7 14 21 28 35 SE +/- 0.04, N = 3 29.00 18.32
Blender Blend File: Classroom - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: CUDA RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.01, N = 3 76.06 51.18
Blender Blend File: Fishy Cat - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: CUDA RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.04, N = 3 54.69 34.65
Blender Blend File: Barbershop - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Barbershop - Compute: CUDA RTX 3070 RTX 3090 110 220 330 440 550 SE +/- 0.17, N = 3 507.39 373.32
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3070 RTX 3090 4 8 12 16 20 SE +/- 0.01, N = 3 15.82 9.52
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX RTX 3070 RTX 3090 10 20 30 40 50 SE +/- 0.02, N = 3 45.77 28.66
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3070 RTX 3090 8 16 24 32 40 SE +/- 0.01, N = 3 33.34 18.97
Phoronix Test Suite v10.8.5