RTX 30 Compute September AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3090 24GB on Ubuntu 21.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2109061-TJ-RTX30COMP69&sor .
RTX 30 Compute September Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution RTX 3070 RTX 3090 GeForce RTX 3090 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 1000GB Western Digital WD_BLACK SN850 1TB + 2000GB NVIDIA GeForce RTX 3070 8GB NVIDIA GA104 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 21.10 5.13.0-14-generic (x86_64) GNOME Shell 40.2 X Server 1.20.11 NVIDIA 470.63.01 4.6.0 OpenCL 3.0 CUDA 11.4.112 1.2.175 GCC 11.2.0 ext4 3840x2160 NVIDIA GeForce RTX 3090 24GB NVIDIA GA102 HD Audio OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 OpenCL Details - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - GeForce RTX 3090: GPU Compute Cores: 10496 Python Details - Python 3.9.6 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
RTX 30 Compute September vkpeak: fp32-scalar vkpeak: fp32-vec4 vkpeak: fp16-scalar vkpeak: fp16-vec4 vkpeak: fp64-scalar vkpeak: fp64-vec4 vkpeak: int32-scalar vkpeak: int32-vec4 vkpeak: int16-scalar vkpeak: int16-vec4 realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes waifu2x-ncnn: 2x - 3 - Yes vkfft: hashcat: MD5 hashcat: SHA1 hashcat: 7-Zip hashcat: SHA-512 hashcat: TrueCrypt RIPEMD160 + XTS shoc: OpenCL - S3D shoc: OpenCL - Triad shoc: OpenCL - FFT SP shoc: OpenCL - MD5 Hash shoc: OpenCL - Reduction shoc: OpenCL - GEMM SGEMM_N shoc: OpenCL - Max SP Flops shoc: OpenCL - Bus Speed Download shoc: OpenCL - Bus Speed Readback shoc: OpenCL - Texture Read Bandwidth cl-mem: Copy cl-mem: Read cl-mem: Write namd-cuda: ATPase Simulation - 327,506 Atoms vkresample: 2x - Double vkresample: 2x - Single octanebench: Total Score redshift: fahbench: lczero: OpenCL rodinia: OpenCL Particle Filter arrayfire: Conjugate Gradient OpenCL luxcorerender: DLSC - GPU luxcorerender: Danish Mood - GPU luxcorerender: Orange Juice - GPU luxcorerender: LuxCore Benchmark - GPU luxcorerender: Rainbow Colors and Prism - GPU financebench: Black-Scholes OpenCL viennacl: CPU BLAS - sCOPY viennacl: CPU BLAS - sAXPY viennacl: CPU BLAS - sDOT viennacl: CPU BLAS - dCOPY viennacl: CPU BLAS - dAXPY viennacl: CPU BLAS - dDOT viennacl: CPU BLAS - dGEMV-N viennacl: CPU BLAS - dGEMV-T viennacl: CPU BLAS - dGEMM-NN viennacl: CPU BLAS - dGEMM-NT viennacl: CPU BLAS - dGEMM-TN viennacl: CPU BLAS - dGEMM-TT viennacl: OpenCL BLAS - sCOPY viennacl: OpenCL BLAS - sAXPY viennacl: OpenCL BLAS - sDOT viennacl: OpenCL BLAS - dCOPY viennacl: OpenCL BLAS - dAXPY viennacl: OpenCL BLAS - dDOT viennacl: OpenCL BLAS - dGEMV-N viennacl: OpenCL BLAS - dGEMV-T viennacl: OpenCL BLAS - dGEMM-NN viennacl: OpenCL BLAS - dGEMM-NT viennacl: OpenCL BLAS - dGEMM-TN ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - googlenet indigobench: OpenCL GPU - Bedroom indigobench: OpenCL GPU - Supercar blender: BMW27 - CUDA blender: Classroom - CUDA blender: Fishy Cat - CUDA blender: Barbershop - CUDA blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX viennacl: OpenCL BLAS - dGEMM-TT RTX 3070 RTX 3090 GeForce RTX 3090 11589.59 15319.31 11590.48 22503.16 363.75 364.29 11571.35 11521.48 7644.32 10106.83 7.856 46.790 4.112 31554 38925166667 13194833333 689667 1673633333 503167 219.195 24.6671 1134.82 25.4087 326.570 3732.87 23102.9 26.2837 27.1135 2130.04 296.8 393.3 382.0 0.12555 216.406 17.529 415.199251 226 265.5078 37790 5.920 2.089 6.68 5.06 6.99 6.22 21.27 10.457 66.9 100.8 151 24.6 36.5 48.6 82.8 89.8 53.1 53.6 58.2 56.4 291 359 322 370 396 395 222 333 341 342 337 4.31 1.91 2.14 1.71 2.01 3.17 0.98 5.43 1.68 1.90 3.74 6.57 4.43 2.42 4.13 12.941 37.318 29.00 76.06 54.69 507.39 15.82 45.77 33.34 21074.89 27597.6 20954 40868.96 655.42 655.31 20836.32 20743.8 13646.56 16889.26 5.566 28.415 3.276 43295 66739300000 22853700000 1154600 2884600000 857500 427.935 25.5289 2349.19 44.4267 391.211 8174.54 40344.1 26.2571 27.0785 2228.01 364.3 826.6 745 0.13155 119.824 9.254 683.595999 139 344.0195 53653 3.68 1.48 11.53 8.64 10.42 10.92 32.09 6.357 63 89.6 136 22.6 34.8 43.2 77.6 83.8 52.4 52 56.1 54 364 501 351 607 721 663 236 376 600 602 598 4.48 1.98 2.21 1.77 2.09 3.35 0.96 4.44 1.81 1.88 3.74 7.66 4.37 2.57 4.38 20.968 53.364 18.32 51.18 34.65 373.32 9.52 28.66 18.97 601 20871.36 27390.08 20714.14 40423.41 651.31 651.2 20687.55 20597.19 13655.97 16887.92 5.595 28.421 3.275 44567 66589100000 22798500000 1161100 2881300000 859400 427.078 25.4496 2348.03 44.1942 391.091 8105.73 OpenBenchmarking.org
vkpeak fp32-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-scalar GeForce RTX 3090 RTX 3090 RTX 3070 5K 10K 15K 20K 25K SE +/- 35.78, N = 3 21146.01 21074.89 11589.59
vkpeak fp32-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-vec4 GeForce RTX 3090 RTX 3090 RTX 3070 6K 12K 18K 24K 30K SE +/- 35.81, N = 3 27807.75 27597.60 15319.31
vkpeak fp16-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-scalar RTX 3090 GeForce RTX 3090 RTX 3070 4K 8K 12K 16K 20K SE +/- 26.04, N = 3 20954.00 20953.65 11590.48
vkpeak fp16-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-vec4 GeForce RTX 3090 RTX 3090 RTX 3070 9K 18K 27K 36K 45K SE +/- 71.70, N = 3 40869.19 40868.96 22503.16
vkpeak fp64-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-scalar GeForce RTX 3090 RTX 3090 RTX 3070 140 280 420 560 700 SE +/- 0.36, N = 3 658.56 655.42 363.75
vkpeak fp64-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-vec4 RTX 3090 GeForce RTX 3090 RTX 3070 140 280 420 560 700 SE +/- 0.42, N = 3 655.31 651.20 364.29
vkpeak int32-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-scalar GeForce RTX 3090 RTX 3090 RTX 3070 4K 8K 12K 16K 20K SE +/- 16.33, N = 3 20925.87 20836.32 11571.35
vkpeak int32-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-vec4 GeForce RTX 3090 RTX 3090 RTX 3070 4K 8K 12K 16K 20K SE +/- 18.17, N = 3 20746.67 20743.80 11521.48
vkpeak int16-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-scalar GeForce RTX 3090 RTX 3090 RTX 3070 3K 6K 9K 12K 15K SE +/- 11.41, N = 3 13752.19 13646.56 7644.32
vkpeak int16-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-vec4 GeForce RTX 3090 RTX 3090 RTX 3070 4K 8K 12K 16K 20K SE +/- 20.90, N = 3 17006.61 16889.26 10106.83
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No RTX 3090 GeForce RTX 3090 RTX 3070 2 4 6 8 10 SE +/- 0.002, N = 3 5.566 5.595 7.856
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes RTX 3090 GeForce RTX 3090 RTX 3070 11 22 33 44 55 SE +/- 0.04, N = 3 28.42 28.42 46.79
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes GeForce RTX 3090 RTX 3090 RTX 3070 0.9252 1.8504 2.7756 3.7008 4.626 SE +/- 0.006, N = 3 3.275 3.276 4.112
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 GeForce RTX 3090 RTX 3090 RTX 3070 10K 20K 30K 40K 50K SE +/- 172.10, N = 3 44567 43295 31554 1. (CXX) g++ options: -O3 -pthread
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: MD5 RTX 3090 GeForce RTX 3090 RTX 3070 14000M 28000M 42000M 56000M 70000M SE +/- 41756290.28, N = 3 66739300000 66589100000 38925166667
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA1 RTX 3090 GeForce RTX 3090 RTX 3070 5000M 10000M 15000M 20000M 25000M SE +/- 7750340.49, N = 3 22853700000 22798500000 13194833333
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: 7-Zip GeForce RTX 3090 RTX 3090 RTX 3070 200K 400K 600K 800K 1000K SE +/- 1128.91, N = 3 1161100 1154600 689667
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA-512 RTX 3090 GeForce RTX 3090 RTX 3070 600M 1200M 1800M 2400M 3000M SE +/- 735602.55, N = 3 2884600000 2881300000 1673633333
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: TrueCrypt RIPEMD160 + XTS GeForce RTX 3090 RTX 3090 RTX 3070 200K 400K 600K 800K 1000K SE +/- 800.69, N = 3 859400 857500 503167
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: S3D OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: S3D RTX 3090 GeForce RTX 3090 RTX 3070 90 180 270 360 450 SE +/- 0.17, N = 3 427.94 427.08 219.20 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Triad OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Triad RTX 3090 GeForce RTX 3090 RTX 3070 6 12 18 24 30 SE +/- 0.01, N = 3 25.53 25.45 24.67 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: FFT SP OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: FFT SP RTX 3090 GeForce RTX 3090 RTX 3070 500 1000 1500 2000 2500 SE +/- 0.78, N = 3 2349.19 2348.03 1134.82 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: MD5 Hash OpenBenchmarking.org GHash/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: MD5 Hash RTX 3090 GeForce RTX 3090 RTX 3070 10 20 30 40 50 SE +/- 0.03, N = 3 44.43 44.19 25.41 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Reduction OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Reduction RTX 3090 GeForce RTX 3090 RTX 3070 80 160 240 320 400 SE +/- 0.70, N = 3 391.21 391.09 326.57 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: GEMM SGEMM_N OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: GEMM SGEMM_N RTX 3090 GeForce RTX 3090 RTX 3070 2K 4K 6K 8K 10K SE +/- 26.69, N = 3 8174.54 8105.73 3732.87 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Max SP Flops OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Max SP Flops RTX 3090 RTX 3070 9K 18K 27K 36K 45K SE +/- 59.20, N = 3 40344.1 23102.9 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Download OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Download RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.02, N = 3 26.28 26.26 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Readback OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Readback RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.01, N = 3 27.11 27.08 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Texture Read Bandwidth OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Texture Read Bandwidth RTX 3090 RTX 3070 500 1000 1500 2000 2500 SE +/- 6.58, N = 3 2228.01 2130.04 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
cl-mem Benchmark: Copy OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Copy RTX 3090 RTX 3070 80 160 240 320 400 SE +/- 0.45, N = 3 364.3 296.8 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Read OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read RTX 3090 RTX 3070 200 400 600 800 1000 SE +/- 0.30, N = 3 826.6 393.3 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Write OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write RTX 3090 RTX 3070 160 320 480 640 800 SE +/- 0.09, N = 3 745.0 382.0 1. (CC) gcc options: -O2 -flto -lOpenCL
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms RTX 3070 RTX 3090 0.0296 0.0592 0.0888 0.1184 0.148 SE +/- 0.00049, N = 3 0.12555 0.13155
VkResample Upscale: 2x - Precision: Double OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double RTX 3090 RTX 3070 50 100 150 200 250 SE +/- 0.03, N = 3 119.82 216.41 1. (CXX) g++ options: -O3 -pthread
VkResample Upscale: 2x - Precision: Single OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single RTX 3090 RTX 3070 4 8 12 16 20 SE +/- 0.013, N = 3 9.254 17.529 1. (CXX) g++ options: -O3 -pthread
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score RTX 3090 RTX 3070 150 300 450 600 750 683.60 415.20
RedShift Demo OpenBenchmarking.org Seconds, Fewer Is Better RedShift Demo 3.0 RTX 3090 RTX 3070 50 100 150 200 250 SE +/- 0.33, N = 3 139 226
FAHBench OpenBenchmarking.org Ns Per Day, More Is Better FAHBench 2.3.2 RTX 3090 RTX 3070 70 140 210 280 350 SE +/- 0.05, N = 3 344.02 265.51
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3090 RTX 3070 11K 22K 33K 44K 55K SE +/- 178.94, N = 3 53653 37790 1. (CXX) g++ options: -flto -pthread
Rodinia Test: OpenCL Particle Filter OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter RTX 3090 RTX 3070 1.332 2.664 3.996 5.328 6.66 SE +/- 0.007, N = 3 3.680 5.920 1. (CXX) g++ options: -O2 -lOpenCL
ArrayFire Test: Conjugate Gradient OpenCL OpenBenchmarking.org ms, Fewer Is Better ArrayFire 3.7 Test: Conjugate Gradient OpenCL RTX 3090 RTX 3070 0.47 0.94 1.41 1.88 2.35 SE +/- 0.001, N = 3 1.480 2.089 1. (CXX) g++ options: -rdynamic
LuxCoreRender Scene: DLSC - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: DLSC - Acceleration: GPU RTX 3090 RTX 3070 3 6 9 12 15 SE +/- 0.00, N = 3 11.53 6.68 MIN: 11.29 / MAX: 11.68 MIN: 6.25 / MAX: 6.94
LuxCoreRender Scene: Danish Mood - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Danish Mood - Acceleration: GPU RTX 3090 RTX 3070 2 4 6 8 10 SE +/- 0.00, N = 3 8.64 5.06 MIN: 2.95 / MAX: 10.48 MIN: 1.5 / MAX: 6.12
LuxCoreRender Scene: Orange Juice - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Orange Juice - Acceleration: GPU RTX 3090 RTX 3070 3 6 9 12 15 SE +/- 0.01, N = 3 10.42 6.99 MIN: 8.45 / MAX: 13.57 MIN: 5.61 / MAX: 8.46
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: LuxCore Benchmark - Acceleration: GPU RTX 3090 RTX 3070 3 6 9 12 15 SE +/- 0.01, N = 3 10.92 6.22 MIN: 3.29 / MAX: 13.01 MIN: 2.05 / MAX: 7.38
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Rainbow Colors and Prism - Acceleration: GPU RTX 3090 RTX 3070 7 14 21 28 35 SE +/- 0.03, N = 3 32.09 21.27 MIN: 28.96 / MAX: 34.45 MIN: 20.13 / MAX: 22.99
FinanceBench Benchmark: Black-Scholes OpenCL OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL RTX 3090 RTX 3070 3 6 9 12 15 SE +/- 0.003, N = 3 6.357 10.457 1. (CXX) g++ options: -O3 -march=native -fopenmp
ViennaCL Test: CPU BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY RTX 3070 RTX 3090 15 30 45 60 75 SE +/- 0.58, N = 3 66.9 63.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.73, N = 3 100.8 89.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT RTX 3070 RTX 3090 30 60 90 120 150 SE +/- 0.88, N = 3 151 136 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.03, N = 3 24.6 22.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY RTX 3070 RTX 3090 8 16 24 32 40 SE +/- 0.32, N = 3 36.5 34.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT RTX 3070 RTX 3090 11 22 33 44 55 SE +/- 0.50, N = 3 48.6 43.2 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.09, N = 3 82.8 77.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.10, N = 3 89.8 83.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.26, N = 3 53.1 52.4 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.12, N = 3 53.6 52.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.00, N = 3 58.2 56.1 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.09, N = 3 56.4 54.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY RTX 3090 RTX 3070 80 160 240 320 400 SE +/- 0.58, N = 3 364 291 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY RTX 3090 RTX 3070 110 220 330 440 550 SE +/- 0.33, N = 3 501 359 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT RTX 3090 RTX 3070 80 160 240 320 400 SE +/- 0.67, N = 3 351 322 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY RTX 3090 RTX 3070 130 260 390 520 650 SE +/- 0.33, N = 3 607 370 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY RTX 3090 RTX 3070 160 320 480 640 800 SE +/- 0.00, N = 3 721 396 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT RTX 3090 RTX 3070 140 280 420 560 700 SE +/- 0.00, N = 3 663 395 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N RTX 3090 RTX 3070 50 100 150 200 250 SE +/- 0.58, N = 3 236 222 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T RTX 3090 RTX 3070 80 160 240 320 400 SE +/- 0.67, N = 3 376 333 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN RTX 3090 RTX 3070 130 260 390 520 650 SE +/- 1.33, N = 3 600 341 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT RTX 3090 RTX 3070 130 260 390 520 650 SE +/- 1.33, N = 3 602 342 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN RTX 3090 RTX 3070 130 260 390 520 650 598 337 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3070 RTX 3090 1.008 2.016 3.024 4.032 5.04 SE +/- 0.01, N = 3 4.31 4.47 MIN: 4.25 / MAX: 5.94 MIN: 4.1 / MAX: 24.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 3070 RTX 3090 0.4455 0.891 1.3365 1.782 2.2275 SE +/- 0.01, N = 3 1.91 1.98 MIN: 1.88 / MAX: 3.42 MIN: 1.84 / MAX: 7.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 3070 RTX 3090 0.5198 1.0396 1.5594 2.0792 2.599 SE +/- 0.01, N = 3 2.14 2.21 MIN: 2.11 / MAX: 3.93 MIN: 2.05 / MAX: 17.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 3070 RTX 3090 0.3983 0.7966 1.1949 1.5932 1.9915 SE +/- 0.01, N = 3 1.71 1.77 MIN: 1.68 / MAX: 3.55 MIN: 1.67 / MAX: 9.47 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 3070 RTX 3090 0.4815 0.963 1.4445 1.926 2.4075 SE +/- 0.01, N = 3 2.01 2.09 MIN: 1.98 / MAX: 4.82 MIN: 1.91 / MAX: 13.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 3070 RTX 3090 0.7538 1.5076 2.2614 3.0152 3.769 SE +/- 0.01, N = 3 3.17 3.34 MIN: 3.14 / MAX: 5.06 MIN: 3.09 / MAX: 9.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface RTX 3090 RTX 3070 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.00, N = 3 0.96 0.98 MIN: 0.88 / MAX: 8.42 MIN: 0.95 / MAX: 2.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3090 RTX 3070 1.2218 2.4436 3.6654 4.8872 6.109 SE +/- 0.01, N = 3 4.35 5.43 MIN: 4.02 / MAX: 18.18 MIN: 5.38 / MAX: 9.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 RTX 3090 RTX 3070 0.4073 0.8146 1.2219 1.6292 2.0365 SE +/- 0.01, N = 3 1.66 1.68 MIN: 1.53 / MAX: 9.86 MIN: 1.66 / MAX: 1.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3090 RTX 3070 0.4388 0.8776 1.3164 1.7552 2.194 SE +/- 0.01, N = 3 1.88 1.90 MIN: 1.77 / MAX: 6.33 MIN: 1.86 / MAX: 5.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3090 RTX 3070 0.8415 1.683 2.5245 3.366 4.2075 SE +/- 0.01, N = 3 3.68 3.74 MIN: 3.44 / MAX: 13.64 MIN: 3.71 / MAX: 4.06 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3070 RTX 3090 2 4 6 8 10 SE +/- 0.01, N = 3 6.57 7.20 MIN: 6.33 / MAX: 6.98 MIN: 6.44 / MAX: 31.2 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3090 RTX 3070 0.9968 1.9936 2.9904 3.9872 4.984 SE +/- 0.13, N = 3 4.37 4.43 MIN: 3.93 / MAX: 23.52 MIN: 4.1 / MAX: 7.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 3070 RTX 3090 0.5783 1.1566 1.7349 2.3132 2.8915 SE +/- 0.01, N = 3 2.42 2.52 MIN: 2.4 / MAX: 3.84 MIN: 2.38 / MAX: 10.9 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 3070 RTX 3090 0.9923 1.9846 2.9769 3.9692 4.9615 SE +/- 0.13, N = 2 4.13 4.38 MIN: 3.77 / MAX: 13.51 MIN: 3.61 / MAX: 17.92 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
IndigoBench Acceleration: OpenCL GPU - Scene: Bedroom OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Bedroom RTX 3090 RTX 3070 5 10 15 20 25 SE +/- 0.02, N = 3 20.97 12.94
IndigoBench Acceleration: OpenCL GPU - Scene: Supercar OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar RTX 3090 RTX 3070 12 24 36 48 60 SE +/- 0.04, N = 3 53.36 37.32
Blender Blend File: BMW27 - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: CUDA RTX 3090 RTX 3070 7 14 21 28 35 SE +/- 0.04, N = 3 18.32 29.00
Blender Blend File: Classroom - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: CUDA RTX 3090 RTX 3070 20 40 60 80 100 SE +/- 0.01, N = 3 51.18 76.06
Blender Blend File: Fishy Cat - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: CUDA RTX 3090 RTX 3070 12 24 36 48 60 SE +/- 0.04, N = 3 34.65 54.69
Blender Blend File: Barbershop - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Barbershop - Compute: CUDA RTX 3090 RTX 3070 110 220 330 440 550 SE +/- 0.17, N = 3 373.32 507.39
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3090 RTX 3070 4 8 12 16 20 SE +/- 0.01, N = 3 9.52 15.82
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX RTX 3090 RTX 3070 10 20 30 40 50 SE +/- 0.02, N = 3 28.66 45.77
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3090 RTX 3070 8 16 24 32 40 SE +/- 0.01, N = 3 18.97 33.34
ViennaCL Test: OpenCL BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT RTX 3090 130 260 390 520 650 601 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
Phoronix Test Suite v10.8.4