RTX 30 Compute September AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3090 24GB on Ubuntu 21.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2109061-TJ-RTX30COMP69&grt&rdt .
RTX 30 Compute September Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution RTX 3070 RTX 3090 GeForce RTX 3090 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 1000GB Western Digital WD_BLACK SN850 1TB + 2000GB NVIDIA GeForce RTX 3070 8GB NVIDIA GA104 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 21.10 5.13.0-14-generic (x86_64) GNOME Shell 40.2 X Server 1.20.11 NVIDIA 470.63.01 4.6.0 OpenCL 3.0 CUDA 11.4.112 1.2.175 GCC 11.2.0 ext4 3840x2160 NVIDIA GeForce RTX 3090 24GB NVIDIA GA102 HD Audio OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-M6DaQn/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 OpenCL Details - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - GeForce RTX 3090: GPU Compute Cores: 10496 Python Details - Python 3.9.6 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
RTX 30 Compute September arrayfire: Conjugate Gradient OpenCL blender: BMW27 - CUDA blender: Classroom - CUDA blender: Fishy Cat - CUDA blender: Barbershop - CUDA blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX cl-mem: Copy cl-mem: Read cl-mem: Write fahbench: financebench: Black-Scholes OpenCL hashcat: MD5 hashcat: SHA1 hashcat: 7-Zip hashcat: SHA-512 hashcat: TrueCrypt RIPEMD160 + XTS indigobench: OpenCL GPU - Bedroom indigobench: OpenCL GPU - Supercar lczero: OpenCL luxcorerender: DLSC - GPU luxcorerender: Danish Mood - GPU luxcorerender: Orange Juice - GPU luxcorerender: LuxCore Benchmark - GPU luxcorerender: Rainbow Colors and Prism - GPU namd-cuda: ATPase Simulation - 327,506 Atoms ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - googlenet octanebench: Total Score realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes redshift: rodinia: OpenCL Particle Filter shoc: OpenCL - S3D shoc: OpenCL - Triad shoc: OpenCL - FFT SP shoc: OpenCL - MD5 Hash shoc: OpenCL - Reduction shoc: OpenCL - GEMM SGEMM_N shoc: OpenCL - Max SP Flops shoc: OpenCL - Bus Speed Download shoc: OpenCL - Bus Speed Readback shoc: OpenCL - Texture Read Bandwidth viennacl: CPU BLAS - sCOPY viennacl: CPU BLAS - sAXPY viennacl: CPU BLAS - sDOT viennacl: CPU BLAS - dCOPY viennacl: CPU BLAS - dAXPY viennacl: CPU BLAS - dDOT viennacl: CPU BLAS - dGEMV-N viennacl: CPU BLAS - dGEMV-T viennacl: CPU BLAS - dGEMM-NN viennacl: CPU BLAS - dGEMM-NT viennacl: CPU BLAS - dGEMM-TN viennacl: CPU BLAS - dGEMM-TT viennacl: OpenCL BLAS - sCOPY viennacl: OpenCL BLAS - sAXPY viennacl: OpenCL BLAS - sDOT viennacl: OpenCL BLAS - dCOPY viennacl: OpenCL BLAS - dAXPY viennacl: OpenCL BLAS - dDOT viennacl: OpenCL BLAS - dGEMV-N viennacl: OpenCL BLAS - dGEMV-T viennacl: OpenCL BLAS - dGEMM-NN viennacl: OpenCL BLAS - dGEMM-NT viennacl: OpenCL BLAS - dGEMM-TN viennacl: OpenCL BLAS - dGEMM-TT vkfft: vkpeak: fp32-scalar vkpeak: fp32-vec4 vkpeak: fp16-scalar vkpeak: fp16-vec4 vkpeak: fp64-scalar vkpeak: fp64-vec4 vkpeak: int32-scalar vkpeak: int32-vec4 vkpeak: int16-scalar vkpeak: int16-vec4 vkresample: 2x - Double vkresample: 2x - Single waifu2x-ncnn: 2x - 3 - Yes RTX 3070 RTX 3090 GeForce RTX 3090 2.089 29.00 76.06 54.69 507.39 15.82 45.77 33.34 296.8 393.3 382.0 265.5078 10.457 38925166667 13194833333 689667 1673633333 503167 12.941 37.318 37790 6.68 5.06 6.99 6.22 21.27 0.12555 4.31 1.91 2.14 1.71 2.01 3.17 0.98 5.43 1.68 1.90 3.74 6.57 4.43 2.42 4.13 415.199251 7.856 46.790 226 5.920 219.195 24.6671 1134.82 25.4087 326.570 3732.87 23102.9 26.2837 27.1135 2130.04 66.9 100.8 151 24.6 36.5 48.6 82.8 89.8 53.1 53.6 58.2 56.4 291 359 322 370 396 395 222 333 341 342 337 31554 11589.59 15319.31 11590.48 22503.16 363.75 364.29 11571.35 11521.48 7644.32 10106.83 216.406 17.529 4.112 1.48 18.32 51.18 34.65 373.32 9.52 28.66 18.97 364.3 826.6 745 344.0195 6.357 66739300000 22853700000 1154600 2884600000 857500 20.968 53.364 53653 11.53 8.64 10.42 10.92 32.09 0.13155 4.47 1.98 2.31 1.77 2.14 3.34 1.07 4.35 1.66 1.95 3.68 7.2 4.37 2.52 4.41 683.595999 5.566 28.415 139 3.68 427.935 25.5289 2349.19 44.4267 391.211 8174.54 40344.1 26.2571 27.0785 2228.01 63 89.6 136 22.6 34.8 43.2 77.6 83.8 52.4 52 56.1 54 364 501 351 607 721 663 236 376 600 602 598 601 43295 21074.89 27597.6 20954 40868.96 655.42 655.31 20836.32 20743.8 13646.56 16889.26 119.824 9.254 3.276 66589100000 22798500000 1161100 2881300000 859400 5.595 28.421 427.078 25.4496 2348.03 44.1942 391.091 8105.73 44567 21146.01 27807.75 20953.65 40869.19 658.56 651.2 20925.87 20746.67 13752.19 17006.61 3.275 OpenBenchmarking.org
ArrayFire Test: Conjugate Gradient OpenCL OpenBenchmarking.org ms, Fewer Is Better ArrayFire 3.7 Test: Conjugate Gradient OpenCL RTX 3070 RTX 3090 0.47 0.94 1.41 1.88 2.35 SE +/- 0.001, N = 3 2.089 1.480 1. (CXX) g++ options: -rdynamic
Blender Blend File: BMW27 - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: CUDA RTX 3070 RTX 3090 7 14 21 28 35 SE +/- 0.04, N = 3 29.00 18.32
Blender Blend File: Classroom - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: CUDA RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.01, N = 3 76.06 51.18
Blender Blend File: Fishy Cat - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: CUDA RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.04, N = 3 54.69 34.65
Blender Blend File: Barbershop - Compute: CUDA OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Barbershop - Compute: CUDA RTX 3070 RTX 3090 110 220 330 440 550 SE +/- 0.17, N = 3 507.39 373.32
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3070 RTX 3090 4 8 12 16 20 SE +/- 0.01, N = 3 15.82 9.52
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX RTX 3070 RTX 3090 10 20 30 40 50 SE +/- 0.02, N = 3 45.77 28.66
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3070 RTX 3090 8 16 24 32 40 SE +/- 0.01, N = 3 33.34 18.97
cl-mem Benchmark: Copy OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Copy RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.45, N = 3 296.8 364.3 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Read OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read RTX 3070 RTX 3090 200 400 600 800 1000 SE +/- 0.30, N = 3 393.3 826.6 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Write OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write RTX 3070 RTX 3090 160 320 480 640 800 SE +/- 0.09, N = 3 382.0 745.0 1. (CC) gcc options: -O2 -flto -lOpenCL
FAHBench OpenBenchmarking.org Ns Per Day, More Is Better FAHBench 2.3.2 RTX 3070 RTX 3090 70 140 210 280 350 SE +/- 0.05, N = 3 265.51 344.02
FinanceBench Benchmark: Black-Scholes OpenCL OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.003, N = 3 10.457 6.357 1. (CXX) g++ options: -O3 -march=native -fopenmp
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: MD5 RTX 3070 RTX 3090 GeForce RTX 3090 14000M 28000M 42000M 56000M 70000M SE +/- 41756290.28, N = 3 38925166667 66739300000 66589100000
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA1 RTX 3070 RTX 3090 GeForce RTX 3090 5000M 10000M 15000M 20000M 25000M SE +/- 7750340.49, N = 3 13194833333 22853700000 22798500000
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: 7-Zip RTX 3070 RTX 3090 GeForce RTX 3090 200K 400K 600K 800K 1000K SE +/- 1128.91, N = 3 689667 1154600 1161100
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: SHA-512 RTX 3070 RTX 3090 GeForce RTX 3090 600M 1200M 1800M 2400M 3000M SE +/- 735602.55, N = 3 1673633333 2884600000 2881300000
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.1.1 Benchmark: TrueCrypt RIPEMD160 + XTS RTX 3070 RTX 3090 GeForce RTX 3090 200K 400K 600K 800K 1000K SE +/- 800.69, N = 3 503167 857500 859400
IndigoBench Acceleration: OpenCL GPU - Scene: Bedroom OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Bedroom RTX 3070 RTX 3090 5 10 15 20 25 SE +/- 0.02, N = 3 12.94 20.97
IndigoBench Acceleration: OpenCL GPU - Scene: Supercar OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.04, N = 3 37.32 53.36
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3070 RTX 3090 11K 22K 33K 44K 55K SE +/- 178.94, N = 3 37790 53653 1. (CXX) g++ options: -flto -pthread
LuxCoreRender Scene: DLSC - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: DLSC - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.00, N = 3 6.68 11.53 MIN: 6.25 / MAX: 6.94 MIN: 11.29 / MAX: 11.68
LuxCoreRender Scene: Danish Mood - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Danish Mood - Acceleration: GPU RTX 3070 RTX 3090 2 4 6 8 10 SE +/- 0.00, N = 3 5.06 8.64 MIN: 1.5 / MAX: 6.12 MIN: 2.95 / MAX: 10.48
LuxCoreRender Scene: Orange Juice - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Orange Juice - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.01, N = 3 6.99 10.42 MIN: 5.61 / MAX: 8.46 MIN: 8.45 / MAX: 13.57
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: LuxCore Benchmark - Acceleration: GPU RTX 3070 RTX 3090 3 6 9 12 15 SE +/- 0.01, N = 3 6.22 10.92 MIN: 2.05 / MAX: 7.38 MIN: 3.29 / MAX: 13.01
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.5 Scene: Rainbow Colors and Prism - Acceleration: GPU RTX 3070 RTX 3090 7 14 21 28 35 SE +/- 0.03, N = 3 21.27 32.09 MIN: 20.13 / MAX: 22.99 MIN: 28.96 / MAX: 34.45
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms RTX 3070 RTX 3090 0.0296 0.0592 0.0888 0.1184 0.148 SE +/- 0.00049, N = 3 0.12555 0.13155
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3090 RTX 3070 1.008 2.016 3.024 4.032 5.04 SE +/- 0.01, N = 3 4.48 4.31 MIN: 4.13 / MAX: 21.47 MIN: 4.25 / MAX: 5.94 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 3070 RTX 3090 0.4455 0.891 1.3365 1.782 2.2275 SE +/- 0.01, N = 3 1.91 1.98 MIN: 1.88 / MAX: 3.42 MIN: 1.84 / MAX: 7.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 3090 RTX 3070 0.5198 1.0396 1.5594 2.0792 2.599 SE +/- 0.01, N = 3 2.21 2.14 MIN: 2.05 / MAX: 17.77 MIN: 2.11 / MAX: 3.93 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 3070 RTX 3090 0.3983 0.7966 1.1949 1.5932 1.9915 SE +/- 0.01, N = 3 1.71 1.77 MIN: 1.68 / MAX: 3.55 MIN: 1.67 / MAX: 9.47 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 3090 RTX 3070 0.4815 0.963 1.4445 1.926 2.4075 SE +/- 0.01, N = 3 2.09 2.01 MIN: 1.91 / MAX: 13.69 MIN: 1.98 / MAX: 4.82 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 3090 RTX 3070 0.7538 1.5076 2.2614 3.0152 3.769 SE +/- 0.01, N = 3 3.35 3.17 MIN: 3.08 / MAX: 13.75 MIN: 3.14 / MAX: 5.06 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface RTX 3090 RTX 3070 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.00, N = 3 0.96 0.98 MIN: 0.88 / MAX: 8.42 MIN: 0.95 / MAX: 2.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3090 RTX 3070 1.2218 2.4436 3.6654 4.8872 6.109 SE +/- 0.01, N = 3 4.44 5.43 MIN: 4.12 / MAX: 17.46 MIN: 5.38 / MAX: 9.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 RTX 3090 RTX 3070 0.4073 0.8146 1.2219 1.6292 2.0365 SE +/- 0.01, N = 3 1.81 1.68 MIN: 1.52 / MAX: 16.46 MIN: 1.66 / MAX: 1.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3090 RTX 3070 0.4388 0.8776 1.3164 1.7552 2.194 SE +/- 0.01, N = 3 1.88 1.90 MIN: 1.77 / MAX: 6.33 MIN: 1.86 / MAX: 5.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3090 RTX 3070 0.8415 1.683 2.5245 3.366 4.2075 SE +/- 0.01, N = 3 3.74 3.74 MIN: 3.43 / MAX: 14.52 MIN: 3.71 / MAX: 4.06 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3090 RTX 3070 2 4 6 8 10 SE +/- 0.01, N = 3 7.66 6.57 MIN: 6.47 / MAX: 40.34 MIN: 6.33 / MAX: 6.98 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3070 RTX 3090 0.9968 1.9936 2.9904 3.9872 4.984 SE +/- 0.13, N = 3 4.43 4.37 MIN: 4.1 / MAX: 7.62 MIN: 3.93 / MAX: 23.52 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 3090 RTX 3070 0.5783 1.1566 1.7349 2.3132 2.8915 SE +/- 0.01, N = 3 2.57 2.42 MIN: 2.38 / MAX: 8.98 MIN: 2.4 / MAX: 3.84 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 3090 RTX 3070 0.9923 1.9846 2.9769 3.9692 4.9615 SE +/- 0.13, N = 2 4.38 4.13 MIN: 3.61 / MAX: 17.92 MIN: 3.77 / MAX: 13.51 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score RTX 3070 RTX 3090 150 300 450 600 750 415.20 683.60
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No RTX 3070 RTX 3090 GeForce RTX 3090 2 4 6 8 10 SE +/- 0.002, N = 3 7.856 5.566 5.595
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes RTX 3070 RTX 3090 GeForce RTX 3090 11 22 33 44 55 SE +/- 0.04, N = 3 46.79 28.42 28.42
RedShift Demo OpenBenchmarking.org Seconds, Fewer Is Better RedShift Demo 3.0 RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.33, N = 3 226 139
Rodinia Test: OpenCL Particle Filter OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter RTX 3070 RTX 3090 1.332 2.664 3.996 5.328 6.66 SE +/- 0.007, N = 3 5.920 3.680 1. (CXX) g++ options: -O2 -lOpenCL
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: S3D OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: S3D RTX 3070 RTX 3090 GeForce RTX 3090 90 180 270 360 450 SE +/- 0.17, N = 3 219.20 427.94 427.08 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Triad OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Triad RTX 3070 RTX 3090 GeForce RTX 3090 6 12 18 24 30 SE +/- 0.01, N = 3 24.67 25.53 25.45 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: FFT SP OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: FFT SP RTX 3070 RTX 3090 GeForce RTX 3090 500 1000 1500 2000 2500 SE +/- 0.78, N = 3 1134.82 2349.19 2348.03 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: MD5 Hash OpenBenchmarking.org GHash/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: MD5 Hash RTX 3070 RTX 3090 GeForce RTX 3090 10 20 30 40 50 SE +/- 0.03, N = 3 25.41 44.43 44.19 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Reduction OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Reduction RTX 3070 RTX 3090 GeForce RTX 3090 80 160 240 320 400 SE +/- 0.70, N = 3 326.57 391.21 391.09 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: GEMM SGEMM_N OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: GEMM SGEMM_N RTX 3070 RTX 3090 GeForce RTX 3090 2K 4K 6K 8K 10K SE +/- 26.69, N = 3 3732.87 8174.54 8105.73 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Max SP Flops OpenBenchmarking.org GFLOPS, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Max SP Flops RTX 3070 RTX 3090 9K 18K 27K 36K 45K SE +/- 59.20, N = 3 23102.9 40344.1 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Download OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Download RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.02, N = 3 26.28 26.26 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Bus Speed Readback OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Readback RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.01, N = 3 27.11 27.08 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
SHOC Scalable HeterOgeneous Computing Target: OpenCL - Benchmark: Texture Read Bandwidth OpenBenchmarking.org GB/s, More Is Better SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Texture Read Bandwidth RTX 3070 RTX 3090 500 1000 1500 2000 2500 SE +/- 6.58, N = 3 2130.04 2228.01 1. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi
ViennaCL Test: CPU BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY RTX 3070 RTX 3090 15 30 45 60 75 SE +/- 0.58, N = 3 66.9 63.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.73, N = 3 100.8 89.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT RTX 3070 RTX 3090 30 60 90 120 150 SE +/- 0.88, N = 3 151 136 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY RTX 3070 RTX 3090 6 12 18 24 30 SE +/- 0.03, N = 3 24.6 22.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY RTX 3070 RTX 3090 8 16 24 32 40 SE +/- 0.32, N = 3 36.5 34.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT RTX 3070 RTX 3090 11 22 33 44 55 SE +/- 0.50, N = 3 48.6 43.2 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.09, N = 3 82.8 77.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T RTX 3070 RTX 3090 20 40 60 80 100 SE +/- 0.10, N = 3 89.8 83.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.26, N = 3 53.1 52.4 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT RTX 3070 RTX 3090 12 24 36 48 60 SE +/- 0.12, N = 3 53.6 52.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.00, N = 3 58.2 56.1 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT RTX 3070 RTX 3090 13 26 39 52 65 SE +/- 0.09, N = 3 56.4 54.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.58, N = 3 291 364 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY RTX 3070 RTX 3090 110 220 330 440 550 SE +/- 0.33, N = 3 359 501 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.67, N = 3 322 351 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 0.33, N = 3 370 607 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY RTX 3070 RTX 3090 160 320 480 640 800 SE +/- 0.00, N = 3 396 721 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT RTX 3070 RTX 3090 140 280 420 560 700 SE +/- 0.00, N = 3 395 663 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.58, N = 3 222 236 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T RTX 3070 RTX 3090 80 160 240 320 400 SE +/- 0.67, N = 3 333 376 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 341 600 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT RTX 3070 RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 342 602 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN RTX 3070 RTX 3090 130 260 390 520 650 337 598 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT RTX 3090 130 260 390 520 650 601 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 RTX 3070 RTX 3090 GeForce RTX 3090 10K 20K 30K 40K 50K SE +/- 172.10, N = 3 31554 43295 44567 1. (CXX) g++ options: -O3 -pthread
vkpeak fp32-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-scalar GeForce RTX 3090 RTX 3070 RTX 3090 5K 10K 15K 20K 25K SE +/- 35.78, N = 3 20871.36 11589.59 21074.89
vkpeak fp32-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp32-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 6K 12K 18K 24K 30K SE +/- 35.81, N = 3 27390.08 15319.31 27597.60
vkpeak fp16-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-scalar GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 26.04, N = 3 20714.14 11590.48 20954.00
vkpeak fp16-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp16-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 9K 18K 27K 36K 45K SE +/- 71.70, N = 3 40423.41 22503.16 40868.96
vkpeak fp64-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-scalar GeForce RTX 3090 RTX 3070 RTX 3090 140 280 420 560 700 SE +/- 0.36, N = 3 651.31 363.75 655.42
vkpeak fp64-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20210424 fp64-vec4 RTX 3070 RTX 3090 GeForce RTX 3090 140 280 420 560 700 SE +/- 0.42, N = 3 364.29 655.31 651.20
vkpeak int32-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-scalar GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 16.33, N = 3 20687.55 11571.35 20836.32
vkpeak int32-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int32-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 18.17, N = 3 20597.19 11521.48 20743.80
vkpeak int16-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-scalar GeForce RTX 3090 RTX 3070 RTX 3090 3K 6K 9K 12K 15K SE +/- 11.41, N = 3 13655.97 7644.32 13646.56
vkpeak int16-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20210424 int16-vec4 GeForce RTX 3090 RTX 3070 RTX 3090 4K 8K 12K 16K 20K SE +/- 20.90, N = 3 16887.92 10106.83 16889.26
VkResample Upscale: 2x - Precision: Double OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double RTX 3070 RTX 3090 50 100 150 200 250 SE +/- 0.03, N = 3 216.41 119.82 1. (CXX) g++ options: -O3 -pthread
VkResample Upscale: 2x - Precision: Single OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single RTX 3070 RTX 3090 4 8 12 16 20 SE +/- 0.013, N = 3 17.529 9.254 1. (CXX) g++ options: -O3 -pthread
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes RTX 3070 RTX 3090 GeForce RTX 3090 0.9252 1.8504 2.7756 3.7008 4.626 SE +/- 0.006, N = 3 4.112 3.276 3.275
Phoronix Test Suite v10.8.5