nvidia linux Tests for a future article. AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3080 10GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2110101-TJ-NVIDIALIN34&sor&grw .
nvidia linux Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB eVGA NVIDIA GeForce GTX 1660 Ti 6GB NVIDIA TU116 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 20.04 5.11.0-37-generic (x86_64) GNOME Shell 3.36.9 X Server 1.20.11 NVIDIA 470.74 4.6.0 OpenCL 3.0 CUDA 11.4.136 1.2.175 GCC 9.3.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio eVGA NVIDIA GeForce GTX 1660 SUPER 6GB NVIDIA TU116 HD Audio eVGA NVIDIA GeForce RTX 3060 12GB NVIDIA Device 228e NVIDIA GeForce RTX 2070 SUPER 8GB NVIDIA TU104 HD Audio ASUS NVIDIA GeForce RTX 2070 8GB NVIDIA TU106 HD Audio NVIDIA GeForce RTX 2060 SUPER 8GB NVIDIA GeForce RTX 2060 6GB NVIDIA GeForce RTX 3060 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 Ti 12GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3090 24GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 10GB NVIDIA Device 1aef OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016 Graphics Details - GTX 1660Ti: BAR1 / Visible vRAM Size: 256 MiB - GTX 1060: BAR1 / Visible vRAM Size: 256 MiB - GTX 1660 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - NVIDIA RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - RTX 2070 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2070: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080Ti: BAR1 / Visible vRAM Size: 16384 MiB - RTX 3070: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - NVIDIA RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - 3090: BAR1 / Visible vRAM Size: 32768 MiB - RTX 3070 Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080: BAR1 / Visible vRAM Size: 256 MiB OpenCL Details - GTX 1660Ti: GPU Compute Cores: 1536 - GTX 1060: GPU Compute Cores: 1280 - GTX 1660 SUPER: GPU Compute Cores: 1408 - RTX 3060: GPU Compute Cores: 3584 - NVIDIA RTX 3060: GPU Compute Cores: 3584 - RTX 2070 SUPER: GPU Compute Cores: 2560 - RTX 2070: GPU Compute Cores: 2304 - RTX 2060 SUPER: GPU Compute Cores: 2176 - RTX 2060: GPU Compute Cores: 1920 - RTX 3060Ti: GPU Compute Cores: 4864 - RTX 3080Ti: GPU Compute Cores: 10240 - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - NVIDIA RTX 3090: GPU Compute Cores: 10496 - 3090: GPU Compute Cores: 10496 - RTX 3070 Ti: GPU Compute Cores: 6144 - RTX 3080: GPU Compute Cores: 8704 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected Compiler Details - RTX 3060, NVIDIA RTX 3060, RTX 2070 SUPER, RTX 2070, RTX 2060 SUPER, RTX 2060, RTX 3060Ti, RTX 3080Ti, RTX 3070, RTX 3090, NVIDIA RTX 3090, 3090, RTX 3070 Ti, RTX 3080: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
nvidia linux etlegacy: 3840 x 2160 lczero: OpenCL ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m v-ray: NVIDIA CUDA GPU v-ray: NVIDIA RTX GPU blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX gravitymark: 2560 x 1440 - OpenGL hashcat: MD5 gravitymark: 1920 x 1080 - OpenGL hashcat: SHA1 gravitymark: 1920 x 1080 - Vulkan hashcat: 7-Zip gravitymark: 3840 x 2160 - OpenGL hashcat: SHA-512 gravitymark: 3840 x 2160 - Vulkan hashcat: TrueCrypt RIPEMD160 + XTS namd-cuda: ATPase Simulation - 327,506 Atoms octanebench: Total Score realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes gravitymark: 2560 x 1440 - Vulkan vkfft: waifu2x-ncnn: 2x - 3 - Yes GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 495.2 442 19620766667 6702033333 355133 854600000 253767 133.125997 445.2 249 13119800000 4455966667 189133 483533333 137633 81.44449 482.9 456 18355966667 6235366667 330833 792333333 235133 133.086823 22236 4.38 1.92 2.14 1.70 2.02 3.21 0.95 4.30 7.24 1.90 2.07 4.17 6.71 4.77 2.42 1207 26.10 73.10 56.45 0.15237 10.456 68.156 4.978 590.6 4.39 1.91 2.15 1.71 2.01 3.24 0.95 4.28 7.25 1.93 2.07 4.18 6.73 4.83 2.41 851 93.3 24825266667 110.4 7790600000 149.3 410267 72.8 992833333 84.0 291333 294.020104 120.0 27278 630.7 21079 4.13 1.72 1.94 1.59 1.78 2.92 0.91 3.86 7.90 1.90 2.31 3.94 6.85 4.74 2.17 834 1055 28.10 89.01 52.85 96.7 35928633333 114.4 11276666667 149.6 580233 74.6 1438900000 83.6 416900 0.14020 261.828555 10.093 63.881 121.4 29335 4.848 591.6 17674 4.30 1.79 2.02 1.64 1.85 3.05 0.93 4.13 8.78 2 2.45 4.19 7.01 4.90 2.24 513 798 30.10 146.40 59.97 86.4 30641800000 101.5 9694933333 139.1 491500 66.5 1224300000 78.4 353967 0.15287 244.190524 11.524 75.692 112.5 30028 5.353 559.7 17484 4.26 1.76 1.97 1.6 1.81 2.96 0.91 4.19 8.87 1.99 2.42 4.16 7.01 4.90 2.19 528 826 29.89 142.69 60.30 87.8 29907933333 103.9 9468200000 138.8 482933 67.5 1198700000 77.8 348033 0.15476 243.812534 11.671 76.681 112.0 29970 5.317 557.6 14473 4.40 1.80 2.00 1.63 1.86 3.02 0.93 4.21 9.96 2.19 2.63 4.49 7.25 5.16 2.25 505 733 36.03 146.87 69.56 79.5 26593433333 94.9 8390766667 116.4 435700 59.5 1062933333 64.3 305833 0.16856 195.639962 12.901 86.359 93.0 22746 5.844 645.3 30371 4.17 1.88 2.11 1.67 1.98 3.13 0.93 4.14 5.76 1.70 1.90 3.80 6.30 4.27 2.37 1260 1716 17.42 52.05 39.00 113.5 35414300000 132.1 11069666667 188.0 569333 89.8 1412966667 108.5 417467 0.12830 384.119086 8.384 51.297 153.3 33746 4.287 646.5 38444 4.01 1.83 2.09 1.67 1.94 3.12 0.88 4.11 4.13 1.53 1.76 3.47 5.85 4.15 2.39 2052 2850 9.70 29.61 19.80 147.6 68466466667 164.7 21732166667 262.5 1066767 125.8 2762600000 173.5 805133 0.11958 668.016818 5.729 29.814 226.1 43263 3.355 645.5 32980 4.10 1.87 2.11 1.67 1.97 3.13 0.93 4.24 5.43 1.64 1.87 3.73 6.15 4.32 2.39 1418 1880 15.69 45.71 33.30 117.3 41900433333 134.9 13140600000 201.3 663433 93.6 1682733333 116.1 488467 0.12726 414.231909 7.898 47.047 164.0 31446 4.123 654.5 39001 4.00 1.81 2.06 1.65 1.93 3.08 0.88 4.02 4.01 1.52 1.74 3.41 5.82 3.92 2.37 2111 2928 9.42 28.61 18.99 153.3 72520866667 169.7 22954666667 269.2 1113033 130.3 2890933333 178.6 832767 0.12001 684.778798 5.614 28.744 232.7 44486 3.314 581.5 4 1.82 2.06 1.66 1.92 3.08 0.87 4.08 4.03 1.51 1.74 3.41 5.85 4.10 2.36 2112 9.44 28.51 19.00 70873300000 170.1 22570933333 269.3 1104300 2857066667 818267 680.453461 43830 667.2 38687 4 1.82 2.07 1.66 1.92 3.09 0.88 3.92 4.04 1.51 1.74 3.42 5.88 4.13 2.37 2111 2917 9.44 28.56 19.01 153.3 70253400000 169.4 22452233333 269.9 1101967 130.7 2861100000 178.5 822167 0.11951 680.626427 5.606 28.729 233.4 43849 3.310 648.3 35401 4.02 1.81 2.06 1.65 1.92 3.09 0.93 3.93 5.07 1.62 1.79 3.59 6.12 4.34 2.34 1501 2034 14.38 42.76 31.44 118.7 42901566667 136.4 13536633333 212.2 709967 96.2 1717533333 128.9 505733 0.12415 454.752121 7.155 41.302 176.5 37970 3.820 639.3 38103 3.96 1.79 2.04 1.64 1.90 3.05 0.88 3.90 4.36 1.52 1.75 3.40 5.86 4.10 2.32 1774 2446 11.24 33.85 22.67 143.1 61586233333 160.6 19440866667 248.2 972500 120.2 2466033333 158.1 724700 0.12250 570.414463 6.113 32.845 210.4 40852 3.444 OpenBenchmarking.org
ET: Legacy Resolution: 3840 x 2160 OpenBenchmarking.org Frames Per Second, More Is Better ET: Legacy 2.78 Resolution: 3840 x 2160 3090 RTX 3090 RTX 3070 Ti RTX 3080Ti RTX 3070 RTX 3060Ti RTX 3080 RTX 2070 SUPER RTX 2070 NVIDIA RTX 3060 NVIDIA RTX 3090 RTX 2060 SUPER RTX 2060 GTX 1660Ti GTX 1660 SUPER GTX 1060 140 280 420 560 700 SE +/- 1.66, N = 3 SE +/- 6.42, N = 5 SE +/- 4.84, N = 3 SE +/- 1.67, N = 3 SE +/- 6.77, N = 3 SE +/- 3.68, N = 3 SE +/- 1.47, N = 3 SE +/- 1.83, N = 3 SE +/- 2.35, N = 3 SE +/- 2.08, N = 3 SE +/- 72.37, N = 9 SE +/- 26.17, N = 12 SE +/- 0.44, N = 3 SE +/- 4.09, N = 3 SE +/- 3.91, N = 3 SE +/- 1.20, N = 3 667.2 654.5 648.3 646.5 645.5 645.3 639.3 630.7 591.6 590.6 581.5 559.7 557.6 495.2 482.9 445.2
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 8K 16K 24K 32K 40K SE +/- 412.81, N = 3 SE +/- 278.45, N = 3 SE +/- 111.06, N = 3 SE +/- 230.16, N = 3 SE +/- 231.99, N = 3 SE +/- 232.47, N = 3 SE +/- 168.30, N = 3 SE +/- 125.30, N = 3 SE +/- 129.25, N = 3 SE +/- 144.05, N = 3 SE +/- 87.16, N = 3 SE +/- 59.29, N = 3 39001 38687 38444 38103 35401 32980 30371 22236 21079 17674 17484 14473 1. (CXX) g++ options: -flto -pthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3080 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2060 SUPER RTX 2070 RTX 3060 NVIDIA RTX 3060 RTX 2060 0.99 1.98 2.97 3.96 4.95 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 3.96 4.00 4.00 4.00 4.01 4.02 4.10 4.13 4.17 4.26 4.30 4.38 4.39 4.40 MIN: 3.89 / MAX: 4.55 MIN: 3.92 / MAX: 7.83 MIN: 3.94 / MAX: 4.48 MIN: 3.95 / MAX: 4.44 MIN: 3.96 / MAX: 4.13 MIN: 3.97 / MAX: 4.21 MIN: 4.05 / MAX: 4.23 MIN: 4.09 / MAX: 6.52 MIN: 4.12 / MAX: 4.36 MIN: 4.2 / MAX: 4.47 MIN: 4.21 / MAX: 12.49 MIN: 4.31 / MAX: 4.57 MIN: 4.33 / MAX: 4.54 MIN: 4.35 / MAX: 4.57 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 3080 RTX 2060 RTX 3090 RTX 3070 Ti NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 3060 0.432 0.864 1.296 1.728 2.16 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.72 1.76 1.79 1.79 1.80 1.81 1.81 1.82 1.82 1.83 1.87 1.88 1.91 1.92 MIN: 1.7 / MAX: 3.09 MIN: 1.73 / MAX: 2.62 MIN: 1.76 / MAX: 2.81 MIN: 1.77 / MAX: 3.16 MIN: 1.78 / MAX: 2.99 MIN: 1.79 / MAX: 3.1 MIN: 1.79 / MAX: 4.69 MIN: 1.79 / MAX: 8.7 MIN: 1.79 / MAX: 4.97 MIN: 1.81 / MAX: 4.77 MIN: 1.84 / MAX: 4.81 MIN: 1.84 / MAX: 5.51 MIN: 1.89 / MAX: 2.84 MIN: 1.88 / MAX: 8.45 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 2070 SUPER RTX 2060 SUPER RTX 2060 RTX 2070 RTX 3080 RTX 3090 NVIDIA RTX 3090 RTX 3070 Ti 3090 RTX 3080Ti RTX 3060Ti RTX 3070 RTX 3060 NVIDIA RTX 3060 0.4838 0.9676 1.4514 1.9352 2.419 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.94 1.97 2.00 2.02 2.04 2.06 2.06 2.06 2.07 2.09 2.11 2.11 2.14 2.15 MIN: 1.92 / MAX: 3 MIN: 1.95 / MAX: 3.04 MIN: 1.98 / MAX: 2.91 MIN: 2 / MAX: 4.82 MIN: 2.02 / MAX: 2.27 MIN: 2.05 / MAX: 2.49 MIN: 2.04 / MAX: 2.62 MIN: 2.04 / MAX: 4.66 MIN: 2.05 / MAX: 2.62 MIN: 2.06 / MAX: 4.83 MIN: 2.07 / MAX: 4.83 MIN: 2.08 / MAX: 3.71 MIN: 2.11 / MAX: 4.76 MIN: 2.12 / MAX: 4.81 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 2070 SUPER RTX 2060 SUPER RTX 2060 RTX 2070 RTX 3080 RTX 3090 RTX 3070 Ti NVIDIA RTX 3090 3090 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3060 NVIDIA RTX 3060 0.3848 0.7696 1.1544 1.5392 1.924 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.59 1.60 1.63 1.64 1.64 1.65 1.65 1.66 1.66 1.67 1.67 1.67 1.70 1.71 MIN: 1.57 / MAX: 2.93 MIN: 1.59 / MAX: 2.59 MIN: 1.61 / MAX: 2.77 MIN: 1.62 / MAX: 2.66 MIN: 1.61 / MAX: 2.43 MIN: 1.64 / MAX: 2.43 MIN: 1.62 / MAX: 6.14 MIN: 1.63 / MAX: 2.59 MIN: 1.63 / MAX: 2.99 MIN: 1.64 / MAX: 2.7 MIN: 1.65 / MAX: 2.01 MIN: 1.64 / MAX: 3.01 MIN: 1.68 / MAX: 2.76 MIN: 1.69 / MAX: 2.81 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 RTX 3080 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3090 RTX 3080Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 3060 0.4545 0.909 1.3635 1.818 2.2725 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.78 1.81 1.85 1.86 1.90 1.92 1.92 1.92 1.93 1.94 1.97 1.98 2.01 2.02 MIN: 1.76 / MAX: 2.56 MIN: 1.8 / MAX: 2.09 MIN: 1.83 / MAX: 2.02 MIN: 1.83 / MAX: 4.81 MIN: 1.87 / MAX: 8.44 MIN: 1.9 / MAX: 2.79 MIN: 1.89 / MAX: 4.81 MIN: 1.89 / MAX: 4.79 MIN: 1.91 / MAX: 8.55 MIN: 1.92 / MAX: 3.04 MIN: 1.94 / MAX: 4.81 MIN: 1.95 / MAX: 8.5 MIN: 1.98 / MAX: 5.81 MIN: 1.97 / MAX: 12.09 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 2070 SUPER RTX 2060 SUPER RTX 2060 RTX 2070 RTX 3080 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080Ti RTX 3060Ti RTX 3070 RTX 3060 NVIDIA RTX 3060 0.729 1.458 2.187 2.916 3.645 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.92 2.96 3.02 3.05 3.05 3.08 3.08 3.09 3.09 3.12 3.13 3.13 3.21 3.24 MIN: 2.88 / MAX: 5.47 MIN: 2.92 / MAX: 9.52 MIN: 2.99 / MAX: 5.02 MIN: 3.02 / MAX: 4.81 MIN: 3.02 / MAX: 3.36 MIN: 3.06 / MAX: 4.67 MIN: 3.04 / MAX: 4.85 MIN: 3.06 / MAX: 6.04 MIN: 3.05 / MAX: 4.84 MIN: 3.09 / MAX: 4.84 MIN: 3.1 / MAX: 4.87 MIN: 3.1 / MAX: 4.82 MIN: 3.18 / MAX: 4.81 MIN: 3.19 / MAX: 4.87 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface NVIDIA RTX 3090 RTX 3080Ti RTX 3090 3090 RTX 3080 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 RTX 3060Ti RTX 3070 RTX 3070 Ti RTX 3060 NVIDIA RTX 3060 0.2138 0.4276 0.6414 0.8552 1.069 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.87 0.88 0.88 0.88 0.88 0.91 0.91 0.93 0.93 0.93 0.93 0.93 0.95 0.95 MIN: 0.85 / MAX: 1.89 MIN: 0.86 / MAX: 1.84 MIN: 0.85 / MAX: 1.76 MIN: 0.85 / MAX: 1.71 MIN: 0.86 / MAX: 1.91 MIN: 0.88 / MAX: 1.8 MIN: 0.89 / MAX: 1.94 MIN: 0.9 / MAX: 2.01 MIN: 0.91 / MAX: 2 MIN: 0.91 / MAX: 1.68 MIN: 0.91 / MAX: 1.8 MIN: 0.91 / MAX: 1.99 MIN: 0.93 / MAX: 1.89 MIN: 0.93 / MAX: 1.92 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 2070 SUPER RTX 3080 3090 RTX 3070 Ti RTX 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 2070 RTX 3060Ti RTX 2060 SUPER RTX 2060 RTX 3070 NVIDIA RTX 3060 RTX 3060 0.9675 1.935 2.9025 3.87 4.8375 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.00, N = 2 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 2 SE +/- 0.00, N = 2 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 3.86 3.90 3.92 3.93 4.02 4.08 4.11 4.13 4.14 4.19 4.21 4.24 4.28 4.30 MIN: 3.44 / MAX: 11.03 MIN: 3.51 / MAX: 17.33 MIN: 3.57 / MAX: 18.33 MIN: 3.59 / MAX: 13.6 MIN: 3.57 / MAX: 16.52 MIN: 3.57 / MAX: 15.4 MIN: 3.62 / MAX: 17.74 MIN: 3.63 / MAX: 11.49 MIN: 3.75 / MAX: 13.91 MIN: 3.57 / MAX: 12.23 MIN: 3.71 / MAX: 19.56 MIN: 3.72 / MAX: 13.94 MIN: 3.91 / MAX: 22.46 MIN: 3.91 / MAX: 15 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 4.01 4.03 4.04 4.13 4.36 5.07 5.43 5.76 7.24 7.25 7.90 8.78 8.87 9.96 MIN: 3.97 / MAX: 6.67 MIN: 3.98 / MAX: 10.03 MIN: 3.98 / MAX: 13.19 MIN: 4.1 / MAX: 7.68 MIN: 4.31 / MAX: 6.26 MIN: 5.02 / MAX: 9.32 MIN: 5.33 / MAX: 19.97 MIN: 5.68 / MAX: 13.67 MIN: 7.11 / MAX: 16.52 MIN: 7.15 / MAX: 16.65 MIN: 7.39 / MAX: 17.42 MIN: 8.15 / MAX: 25.5 MIN: 8.62 / MAX: 23.64 MIN: 9.52 / MAX: 24.93 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 NVIDIA RTX 3090 3090 RTX 3090 RTX 3080 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.51 1.51 1.52 1.52 1.53 1.62 1.64 1.70 1.90 1.90 1.93 1.99 2.00 2.19 MIN: 1.49 / MAX: 1.76 MIN: 1.49 / MAX: 1.7 MIN: 1.49 / MAX: 4.09 MIN: 1.49 / MAX: 2.49 MIN: 1.51 / MAX: 1.76 MIN: 1.61 / MAX: 3.82 MIN: 1.62 / MAX: 1.88 MIN: 1.68 / MAX: 4.79 MIN: 1.88 / MAX: 2.08 MIN: 1.88 / MAX: 2.05 MIN: 1.88 / MAX: 12.22 MIN: 1.97 / MAX: 2.15 MIN: 1.98 / MAX: 2.13 MIN: 2.17 / MAX: 2.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3090 NVIDIA RTX 3090 3090 RTX 3080 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 0.5918 1.1836 1.7754 2.3672 2.959 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.74 1.74 1.74 1.75 1.76 1.79 1.87 1.90 2.07 2.07 2.31 2.42 2.45 2.63 MIN: 1.72 / MAX: 1.89 MIN: 1.72 / MAX: 1.94 MIN: 1.72 / MAX: 1.92 MIN: 1.72 / MAX: 4.78 MIN: 1.74 / MAX: 1.92 MIN: 1.78 / MAX: 1.94 MIN: 1.83 / MAX: 4.81 MIN: 1.85 / MAX: 8.61 MIN: 2.03 / MAX: 5.86 MIN: 2.05 / MAX: 2.22 MIN: 2.06 / MAX: 3.47 MIN: 2.34 / MAX: 2.93 MIN: 2.39 / MAX: 4.82 MIN: 2.51 / MAX: 4.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3080 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 2060 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 RTX 2060 1.0103 2.0206 3.0309 4.0412 5.0515 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 3.40 3.41 3.41 3.42 3.47 3.59 3.73 3.80 3.94 4.16 4.17 4.18 4.19 4.49 MIN: 3.37 / MAX: 3.58 MIN: 3.39 / MAX: 3.54 MIN: 3.39 / MAX: 4.83 MIN: 3.4 / MAX: 8.52 MIN: 3.45 / MAX: 4.72 MIN: 3.56 / MAX: 4.82 MIN: 3.67 / MAX: 4.82 MIN: 3.76 / MAX: 13.08 MIN: 3.91 / MAX: 4.89 MIN: 4.14 / MAX: 4.83 MIN: 4.15 / MAX: 4.26 MIN: 4.15 / MAX: 4.48 MIN: 4.16 / MAX: 4.31 MIN: 4.47 / MAX: 4.83 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3090 RTX 3080Ti NVIDIA RTX 3090 RTX 3080 3090 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 5.82 5.85 5.85 5.86 5.88 6.12 6.15 6.30 6.71 6.73 6.85 7.01 7.01 7.25 MIN: 5.57 / MAX: 6.24 MIN: 5.59 / MAX: 10.87 MIN: 5.6 / MAX: 6.5 MIN: 5.61 / MAX: 6.37 MIN: 5.58 / MAX: 12.45 MIN: 5.9 / MAX: 6.51 MIN: 5.94 / MAX: 6.41 MIN: 6.11 / MAX: 6.59 MIN: 6.58 / MAX: 7.1 MIN: 6.6 / MAX: 6.89 MIN: 6.66 / MAX: 7.27 MIN: 6.91 / MAX: 10.62 MIN: 6.92 / MAX: 16.05 MIN: 7.17 / MAX: 7.38 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3090 NVIDIA RTX 3090 RTX 3080 3090 RTX 3080Ti RTX 3060Ti RTX 3070 RTX 3070 Ti RTX 2070 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 1.161 2.322 3.483 4.644 5.805 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 2 SE +/- 0.17, N = 2 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 3.92 4.10 4.10 4.13 4.15 4.27 4.32 4.34 4.74 4.77 4.83 4.90 4.90 5.16 MIN: 3.85 / MAX: 4.41 MIN: 3.84 / MAX: 8.44 MIN: 3.89 / MAX: 8.62 MIN: 3.89 / MAX: 6.1 MIN: 3.9 / MAX: 7.31 MIN: 4.16 / MAX: 4.55 MIN: 4.04 / MAX: 9.9 MIN: 4.04 / MAX: 7.74 MIN: 4.52 / MAX: 9.57 MIN: 4.67 / MAX: 5.06 MIN: 4.63 / MAX: 14.6 MIN: 4.65 / MAX: 7.98 MIN: 4.66 / MAX: 8.68 MIN: 4.86 / MAX: 21.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 RTX 3080 RTX 3070 Ti NVIDIA RTX 3090 RTX 3060Ti RTX 3090 3090 RTX 3080Ti RTX 3070 NVIDIA RTX 3060 RTX 3060 0.5445 1.089 1.6335 2.178 2.7225 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 2.17 2.19 2.24 2.25 2.32 2.34 2.36 2.37 2.37 2.37 2.39 2.39 2.41 2.42 MIN: 2.15 / MAX: 2.49 MIN: 2.17 / MAX: 2.95 MIN: 2.23 / MAX: 2.46 MIN: 2.2 / MAX: 2.77 MIN: 2.3 / MAX: 3.35 MIN: 2.31 / MAX: 3.52 MIN: 2.35 / MAX: 2.94 MIN: 2.35 / MAX: 2.95 MIN: 2.35 / MAX: 2.86 MIN: 2.35 / MAX: 3.22 MIN: 2.36 / MAX: 2.88 MIN: 2.36 / MAX: 2.74 MIN: 2.39 / MAX: 3.22 MIN: 2.37 / MAX: 10.64 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Chaos Group V-RAY Mode: NVIDIA CUDA GPU OpenBenchmarking.org vpaths, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA CUDA GPU NVIDIA RTX 3090 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 GTX 1660 SUPER GTX 1660Ti GTX 1060 500 1000 1500 2000 2500 SE +/- 2.33, N = 3 SE +/- 2.19, N = 3 SE +/- 2.60, N = 3 SE +/- 1.86, N = 3 SE +/- 1.86, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 1.15, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 2112 2111 2111 2052 1774 1501 1418 1260 851 834 528 513 505 456 442 249
Chaos Group V-RAY Mode: NVIDIA RTX GPU OpenBenchmarking.org vrays, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA RTX GPU RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 600 1200 1800 2400 3000 SE +/- 3.00, N = 3 SE +/- 8.88, N = 3 SE +/- 6.06, N = 3 SE +/- 4.73, N = 3 SE +/- 1.76, N = 3 SE +/- 1.00, N = 3 SE +/- 2.40, N = 3 SE +/- 1.45, N = 3 SE +/- 1.67, N = 3 SE +/- 0.88, N = 3 2928 2917 2850 2446 2034 1880 1716 1207 1055 826 798 733
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 8 16 24 32 40 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 2.63, N = 15 SE +/- 2.61, N = 15 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 9.42 9.44 9.44 9.70 11.24 14.38 15.69 17.42 26.10 28.10 29.89 30.10 36.03
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX NVIDIA RTX 3090 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 30 60 90 120 150 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.30, N = 3 SE +/- 1.28, N = 3 SE +/- 1.24, N = 3 SE +/- 1.05, N = 3 28.51 28.56 28.61 29.61 33.85 42.76 45.71 52.05 73.10 89.01 142.69 146.40 146.87
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 15 30 45 60 75 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 2.69, N = 15 SE +/- 2.71, N = 15 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 18.99 19.00 19.01 19.80 22.67 31.44 33.30 39.00 52.85 56.45 59.97 60.30 69.56
GravityMark Resolution: 2560 x 1440 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: OpenGL 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 30 60 90 120 150 SE +/- 0.69, N = 3 SE +/- 0.35, N = 3 SE +/- 0.64, N = 3 SE +/- 0.42, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.40, N = 3 SE +/- 0.22, N = 3 SE +/- 0.12, N = 3 SE +/- 0.20, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 153.3 153.3 147.6 143.1 118.7 117.3 113.5 96.7 93.3 87.8 86.4 79.5
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 16000M 32000M 48000M 64000M 80000M SE +/- 151860520.80, N = 3 SE +/- 89401584.62, N = 3 SE +/- 43362195.52, N = 3 SE +/- 278660763.49, N = 3 SE +/- 122029850.63, N = 3 SE +/- 53053631.15, N = 3 SE +/- 52398642.90, N = 3 SE +/- 34379515.86, N = 3 SE +/- 62466737.82, N = 3 SE +/- 11557248.81, N = 3 SE +/- 53112532.52, N = 3 SE +/- 58270127.66, N = 3 SE +/- 12235785.40, N = 3 SE +/- 33080726.18, N = 3 SE +/- 61580741.94, N = 3 SE +/- 4813522.62, N = 3 72520866667 70873300000 70253400000 68466466667 61586233333 42901566667 41900433333 35928633333 35414300000 30641800000 29907933333 26593433333 24825266667 19620766667 18355966667 13119800000
GravityMark Resolution: 1920 x 1080 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: OpenGL NVIDIA RTX 3090 RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 40 80 120 160 200 SE +/- 0.44, N = 3 SE +/- 0.22, N = 3 SE +/- 0.72, N = 3 SE +/- 0.12, N = 3 SE +/- 0.50, N = 3 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.50, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.43, N = 3 170.1 169.7 169.4 164.7 160.6 136.4 134.9 132.1 114.4 110.4 103.9 101.5 94.9
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 5000M 10000M 15000M 20000M 25000M SE +/- 52625416.34, N = 3 SE +/- 40688750.83, N = 3 SE +/- 42808501.23, N = 3 SE +/- 54926142.33, N = 3 SE +/- 36421620.56, N = 3 SE +/- 7460414.05, N = 3 SE +/- 17350024.02, N = 3 SE +/- 14748144.89, N = 3 SE +/- 11142461.33, N = 3 SE +/- 36354107.21, N = 3 SE +/- 5602677.93, N = 3 SE +/- 19016338.00, N = 3 SE +/- 4454585.65, N = 3 SE +/- 16083670.12, N = 3 SE +/- 10383694.48, N = 3 SE +/- 2008592.65, N = 3 22954666667 22570933333 22452233333 21732166667 19440866667 13536633333 13140600000 11276666667 11069666667 9694933333 9468200000 8390766667 7790600000 6702033333 6235366667 4455966667
GravityMark Resolution: 1920 x 1080 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: Vulkan 3090 NVIDIA RTX 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 60 120 180 240 300 SE +/- 0.58, N = 3 SE +/- 0.03, N = 3 SE +/- 0.50, N = 3 SE +/- 0.20, N = 3 SE +/- 0.20, N = 3 SE +/- 0.32, N = 3 SE +/- 0.29, N = 3 SE +/- 0.27, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 269.9 269.3 269.2 262.5 248.2 212.2 201.3 188.0 149.6 149.3 139.1 138.8 116.4
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 200K 400K 600K 800K 1000K SE +/- 5304.82, N = 3 SE +/- 1587.45, N = 3 SE +/- 920.75, N = 3 SE +/- 1767.61, N = 3 SE +/- 2685.76, N = 3 SE +/- 1785.43, N = 3 SE +/- 1897.66, N = 3 SE +/- 783.87, N = 3 SE +/- 696.02, N = 3 SE +/- 493.29, N = 3 SE +/- 669.16, N = 3 SE +/- 680.69, N = 3 SE +/- 533.33, N = 3 SE +/- 712.59, N = 3 SE +/- 504.42, N = 3 SE +/- 578.31, N = 3 1113033 1104300 1101967 1066767 972500 709967 663433 580233 569333 491500 482933 435700 410267 355133 330833 189133
GravityMark Resolution: 3840 x 2160 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: OpenGL 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 30 60 90 120 150 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.17, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 130.7 130.3 125.8 120.2 96.2 93.6 89.8 74.6 72.8 67.5 66.5 59.5
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 600M 1200M 1800M 2400M 3000M SE +/- 5366666.67, N = 3 SE +/- 1715614.56, N = 3 SE +/- 1039764.93, N = 3 SE +/- 4194043.40, N = 3 SE +/- 4117577.50, N = 3 SE +/- 829323.69, N = 3 SE +/- 3238483.87, N = 3 SE +/- 152752.52, N = 3 SE +/- 4611700.10, N = 3 SE +/- 568624.07, N = 3 SE +/- 1500000.00, N = 3 SE +/- 1560270.63, N = 3 SE +/- 1083717.88, N = 3 SE +/- 115470.05, N = 3 SE +/- 864741.45, N = 3 SE +/- 66666.67, N = 3 2890933333 2861100000 2857066667 2762600000 2466033333 1717533333 1682733333 1438900000 1412966667 1224300000 1198700000 1062933333 992833333 854600000 792333333 483533333
GravityMark Resolution: 3840 x 2160 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: Vulkan RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 40 80 120 160 200 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.18, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 178.6 178.5 173.5 158.1 128.9 116.1 108.5 84.0 83.6 78.4 77.8 64.3
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 200K 400K 600K 800K 1000K SE +/- 5546.87, N = 3 SE +/- 296.27, N = 3 SE +/- 688.80, N = 3 SE +/- 7319.46, N = 3 SE +/- 2706.17, N = 3 SE +/- 2906.51, N = 3 SE +/- 4139.78, N = 3 SE +/- 3507.29, N = 3 SE +/- 2318.05, N = 3 SE +/- 2602.78, N = 3 SE +/- 317.98, N = 3 SE +/- 1975.12, N = 3 SE +/- 600.93, N = 3 SE +/- 533.33, N = 3 SE +/- 554.78, N = 3 SE +/- 33.33, N = 3 832767 822167 818267 805133 724700 505733 488467 417467 416900 353967 348033 305833 291333 253767 235133 137633
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms 3090 RTX 3080Ti RTX 3090 RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 0.0379 0.0758 0.1137 0.1516 0.1895 SE +/- 0.00003, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00103, N = 3 SE +/- 0.00140, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00094, N = 3 SE +/- 0.00006, N = 3 SE +/- 0.00012, N = 3 SE +/- 0.00015, N = 3 SE +/- 0.00047, N = 3 SE +/- 0.00063, N = 3 SE +/- 0.00014, N = 3 0.11951 0.11958 0.12001 0.12250 0.12415 0.12726 0.12830 0.14020 0.15237 0.15287 0.15476 0.16856
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 GTX 1660Ti GTX 1660 SUPER GTX 1060 150 300 450 600 750 684.78 680.63 680.45 668.02 570.41 454.75 414.23 384.12 294.02 261.83 244.19 243.81 195.64 133.13 133.09 81.44
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 3 6 9 12 15 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.028, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 SE +/- 0.010, N = 3 SE +/- 0.016, N = 3 SE +/- 0.028, N = 3 SE +/- 0.006, N = 3 SE +/- 0.018, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 5.606 5.614 5.729 6.113 7.155 7.898 8.384 10.093 10.456 11.524 11.671 12.901
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 20 40 60 80 100 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 28.73 28.74 29.81 32.85 41.30 47.05 51.30 63.88 68.16 75.69 76.68 86.36
GravityMark Resolution: 2560 x 1440 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: Vulkan 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 50 100 150 200 250 SE +/- 0.21, N = 3 SE +/- 0.26, N = 3 SE +/- 0.15, N = 3 SE +/- 0.34, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.20, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 233.4 232.7 226.1 210.4 176.5 164.0 153.3 121.4 120.0 112.5 112.0 93.0
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3060Ti RTX 3070 RTX 2070 RTX 2060 SUPER RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 10K 20K 30K 40K 50K SE +/- 315.62, N = 3 SE +/- 524.00, N = 3 SE +/- 516.79, N = 4 SE +/- 392.62, N = 9 SE +/- 495.84, N = 3 SE +/- 436.94, N = 4 SE +/- 189.63, N = 3 SE +/- 83.35, N = 3 SE +/- 85.43, N = 3 SE +/- 231.75, N = 3 SE +/- 219.94, N = 3 SE +/- 187.36, N = 3 SE +/- 157.50, N = 3 44486 43849 43830 43263 40852 37970 33746 31446 30028 29970 29335 27278 22746 1. (CXX) g++ options: -O3 -pthread
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 1.3149 2.6298 3.9447 5.2596 6.5745 SE +/- 0.004, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.006, N = 3 SE +/- 0.005, N = 3 SE +/- 0.007, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.008, N = 3 SE +/- 0.007, N = 3 SE +/- 0.016, N = 3 SE +/- 0.024, N = 3 3.310 3.314 3.355 3.444 3.820 4.123 4.287 4.848 4.978 5.317 5.353 5.844
Phoronix Test Suite v10.8.5