nvidia linux Tests for a future article. AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3080 10GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2110101-TJ-NVIDIALIN34&rdt&grw .
nvidia linux Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB eVGA NVIDIA GeForce GTX 1660 Ti 6GB NVIDIA TU116 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 20.04 5.11.0-37-generic (x86_64) GNOME Shell 3.36.9 X Server 1.20.11 NVIDIA 470.74 4.6.0 OpenCL 3.0 CUDA 11.4.136 1.2.175 GCC 9.3.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio eVGA NVIDIA GeForce GTX 1660 SUPER 6GB NVIDIA TU116 HD Audio eVGA NVIDIA GeForce RTX 3060 12GB NVIDIA Device 228e NVIDIA GeForce RTX 2070 SUPER 8GB NVIDIA TU104 HD Audio ASUS NVIDIA GeForce RTX 2070 8GB NVIDIA TU106 HD Audio NVIDIA GeForce RTX 2060 SUPER 8GB NVIDIA GeForce RTX 2060 6GB NVIDIA GeForce RTX 3060 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 Ti 12GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3090 24GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 10GB NVIDIA Device 1aef OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016 Graphics Details - GTX 1660Ti: BAR1 / Visible vRAM Size: 256 MiB - GTX 1060: BAR1 / Visible vRAM Size: 256 MiB - GTX 1660 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - NVIDIA RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - RTX 2070 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2070: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080Ti: BAR1 / Visible vRAM Size: 16384 MiB - RTX 3070: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - NVIDIA RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - 3090: BAR1 / Visible vRAM Size: 32768 MiB - RTX 3070 Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080: BAR1 / Visible vRAM Size: 256 MiB OpenCL Details - GTX 1660Ti: GPU Compute Cores: 1536 - GTX 1060: GPU Compute Cores: 1280 - GTX 1660 SUPER: GPU Compute Cores: 1408 - RTX 3060: GPU Compute Cores: 3584 - NVIDIA RTX 3060: GPU Compute Cores: 3584 - RTX 2070 SUPER: GPU Compute Cores: 2560 - RTX 2070: GPU Compute Cores: 2304 - RTX 2060 SUPER: GPU Compute Cores: 2176 - RTX 2060: GPU Compute Cores: 1920 - RTX 3060Ti: GPU Compute Cores: 4864 - RTX 3080Ti: GPU Compute Cores: 10240 - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - NVIDIA RTX 3090: GPU Compute Cores: 10496 - 3090: GPU Compute Cores: 10496 - RTX 3070 Ti: GPU Compute Cores: 6144 - RTX 3080: GPU Compute Cores: 8704 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected Compiler Details - RTX 3060, NVIDIA RTX 3060, RTX 2070 SUPER, RTX 2070, RTX 2060 SUPER, RTX 2060, RTX 3060Ti, RTX 3080Ti, RTX 3070, RTX 3090, NVIDIA RTX 3090, 3090, RTX 3070 Ti, RTX 3080: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
nvidia linux etlegacy: 3840 x 2160 lczero: OpenCL ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m v-ray: NVIDIA CUDA GPU v-ray: NVIDIA RTX GPU blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX gravitymark: 2560 x 1440 - OpenGL hashcat: MD5 gravitymark: 1920 x 1080 - OpenGL hashcat: SHA1 gravitymark: 1920 x 1080 - Vulkan hashcat: 7-Zip gravitymark: 3840 x 2160 - OpenGL hashcat: SHA-512 gravitymark: 3840 x 2160 - Vulkan hashcat: TrueCrypt RIPEMD160 + XTS namd-cuda: ATPase Simulation - 327,506 Atoms octanebench: Total Score realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes gravitymark: 2560 x 1440 - Vulkan vkfft: waifu2x-ncnn: 2x - 3 - Yes GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 495.2 442 19620766667 6702033333 355133 854600000 253767 133.125997 445.2 249 13119800000 4455966667 189133 483533333 137633 81.44449 482.9 456 18355966667 6235366667 330833 792333333 235133 133.086823 22236 4.38 1.92 2.14 1.70 2.02 3.21 0.95 4.30 7.24 1.90 2.07 4.17 6.71 4.77 2.42 1207 26.10 73.10 56.45 0.15237 10.456 68.156 4.978 590.6 4.39 1.91 2.15 1.71 2.01 3.24 0.95 4.28 7.25 1.93 2.07 4.18 6.73 4.83 2.41 851 93.3 24825266667 110.4 7790600000 149.3 410267 72.8 992833333 84.0 291333 294.020104 120.0 27278 630.7 21079 4.13 1.72 1.94 1.59 1.78 2.92 0.91 3.86 7.90 1.90 2.31 3.94 6.85 4.74 2.17 834 1055 28.10 89.01 52.85 96.7 35928633333 114.4 11276666667 149.6 580233 74.6 1438900000 83.6 416900 0.14020 261.828555 10.093 63.881 121.4 29335 4.848 591.6 17674 4.30 1.79 2.02 1.64 1.85 3.05 0.93 4.13 8.78 2 2.45 4.19 7.01 4.90 2.24 513 798 30.10 146.40 59.97 86.4 30641800000 101.5 9694933333 139.1 491500 66.5 1224300000 78.4 353967 0.15287 244.190524 11.524 75.692 112.5 30028 5.353 559.7 17484 4.26 1.76 1.97 1.6 1.81 2.96 0.91 4.19 8.87 1.99 2.42 4.16 7.01 4.90 2.19 528 826 29.89 142.69 60.30 87.8 29907933333 103.9 9468200000 138.8 482933 67.5 1198700000 77.8 348033 0.15476 243.812534 11.671 76.681 112.0 29970 5.317 557.6 14473 4.40 1.80 2.00 1.63 1.86 3.02 0.93 4.21 9.96 2.19 2.63 4.49 7.25 5.16 2.25 505 733 36.03 146.87 69.56 79.5 26593433333 94.9 8390766667 116.4 435700 59.5 1062933333 64.3 305833 0.16856 195.639962 12.901 86.359 93.0 22746 5.844 645.3 30371 4.17 1.88 2.11 1.67 1.98 3.13 0.93 4.14 5.76 1.70 1.90 3.80 6.30 4.27 2.37 1260 1716 17.42 52.05 39.00 113.5 35414300000 132.1 11069666667 188.0 569333 89.8 1412966667 108.5 417467 0.12830 384.119086 8.384 51.297 153.3 33746 4.287 646.5 38444 4.01 1.83 2.09 1.67 1.94 3.12 0.88 4.11 4.13 1.53 1.76 3.47 5.85 4.15 2.39 2052 2850 9.70 29.61 19.80 147.6 68466466667 164.7 21732166667 262.5 1066767 125.8 2762600000 173.5 805133 0.11958 668.016818 5.729 29.814 226.1 43263 3.355 645.5 32980 4.10 1.87 2.11 1.67 1.97 3.13 0.93 4.24 5.43 1.64 1.87 3.73 6.15 4.32 2.39 1418 1880 15.69 45.71 33.30 117.3 41900433333 134.9 13140600000 201.3 663433 93.6 1682733333 116.1 488467 0.12726 414.231909 7.898 47.047 164.0 31446 4.123 654.5 39001 4.00 1.81 2.06 1.65 1.93 3.08 0.88 4.02 4.01 1.52 1.74 3.41 5.82 3.92 2.37 2111 2928 9.42 28.61 18.99 153.3 72520866667 169.7 22954666667 269.2 1113033 130.3 2890933333 178.6 832767 0.12001 684.778798 5.614 28.744 232.7 44486 3.314 581.5 4 1.82 2.06 1.66 1.92 3.08 0.87 4.08 4.03 1.51 1.74 3.41 5.85 4.10 2.36 2112 9.44 28.51 19.00 70873300000 170.1 22570933333 269.3 1104300 2857066667 818267 680.453461 43830 667.2 38687 4 1.82 2.07 1.66 1.92 3.09 0.88 3.92 4.04 1.51 1.74 3.42 5.88 4.13 2.37 2111 2917 9.44 28.56 19.01 153.3 70253400000 169.4 22452233333 269.9 1101967 130.7 2861100000 178.5 822167 0.11951 680.626427 5.606 28.729 233.4 43849 3.310 648.3 35401 4.02 1.81 2.06 1.65 1.92 3.09 0.93 3.93 5.07 1.62 1.79 3.59 6.12 4.34 2.34 1501 2034 14.38 42.76 31.44 118.7 42901566667 136.4 13536633333 212.2 709967 96.2 1717533333 128.9 505733 0.12415 454.752121 7.155 41.302 176.5 37970 3.820 639.3 38103 3.96 1.79 2.04 1.64 1.90 3.05 0.88 3.90 4.36 1.52 1.75 3.40 5.86 4.10 2.32 1774 2446 11.24 33.85 22.67 143.1 61586233333 160.6 19440866667 248.2 972500 120.2 2466033333 158.1 724700 0.12250 570.414463 6.113 32.845 210.4 40852 3.444 OpenBenchmarking.org
ET: Legacy Resolution: 3840 x 2160 OpenBenchmarking.org Frames Per Second, More Is Better ET: Legacy 2.78 Resolution: 3840 x 2160 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 140 280 420 560 700 SE +/- 4.09, N = 3 SE +/- 1.20, N = 3 SE +/- 3.91, N = 3 SE +/- 2.08, N = 3 SE +/- 1.83, N = 3 SE +/- 2.35, N = 3 SE +/- 26.17, N = 12 SE +/- 0.44, N = 3 SE +/- 3.68, N = 3 SE +/- 1.67, N = 3 SE +/- 6.77, N = 3 SE +/- 6.42, N = 5 SE +/- 72.37, N = 9 SE +/- 1.66, N = 3 SE +/- 4.84, N = 3 SE +/- 1.47, N = 3 495.2 445.2 482.9 590.6 630.7 591.6 559.7 557.6 645.3 646.5 645.5 654.5 581.5 667.2 648.3 639.3
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 8K 16K 24K 32K 40K SE +/- 125.30, N = 3 SE +/- 129.25, N = 3 SE +/- 144.05, N = 3 SE +/- 87.16, N = 3 SE +/- 59.29, N = 3 SE +/- 168.30, N = 3 SE +/- 111.06, N = 3 SE +/- 232.47, N = 3 SE +/- 412.81, N = 3 SE +/- 278.45, N = 3 SE +/- 231.99, N = 3 SE +/- 230.16, N = 3 22236 21079 17674 17484 14473 30371 38444 32980 39001 38687 35401 38103 1. (CXX) g++ options: -flto -pthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.99 1.98 2.97 3.96 4.95 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 4.38 4.39 4.13 4.30 4.26 4.40 4.17 4.01 4.10 4.00 4.00 4.00 4.02 3.96 MIN: 4.31 / MAX: 4.57 MIN: 4.33 / MAX: 4.54 MIN: 4.09 / MAX: 6.52 MIN: 4.21 / MAX: 12.49 MIN: 4.2 / MAX: 4.47 MIN: 4.35 / MAX: 4.57 MIN: 4.12 / MAX: 4.36 MIN: 3.96 / MAX: 4.13 MIN: 4.05 / MAX: 4.23 MIN: 3.92 / MAX: 7.83 MIN: 3.94 / MAX: 4.48 MIN: 3.95 / MAX: 4.44 MIN: 3.97 / MAX: 4.21 MIN: 3.89 / MAX: 4.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.432 0.864 1.296 1.728 2.16 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.92 1.91 1.72 1.79 1.76 1.80 1.88 1.83 1.87 1.81 1.82 1.82 1.81 1.79 MIN: 1.88 / MAX: 8.45 MIN: 1.89 / MAX: 2.84 MIN: 1.7 / MAX: 3.09 MIN: 1.76 / MAX: 2.81 MIN: 1.73 / MAX: 2.62 MIN: 1.78 / MAX: 2.99 MIN: 1.84 / MAX: 5.51 MIN: 1.81 / MAX: 4.77 MIN: 1.84 / MAX: 4.81 MIN: 1.79 / MAX: 3.1 MIN: 1.79 / MAX: 8.7 MIN: 1.79 / MAX: 4.97 MIN: 1.79 / MAX: 4.69 MIN: 1.77 / MAX: 3.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4838 0.9676 1.4514 1.9352 2.419 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.14 2.15 1.94 2.02 1.97 2.00 2.11 2.09 2.11 2.06 2.06 2.07 2.06 2.04 MIN: 2.11 / MAX: 4.76 MIN: 2.12 / MAX: 4.81 MIN: 1.92 / MAX: 3 MIN: 2 / MAX: 4.82 MIN: 1.95 / MAX: 3.04 MIN: 1.98 / MAX: 2.91 MIN: 2.07 / MAX: 4.83 MIN: 2.06 / MAX: 4.83 MIN: 2.08 / MAX: 3.71 MIN: 2.05 / MAX: 2.49 MIN: 2.04 / MAX: 2.62 MIN: 2.05 / MAX: 2.62 MIN: 2.04 / MAX: 4.66 MIN: 2.02 / MAX: 2.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.3848 0.7696 1.1544 1.5392 1.924 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.70 1.71 1.59 1.64 1.60 1.63 1.67 1.67 1.67 1.65 1.66 1.66 1.65 1.64 MIN: 1.68 / MAX: 2.76 MIN: 1.69 / MAX: 2.81 MIN: 1.57 / MAX: 2.93 MIN: 1.62 / MAX: 2.66 MIN: 1.59 / MAX: 2.59 MIN: 1.61 / MAX: 2.77 MIN: 1.64 / MAX: 2.7 MIN: 1.65 / MAX: 2.01 MIN: 1.64 / MAX: 3.01 MIN: 1.64 / MAX: 2.43 MIN: 1.63 / MAX: 2.59 MIN: 1.63 / MAX: 2.99 MIN: 1.62 / MAX: 6.14 MIN: 1.61 / MAX: 2.43 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4545 0.909 1.3635 1.818 2.2725 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.02 2.01 1.78 1.85 1.81 1.86 1.98 1.94 1.97 1.93 1.92 1.92 1.92 1.90 MIN: 1.97 / MAX: 12.09 MIN: 1.98 / MAX: 5.81 MIN: 1.76 / MAX: 2.56 MIN: 1.83 / MAX: 2.02 MIN: 1.8 / MAX: 2.09 MIN: 1.83 / MAX: 4.81 MIN: 1.95 / MAX: 8.5 MIN: 1.92 / MAX: 3.04 MIN: 1.94 / MAX: 4.81 MIN: 1.91 / MAX: 8.55 MIN: 1.9 / MAX: 2.79 MIN: 1.89 / MAX: 4.81 MIN: 1.89 / MAX: 4.79 MIN: 1.87 / MAX: 8.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.729 1.458 2.187 2.916 3.645 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.21 3.24 2.92 3.05 2.96 3.02 3.13 3.12 3.13 3.08 3.08 3.09 3.09 3.05 MIN: 3.18 / MAX: 4.81 MIN: 3.19 / MAX: 4.87 MIN: 2.88 / MAX: 5.47 MIN: 3.02 / MAX: 4.81 MIN: 2.92 / MAX: 9.52 MIN: 2.99 / MAX: 5.02 MIN: 3.1 / MAX: 4.87 MIN: 3.09 / MAX: 4.84 MIN: 3.1 / MAX: 4.82 MIN: 3.06 / MAX: 4.67 MIN: 3.04 / MAX: 4.85 MIN: 3.06 / MAX: 6.04 MIN: 3.05 / MAX: 4.84 MIN: 3.02 / MAX: 3.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.2138 0.4276 0.6414 0.8552 1.069 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.95 0.95 0.91 0.93 0.91 0.93 0.93 0.88 0.93 0.88 0.87 0.88 0.93 0.88 MIN: 0.93 / MAX: 1.89 MIN: 0.93 / MAX: 1.92 MIN: 0.88 / MAX: 1.8 MIN: 0.9 / MAX: 2.01 MIN: 0.89 / MAX: 1.94 MIN: 0.91 / MAX: 2 MIN: 0.91 / MAX: 1.68 MIN: 0.86 / MAX: 1.84 MIN: 0.91 / MAX: 1.8 MIN: 0.85 / MAX: 1.76 MIN: 0.85 / MAX: 1.89 MIN: 0.85 / MAX: 1.71 MIN: 0.91 / MAX: 1.99 MIN: 0.86 / MAX: 1.91 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.9675 1.935 2.9025 3.87 4.8375 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 2 SE +/- 0.04, N = 3 SE +/- 0.07, N = 2 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.00, N = 2 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 4.30 4.28 3.86 4.13 4.19 4.21 4.14 4.11 4.24 4.02 4.08 3.92 3.93 3.90 MIN: 3.91 / MAX: 15 MIN: 3.91 / MAX: 22.46 MIN: 3.44 / MAX: 11.03 MIN: 3.63 / MAX: 11.49 MIN: 3.57 / MAX: 12.23 MIN: 3.71 / MAX: 19.56 MIN: 3.75 / MAX: 13.91 MIN: 3.62 / MAX: 17.74 MIN: 3.72 / MAX: 13.94 MIN: 3.57 / MAX: 16.52 MIN: 3.57 / MAX: 15.4 MIN: 3.57 / MAX: 18.33 MIN: 3.59 / MAX: 13.6 MIN: 3.51 / MAX: 17.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 7.24 7.25 7.90 8.78 8.87 9.96 5.76 4.13 5.43 4.01 4.03 4.04 5.07 4.36 MIN: 7.11 / MAX: 16.52 MIN: 7.15 / MAX: 16.65 MIN: 7.39 / MAX: 17.42 MIN: 8.15 / MAX: 25.5 MIN: 8.62 / MAX: 23.64 MIN: 9.52 / MAX: 24.93 MIN: 5.68 / MAX: 13.67 MIN: 4.1 / MAX: 7.68 MIN: 5.33 / MAX: 19.97 MIN: 3.97 / MAX: 6.67 MIN: 3.98 / MAX: 10.03 MIN: 3.98 / MAX: 13.19 MIN: 5.02 / MAX: 9.32 MIN: 4.31 / MAX: 6.26 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.01, N = 2 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.90 1.93 1.90 2.00 1.99 2.19 1.70 1.53 1.64 1.52 1.51 1.51 1.62 1.52 MIN: 1.88 / MAX: 2.08 MIN: 1.88 / MAX: 12.22 MIN: 1.88 / MAX: 2.05 MIN: 1.98 / MAX: 2.13 MIN: 1.97 / MAX: 2.15 MIN: 2.17 / MAX: 2.33 MIN: 1.68 / MAX: 4.79 MIN: 1.51 / MAX: 1.76 MIN: 1.62 / MAX: 1.88 MIN: 1.49 / MAX: 4.09 MIN: 1.49 / MAX: 1.76 MIN: 1.49 / MAX: 1.7 MIN: 1.61 / MAX: 3.82 MIN: 1.49 / MAX: 2.49 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.5918 1.1836 1.7754 2.3672 2.959 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.07 2.07 2.31 2.45 2.42 2.63 1.90 1.76 1.87 1.74 1.74 1.74 1.79 1.75 MIN: 2.03 / MAX: 5.86 MIN: 2.05 / MAX: 2.22 MIN: 2.06 / MAX: 3.47 MIN: 2.39 / MAX: 4.82 MIN: 2.34 / MAX: 2.93 MIN: 2.51 / MAX: 4.77 MIN: 1.85 / MAX: 8.61 MIN: 1.74 / MAX: 1.92 MIN: 1.83 / MAX: 4.81 MIN: 1.72 / MAX: 1.89 MIN: 1.72 / MAX: 1.94 MIN: 1.72 / MAX: 1.92 MIN: 1.78 / MAX: 1.94 MIN: 1.72 / MAX: 4.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 1.0103 2.0206 3.0309 4.0412 5.0515 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.17 4.18 3.94 4.19 4.16 4.49 3.80 3.47 3.73 3.41 3.41 3.42 3.59 3.40 MIN: 4.15 / MAX: 4.26 MIN: 4.15 / MAX: 4.48 MIN: 3.91 / MAX: 4.89 MIN: 4.16 / MAX: 4.31 MIN: 4.14 / MAX: 4.83 MIN: 4.47 / MAX: 4.83 MIN: 3.76 / MAX: 13.08 MIN: 3.45 / MAX: 4.72 MIN: 3.67 / MAX: 4.82 MIN: 3.39 / MAX: 3.54 MIN: 3.39 / MAX: 4.83 MIN: 3.4 / MAX: 8.52 MIN: 3.56 / MAX: 4.82 MIN: 3.37 / MAX: 3.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 6.71 6.73 6.85 7.01 7.01 7.25 6.30 5.85 6.15 5.82 5.85 5.88 6.12 5.86 MIN: 6.58 / MAX: 7.1 MIN: 6.6 / MAX: 6.89 MIN: 6.66 / MAX: 7.27 MIN: 6.91 / MAX: 10.62 MIN: 6.92 / MAX: 16.05 MIN: 7.17 / MAX: 7.38 MIN: 6.11 / MAX: 6.59 MIN: 5.59 / MAX: 10.87 MIN: 5.94 / MAX: 6.41 MIN: 5.57 / MAX: 6.24 MIN: 5.6 / MAX: 6.5 MIN: 5.58 / MAX: 12.45 MIN: 5.9 / MAX: 6.51 MIN: 5.61 / MAX: 6.37 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 1.161 2.322 3.483 4.644 5.805 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 2 SE +/- 0.11, N = 3 SE +/- 0.13, N = 2 4.77 4.83 4.74 4.90 4.90 5.16 4.27 4.15 4.32 3.92 4.10 4.13 4.34 4.10 MIN: 4.67 / MAX: 5.06 MIN: 4.63 / MAX: 14.6 MIN: 4.52 / MAX: 9.57 MIN: 4.65 / MAX: 7.98 MIN: 4.66 / MAX: 8.68 MIN: 4.86 / MAX: 21.65 MIN: 4.16 / MAX: 4.55 MIN: 3.9 / MAX: 7.31 MIN: 4.04 / MAX: 9.9 MIN: 3.85 / MAX: 4.41 MIN: 3.84 / MAX: 8.44 MIN: 3.89 / MAX: 6.1 MIN: 4.04 / MAX: 7.74 MIN: 3.89 / MAX: 8.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.5445 1.089 1.6335 2.178 2.7225 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.42 2.41 2.17 2.24 2.19 2.25 2.37 2.39 2.39 2.37 2.36 2.37 2.34 2.32 MIN: 2.37 / MAX: 10.64 MIN: 2.39 / MAX: 3.22 MIN: 2.15 / MAX: 2.49 MIN: 2.23 / MAX: 2.46 MIN: 2.17 / MAX: 2.95 MIN: 2.2 / MAX: 2.77 MIN: 2.35 / MAX: 2.95 MIN: 2.36 / MAX: 2.88 MIN: 2.36 / MAX: 2.74 MIN: 2.35 / MAX: 2.86 MIN: 2.35 / MAX: 2.94 MIN: 2.35 / MAX: 3.22 MIN: 2.31 / MAX: 3.52 MIN: 2.3 / MAX: 3.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Chaos Group V-RAY Mode: NVIDIA CUDA GPU OpenBenchmarking.org vpaths, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA CUDA GPU GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 500 1000 1500 2000 2500 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 1.15, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 1.86, N = 3 SE +/- 0.33, N = 3 SE +/- 2.60, N = 3 SE +/- 2.33, N = 3 SE +/- 2.19, N = 3 SE +/- 1.86, N = 3 442 249 456 851 834 513 528 505 1260 2052 1418 2111 2112 2111 1501 1774
Chaos Group V-RAY Mode: NVIDIA RTX GPU OpenBenchmarking.org vrays, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA RTX GPU RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 600 1200 1800 2400 3000 SE +/- 1.67, N = 3 SE +/- 1.45, N = 3 SE +/- 0.88, N = 3 SE +/- 2.40, N = 3 SE +/- 6.06, N = 3 SE +/- 1.00, N = 3 SE +/- 3.00, N = 3 SE +/- 8.88, N = 3 SE +/- 1.76, N = 3 SE +/- 4.73, N = 3 1207 1055 798 826 733 1716 2850 1880 2928 2917 2034 2446
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 8 16 24 32 40 SE +/- 2.63, N = 15 SE +/- 2.61, N = 15 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 26.10 28.10 30.10 29.89 36.03 17.42 9.70 15.69 9.42 9.44 9.44 14.38 11.24
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.30, N = 3 SE +/- 1.24, N = 3 SE +/- 1.28, N = 3 SE +/- 1.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 73.10 89.01 146.40 142.69 146.87 52.05 29.61 45.71 28.61 28.51 28.56 42.76 33.85
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 15 30 45 60 75 SE +/- 2.71, N = 15 SE +/- 2.69, N = 15 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 56.45 52.85 59.97 60.30 69.56 39.00 19.80 33.30 18.99 19.00 19.01 31.44 22.67
GravityMark Resolution: 2560 x 1440 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.20, N = 3 SE +/- 0.03, N = 3 SE +/- 0.40, N = 3 SE +/- 0.64, N = 3 SE +/- 0.15, N = 3 SE +/- 0.35, N = 3 SE +/- 0.69, N = 3 SE +/- 0.20, N = 3 SE +/- 0.42, N = 3 93.3 96.7 86.4 87.8 79.5 113.5 147.6 117.3 153.3 153.3 118.7 143.1
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 16000M 32000M 48000M 64000M 80000M SE +/- 33080726.18, N = 3 SE +/- 4813522.62, N = 3 SE +/- 61580741.94, N = 3 SE +/- 12235785.40, N = 3 SE +/- 34379515.86, N = 3 SE +/- 11557248.81, N = 3 SE +/- 53112532.52, N = 3 SE +/- 58270127.66, N = 3 SE +/- 62466737.82, N = 3 SE +/- 278660763.49, N = 3 SE +/- 52398642.90, N = 3 SE +/- 151860520.80, N = 3 SE +/- 89401584.62, N = 3 SE +/- 43362195.52, N = 3 SE +/- 53053631.15, N = 3 SE +/- 122029850.63, N = 3 19620766667 13119800000 18355966667 24825266667 35928633333 30641800000 29907933333 26593433333 35414300000 68466466667 41900433333 72520866667 70873300000 70253400000 42901566667 61586233333
GravityMark Resolution: 1920 x 1080 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.50, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.43, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.44, N = 3 SE +/- 0.72, N = 3 SE +/- 0.07, N = 3 SE +/- 0.50, N = 3 110.4 114.4 101.5 103.9 94.9 132.1 164.7 134.9 169.7 170.1 169.4 136.4 160.6
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 5000M 10000M 15000M 20000M 25000M SE +/- 16083670.12, N = 3 SE +/- 2008592.65, N = 3 SE +/- 10383694.48, N = 3 SE +/- 4454585.65, N = 3 SE +/- 14748144.89, N = 3 SE +/- 36354107.21, N = 3 SE +/- 5602677.93, N = 3 SE +/- 19016338.00, N = 3 SE +/- 11142461.33, N = 3 SE +/- 54926142.33, N = 3 SE +/- 17350024.02, N = 3 SE +/- 52625416.34, N = 3 SE +/- 40688750.83, N = 3 SE +/- 42808501.23, N = 3 SE +/- 7460414.05, N = 3 SE +/- 36421620.56, N = 3 6702033333 4455966667 6235366667 7790600000 11276666667 9694933333 9468200000 8390766667 11069666667 21732166667 13140600000 22954666667 22570933333 22452233333 13536633333 19440866667
GravityMark Resolution: 1920 x 1080 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 60 120 180 240 300 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.27, N = 3 SE +/- 0.20, N = 3 SE +/- 0.29, N = 3 SE +/- 0.50, N = 3 SE +/- 0.03, N = 3 SE +/- 0.58, N = 3 SE +/- 0.32, N = 3 SE +/- 0.20, N = 3 149.3 149.6 139.1 138.8 116.4 188.0 262.5 201.3 269.2 269.3 269.9 212.2 248.2
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 200K 400K 600K 800K 1000K SE +/- 712.59, N = 3 SE +/- 578.31, N = 3 SE +/- 504.42, N = 3 SE +/- 533.33, N = 3 SE +/- 783.87, N = 3 SE +/- 493.29, N = 3 SE +/- 669.16, N = 3 SE +/- 680.69, N = 3 SE +/- 696.02, N = 3 SE +/- 1767.61, N = 3 SE +/- 1897.66, N = 3 SE +/- 5304.82, N = 3 SE +/- 1587.45, N = 3 SE +/- 920.75, N = 3 SE +/- 1785.43, N = 3 SE +/- 2685.76, N = 3 355133 189133 330833 410267 580233 491500 482933 435700 569333 1066767 663433 1113033 1104300 1101967 709967 972500
GravityMark Resolution: 3840 x 2160 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.23, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 72.8 74.6 66.5 67.5 59.5 89.8 125.8 93.6 130.3 130.7 96.2 120.2
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 600M 1200M 1800M 2400M 3000M SE +/- 115470.05, N = 3 SE +/- 66666.67, N = 3 SE +/- 864741.45, N = 3 SE +/- 1083717.88, N = 3 SE +/- 152752.52, N = 3 SE +/- 568624.07, N = 3 SE +/- 1500000.00, N = 3 SE +/- 1560270.63, N = 3 SE +/- 4611700.10, N = 3 SE +/- 4194043.40, N = 3 SE +/- 3238483.87, N = 3 SE +/- 5366666.67, N = 3 SE +/- 1039764.93, N = 3 SE +/- 1715614.56, N = 3 SE +/- 829323.69, N = 3 SE +/- 4117577.50, N = 3 854600000 483533333 792333333 992833333 1438900000 1224300000 1198700000 1062933333 1412966667 2762600000 1682733333 2890933333 2857066667 2861100000 1717533333 2466033333
GravityMark Resolution: 3840 x 2160 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 84.0 83.6 78.4 77.8 64.3 108.5 173.5 116.1 178.6 178.5 128.9 158.1
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 200K 400K 600K 800K 1000K SE +/- 533.33, N = 3 SE +/- 33.33, N = 3 SE +/- 554.78, N = 3 SE +/- 600.93, N = 3 SE +/- 2318.05, N = 3 SE +/- 2602.78, N = 3 SE +/- 317.98, N = 3 SE +/- 1975.12, N = 3 SE +/- 3507.29, N = 3 SE +/- 7319.46, N = 3 SE +/- 4139.78, N = 3 SE +/- 5546.87, N = 3 SE +/- 688.80, N = 3 SE +/- 296.27, N = 3 SE +/- 2906.51, N = 3 SE +/- 2706.17, N = 3 253767 137633 235133 291333 416900 353967 348033 305833 417467 805133 488467 832767 818267 822167 505733 724700
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 0.0379 0.0758 0.1137 0.1516 0.1895 SE +/- 0.00015, N = 3 SE +/- 0.00012, N = 3 SE +/- 0.00047, N = 3 SE +/- 0.00063, N = 3 SE +/- 0.00014, N = 3 SE +/- 0.00006, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00094, N = 3 SE +/- 0.00103, N = 3 SE +/- 0.00003, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00140, N = 3 0.15237 0.14020 0.15287 0.15476 0.16856 0.12830 0.11958 0.12726 0.12001 0.11951 0.12415 0.12250
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 150 300 450 600 750 133.13 81.44 133.09 294.02 261.83 244.19 243.81 195.64 384.12 668.02 414.23 684.78 680.45 680.63 454.75 570.41
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 3 6 9 12 15 SE +/- 0.006, N = 3 SE +/- 0.028, N = 3 SE +/- 0.018, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.016, N = 3 SE +/- 0.028, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.010, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 10.456 10.093 11.524 11.671 12.901 8.384 5.729 7.898 5.614 5.606 7.155 6.113
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 68.16 63.88 75.69 76.68 86.36 51.30 29.81 47.05 28.74 28.73 41.30 32.85
GravityMark Resolution: 2560 x 1440 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 50 100 150 200 250 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.28, N = 3 SE +/- 0.26, N = 3 SE +/- 0.21, N = 3 SE +/- 0.32, N = 3 SE +/- 0.34, N = 3 120.0 121.4 112.5 112.0 93.0 153.3 226.1 164.0 232.7 233.4 176.5 210.4
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 10K 20K 30K 40K 50K SE +/- 187.36, N = 3 SE +/- 219.94, N = 3 SE +/- 85.43, N = 3 SE +/- 231.75, N = 3 SE +/- 157.50, N = 3 SE +/- 189.63, N = 3 SE +/- 392.62, N = 9 SE +/- 83.35, N = 3 SE +/- 315.62, N = 3 SE +/- 516.79, N = 4 SE +/- 524.00, N = 3 SE +/- 436.94, N = 4 SE +/- 495.84, N = 3 27278 29335 30028 29970 22746 33746 43263 31446 44486 43830 43849 37970 40852 1. (CXX) g++ options: -O3 -pthread
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 1.3149 2.6298 3.9447 5.2596 6.5745 SE +/- 0.008, N = 3 SE +/- 0.001, N = 3 SE +/- 0.016, N = 3 SE +/- 0.007, N = 3 SE +/- 0.024, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.007, N = 3 SE +/- 0.006, N = 3 SE +/- 0.004, N = 3 SE +/- 0.005, N = 3 SE +/- 0.006, N = 3 4.978 4.848 5.353 5.317 5.844 4.287 3.355 4.123 3.314 3.310 3.820 3.444
Phoronix Test Suite v10.8.5