nvidia linux Tests for a future article. AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3080 10GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2110101-TJ-NVIDIALIN34&sor .
nvidia linux Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB eVGA NVIDIA GeForce GTX 1660 Ti 6GB NVIDIA TU116 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 20.04 5.11.0-37-generic (x86_64) GNOME Shell 3.36.9 X Server 1.20.11 NVIDIA 470.74 4.6.0 OpenCL 3.0 CUDA 11.4.136 1.2.175 GCC 9.3.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio eVGA NVIDIA GeForce GTX 1660 SUPER 6GB NVIDIA TU116 HD Audio eVGA NVIDIA GeForce RTX 3060 12GB NVIDIA Device 228e NVIDIA GeForce RTX 2070 SUPER 8GB NVIDIA TU104 HD Audio ASUS NVIDIA GeForce RTX 2070 8GB NVIDIA TU106 HD Audio NVIDIA GeForce RTX 2060 SUPER 8GB NVIDIA GeForce RTX 2060 6GB NVIDIA GeForce RTX 3060 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 Ti 12GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3090 24GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 10GB NVIDIA Device 1aef OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016 Graphics Details - GTX 1660Ti: BAR1 / Visible vRAM Size: 256 MiB - GTX 1060: BAR1 / Visible vRAM Size: 256 MiB - GTX 1660 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - NVIDIA RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - RTX 2070 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2070: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080Ti: BAR1 / Visible vRAM Size: 16384 MiB - RTX 3070: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - NVIDIA RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - 3090: BAR1 / Visible vRAM Size: 32768 MiB - RTX 3070 Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080: BAR1 / Visible vRAM Size: 256 MiB OpenCL Details - GTX 1660Ti: GPU Compute Cores: 1536 - GTX 1060: GPU Compute Cores: 1280 - GTX 1660 SUPER: GPU Compute Cores: 1408 - RTX 3060: GPU Compute Cores: 3584 - NVIDIA RTX 3060: GPU Compute Cores: 3584 - RTX 2070 SUPER: GPU Compute Cores: 2560 - RTX 2070: GPU Compute Cores: 2304 - RTX 2060 SUPER: GPU Compute Cores: 2176 - RTX 2060: GPU Compute Cores: 1920 - RTX 3060Ti: GPU Compute Cores: 4864 - RTX 3080Ti: GPU Compute Cores: 10240 - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - NVIDIA RTX 3090: GPU Compute Cores: 10496 - 3090: GPU Compute Cores: 10496 - RTX 3070 Ti: GPU Compute Cores: 6144 - RTX 3080: GPU Compute Cores: 8704 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected Compiler Details - RTX 3060, NVIDIA RTX 3060, RTX 2070 SUPER, RTX 2070, RTX 2060 SUPER, RTX 2060, RTX 3060Ti, RTX 3080Ti, RTX 3070, RTX 3090, NVIDIA RTX 3090, 3090, RTX 3070 Ti, RTX 3080: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
nvidia linux hashcat: MD5 hashcat: SHA1 hashcat: 7-Zip hashcat: SHA-512 hashcat: TrueCrypt RIPEMD160 + XTS etlegacy: 3840 x 2160 octanebench: Total Score v-ray: NVIDIA CUDA GPU ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX vkfft: gravitymark: 1920 x 1080 - OpenGL gravitymark: 1920 x 1080 - Vulkan gravitymark: 2560 x 1440 - OpenGL gravitymark: 2560 x 1440 - Vulkan gravitymark: 3840 x 2160 - OpenGL gravitymark: 3840 x 2160 - Vulkan realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes waifu2x-ncnn: 2x - 3 - Yes namd-cuda: ATPase Simulation - 327,506 Atoms lczero: OpenCL v-ray: NVIDIA RTX GPU GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 19620766667 6702033333 355133 854600000 253767 495.2 133.125997 442 13119800000 4455966667 189133 483533333 137633 445.2 81.44449 249 18355966667 6235366667 330833 792333333 235133 482.9 133.086823 456 4.38 1.92 2.14 1.70 2.02 3.21 0.95 4.30 7.24 1.90 2.07 4.17 6.71 4.77 2.42 26.10 73.10 56.45 10.456 68.156 4.978 0.15237 22236 1207 24825266667 7790600000 410267 992833333 291333 590.6 294.020104 851 4.39 1.91 2.15 1.71 2.01 3.24 0.95 4.28 7.25 1.93 2.07 4.18 6.73 4.83 2.41 27278 110.4 149.3 93.3 120.0 72.8 84.0 35928633333 11276666667 580233 1438900000 416900 630.7 261.828555 834 4.13 1.72 1.94 1.59 1.78 2.92 0.91 3.86 7.90 1.90 2.31 3.94 6.85 4.74 2.17 28.10 89.01 52.85 29335 114.4 149.6 96.7 121.4 74.6 83.6 10.093 63.881 4.848 0.14020 21079 1055 30641800000 9694933333 491500 1224300000 353967 591.6 244.190524 513 4.30 1.79 2.02 1.64 1.85 3.05 0.93 4.13 8.78 2 2.45 4.19 7.01 4.90 2.24 30.10 146.40 59.97 30028 101.5 139.1 86.4 112.5 66.5 78.4 11.524 75.692 5.353 0.15287 17674 798 29907933333 9468200000 482933 1198700000 348033 559.7 243.812534 528 4.26 1.76 1.97 1.6 1.81 2.96 0.91 4.19 8.87 1.99 2.42 4.16 7.01 4.90 2.19 29.89 142.69 60.30 29970 103.9 138.8 87.8 112.0 67.5 77.8 11.671 76.681 5.317 0.15476 17484 826 26593433333 8390766667 435700 1062933333 305833 557.6 195.639962 505 4.40 1.80 2.00 1.63 1.86 3.02 0.93 4.21 9.96 2.19 2.63 4.49 7.25 5.16 2.25 36.03 146.87 69.56 22746 94.9 116.4 79.5 93.0 59.5 64.3 12.901 86.359 5.844 0.16856 14473 733 35414300000 11069666667 569333 1412966667 417467 645.3 384.119086 1260 4.17 1.88 2.11 1.67 1.98 3.13 0.93 4.14 5.76 1.70 1.90 3.80 6.30 4.27 2.37 17.42 52.05 39.00 33746 132.1 188.0 113.5 153.3 89.8 108.5 8.384 51.297 4.287 0.12830 30371 1716 68466466667 21732166667 1066767 2762600000 805133 646.5 668.016818 2052 4.01 1.83 2.09 1.67 1.94 3.12 0.88 4.11 4.13 1.53 1.76 3.47 5.85 4.15 2.39 9.70 29.61 19.80 43263 164.7 262.5 147.6 226.1 125.8 173.5 5.729 29.814 3.355 0.11958 38444 2850 41900433333 13140600000 663433 1682733333 488467 645.5 414.231909 1418 4.10 1.87 2.11 1.67 1.97 3.13 0.93 4.24 5.43 1.64 1.87 3.73 6.15 4.32 2.39 15.69 45.71 33.30 31446 134.9 201.3 117.3 164.0 93.6 116.1 7.898 47.047 4.123 0.12726 32980 1880 72520866667 22954666667 1113033 2890933333 832767 654.5 684.778798 2111 4.00 1.81 2.06 1.65 1.93 3.08 0.88 4.02 4.01 1.52 1.74 3.41 5.82 3.92 2.37 9.42 28.61 18.99 44486 169.7 269.2 153.3 232.7 130.3 178.6 5.614 28.744 3.314 0.12001 39001 2928 70873300000 22570933333 1104300 2857066667 818267 581.5 680.453461 2112 4 1.82 2.06 1.66 1.92 3.08 0.87 4.08 4.03 1.51 1.74 3.41 5.85 4.10 2.36 9.44 28.51 19.00 43830 170.1 269.3 70253400000 22452233333 1101967 2861100000 822167 667.2 680.626427 2111 4 1.82 2.07 1.66 1.92 3.09 0.88 3.92 4.04 1.51 1.74 3.42 5.88 4.13 2.37 9.44 28.56 19.01 43849 169.4 269.9 153.3 233.4 130.7 178.5 5.606 28.729 3.310 0.11951 38687 2917 42901566667 13536633333 709967 1717533333 505733 648.3 454.752121 1501 4.02 1.81 2.06 1.65 1.92 3.09 0.93 3.93 5.07 1.62 1.79 3.59 6.12 4.34 2.34 14.38 42.76 31.44 37970 136.4 212.2 118.7 176.5 96.2 128.9 7.155 41.302 3.820 0.12415 35401 2034 61586233333 19440866667 972500 2466033333 724700 639.3 570.414463 1774 3.96 1.79 2.04 1.64 1.90 3.05 0.88 3.90 4.36 1.52 1.75 3.40 5.86 4.10 2.32 11.24 33.85 22.67 40852 160.6 248.2 143.1 210.4 120.2 158.1 6.113 32.845 3.444 0.12250 38103 2446 OpenBenchmarking.org
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 16000M 32000M 48000M 64000M 80000M SE +/- 151860520.80, N = 3 SE +/- 89401584.62, N = 3 SE +/- 43362195.52, N = 3 SE +/- 278660763.49, N = 3 SE +/- 122029850.63, N = 3 SE +/- 53053631.15, N = 3 SE +/- 52398642.90, N = 3 SE +/- 34379515.86, N = 3 SE +/- 62466737.82, N = 3 SE +/- 11557248.81, N = 3 SE +/- 53112532.52, N = 3 SE +/- 58270127.66, N = 3 SE +/- 12235785.40, N = 3 SE +/- 33080726.18, N = 3 SE +/- 61580741.94, N = 3 SE +/- 4813522.62, N = 3 72520866667 70873300000 70253400000 68466466667 61586233333 42901566667 41900433333 35928633333 35414300000 30641800000 29907933333 26593433333 24825266667 19620766667 18355966667 13119800000
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 5000M 10000M 15000M 20000M 25000M SE +/- 52625416.34, N = 3 SE +/- 40688750.83, N = 3 SE +/- 42808501.23, N = 3 SE +/- 54926142.33, N = 3 SE +/- 36421620.56, N = 3 SE +/- 7460414.05, N = 3 SE +/- 17350024.02, N = 3 SE +/- 14748144.89, N = 3 SE +/- 11142461.33, N = 3 SE +/- 36354107.21, N = 3 SE +/- 5602677.93, N = 3 SE +/- 19016338.00, N = 3 SE +/- 4454585.65, N = 3 SE +/- 16083670.12, N = 3 SE +/- 10383694.48, N = 3 SE +/- 2008592.65, N = 3 22954666667 22570933333 22452233333 21732166667 19440866667 13536633333 13140600000 11276666667 11069666667 9694933333 9468200000 8390766667 7790600000 6702033333 6235366667 4455966667
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 200K 400K 600K 800K 1000K SE +/- 5304.82, N = 3 SE +/- 1587.45, N = 3 SE +/- 920.75, N = 3 SE +/- 1767.61, N = 3 SE +/- 2685.76, N = 3 SE +/- 1785.43, N = 3 SE +/- 1897.66, N = 3 SE +/- 783.87, N = 3 SE +/- 696.02, N = 3 SE +/- 493.29, N = 3 SE +/- 669.16, N = 3 SE +/- 680.69, N = 3 SE +/- 533.33, N = 3 SE +/- 712.59, N = 3 SE +/- 504.42, N = 3 SE +/- 578.31, N = 3 1113033 1104300 1101967 1066767 972500 709967 663433 580233 569333 491500 482933 435700 410267 355133 330833 189133
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 600M 1200M 1800M 2400M 3000M SE +/- 5366666.67, N = 3 SE +/- 1715614.56, N = 3 SE +/- 1039764.93, N = 3 SE +/- 4194043.40, N = 3 SE +/- 4117577.50, N = 3 SE +/- 829323.69, N = 3 SE +/- 3238483.87, N = 3 SE +/- 152752.52, N = 3 SE +/- 4611700.10, N = 3 SE +/- 568624.07, N = 3 SE +/- 1500000.00, N = 3 SE +/- 1560270.63, N = 3 SE +/- 1083717.88, N = 3 SE +/- 115470.05, N = 3 SE +/- 864741.45, N = 3 SE +/- 66666.67, N = 3 2890933333 2861100000 2857066667 2762600000 2466033333 1717533333 1682733333 1438900000 1412966667 1224300000 1198700000 1062933333 992833333 854600000 792333333 483533333
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 NVIDIA RTX 3060 GTX 1660Ti GTX 1660 SUPER GTX 1060 200K 400K 600K 800K 1000K SE +/- 5546.87, N = 3 SE +/- 296.27, N = 3 SE +/- 688.80, N = 3 SE +/- 7319.46, N = 3 SE +/- 2706.17, N = 3 SE +/- 2906.51, N = 3 SE +/- 4139.78, N = 3 SE +/- 3507.29, N = 3 SE +/- 2318.05, N = 3 SE +/- 2602.78, N = 3 SE +/- 317.98, N = 3 SE +/- 1975.12, N = 3 SE +/- 600.93, N = 3 SE +/- 533.33, N = 3 SE +/- 554.78, N = 3 SE +/- 33.33, N = 3 832767 822167 818267 805133 724700 505733 488467 417467 416900 353967 348033 305833 291333 253767 235133 137633
ET: Legacy Resolution: 3840 x 2160 OpenBenchmarking.org Frames Per Second, More Is Better ET: Legacy 2.78 Resolution: 3840 x 2160 3090 RTX 3090 RTX 3070 Ti RTX 3080Ti RTX 3070 RTX 3060Ti RTX 3080 RTX 2070 SUPER RTX 2070 NVIDIA RTX 3060 NVIDIA RTX 3090 RTX 2060 SUPER RTX 2060 GTX 1660Ti GTX 1660 SUPER GTX 1060 140 280 420 560 700 SE +/- 1.66, N = 3 SE +/- 6.42, N = 5 SE +/- 4.84, N = 3 SE +/- 1.67, N = 3 SE +/- 6.77, N = 3 SE +/- 3.68, N = 3 SE +/- 1.47, N = 3 SE +/- 1.83, N = 3 SE +/- 2.35, N = 3 SE +/- 2.08, N = 3 SE +/- 72.37, N = 9 SE +/- 26.17, N = 12 SE +/- 0.44, N = 3 SE +/- 4.09, N = 3 SE +/- 3.91, N = 3 SE +/- 1.20, N = 3 667.2 654.5 648.3 646.5 645.5 645.3 639.3 630.7 591.6 590.6 581.5 559.7 557.6 495.2 482.9 445.2
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 GTX 1660Ti GTX 1660 SUPER GTX 1060 150 300 450 600 750 684.78 680.63 680.45 668.02 570.41 454.75 414.23 384.12 294.02 261.83 244.19 243.81 195.64 133.13 133.09 81.44
Chaos Group V-RAY Mode: NVIDIA CUDA GPU OpenBenchmarking.org vpaths, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA CUDA GPU NVIDIA RTX 3090 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 GTX 1660 SUPER GTX 1660Ti GTX 1060 500 1000 1500 2000 2500 SE +/- 2.33, N = 3 SE +/- 2.19, N = 3 SE +/- 2.60, N = 3 SE +/- 1.86, N = 3 SE +/- 1.86, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 1.15, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 2112 2111 2111 2052 1774 1501 1418 1260 851 834 528 513 505 456 442 249
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3080 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 2070 SUPER RTX 3060Ti RTX 2060 SUPER RTX 2070 RTX 3060 NVIDIA RTX 3060 RTX 2060 0.99 1.98 2.97 3.96 4.95 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 3.96 4.00 4.00 4.00 4.01 4.02 4.10 4.13 4.17 4.26 4.30 4.38 4.39 4.40 MIN: 3.89 / MAX: 4.55 MIN: 3.92 / MAX: 7.83 MIN: 3.94 / MAX: 4.48 MIN: 3.95 / MAX: 4.44 MIN: 3.96 / MAX: 4.13 MIN: 3.97 / MAX: 4.21 MIN: 4.05 / MAX: 4.23 MIN: 4.09 / MAX: 6.52 MIN: 4.12 / MAX: 4.36 MIN: 4.2 / MAX: 4.47 MIN: 4.21 / MAX: 12.49 MIN: 4.31 / MAX: 4.57 MIN: 4.33 / MAX: 4.54 MIN: 4.35 / MAX: 4.57 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 3080 RTX 2060 RTX 3090 RTX 3070 Ti NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 3060 0.432 0.864 1.296 1.728 2.16 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.72 1.76 1.79 1.79 1.80 1.81 1.81 1.82 1.82 1.83 1.87 1.88 1.91 1.92 MIN: 1.7 / MAX: 3.09 MIN: 1.73 / MAX: 2.62 MIN: 1.76 / MAX: 2.81 MIN: 1.77 / MAX: 3.16 MIN: 1.78 / MAX: 2.99 MIN: 1.79 / MAX: 3.1 MIN: 1.79 / MAX: 4.69 MIN: 1.79 / MAX: 8.7 MIN: 1.79 / MAX: 4.97 MIN: 1.81 / MAX: 4.77 MIN: 1.84 / MAX: 4.81 MIN: 1.84 / MAX: 5.51 MIN: 1.89 / MAX: 2.84 MIN: 1.88 / MAX: 8.45 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 2070 SUPER RTX 2060 SUPER RTX 2060 RTX 2070 RTX 3080 RTX 3090 NVIDIA RTX 3090 RTX 3070 Ti 3090 RTX 3080Ti RTX 3060Ti RTX 3070 RTX 3060 NVIDIA RTX 3060 0.4838 0.9676 1.4514 1.9352 2.419 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.94 1.97 2.00 2.02 2.04 2.06 2.06 2.06 2.07 2.09 2.11 2.11 2.14 2.15 MIN: 1.92 / MAX: 3 MIN: 1.95 / MAX: 3.04 MIN: 1.98 / MAX: 2.91 MIN: 2 / MAX: 4.82 MIN: 2.02 / MAX: 2.27 MIN: 2.05 / MAX: 2.49 MIN: 2.04 / MAX: 2.62 MIN: 2.04 / MAX: 4.66 MIN: 2.05 / MAX: 2.62 MIN: 2.06 / MAX: 4.83 MIN: 2.07 / MAX: 4.83 MIN: 2.08 / MAX: 3.71 MIN: 2.11 / MAX: 4.76 MIN: 2.12 / MAX: 4.81 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 2070 SUPER RTX 2060 SUPER RTX 2060 RTX 2070 RTX 3080 RTX 3090 RTX 3070 Ti NVIDIA RTX 3090 3090 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3060 NVIDIA RTX 3060 0.3848 0.7696 1.1544 1.5392 1.924 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.59 1.60 1.63 1.64 1.64 1.65 1.65 1.66 1.66 1.67 1.67 1.67 1.70 1.71 MIN: 1.57 / MAX: 2.93 MIN: 1.59 / MAX: 2.59 MIN: 1.61 / MAX: 2.77 MIN: 1.62 / MAX: 2.66 MIN: 1.61 / MAX: 2.43 MIN: 1.64 / MAX: 2.43 MIN: 1.62 / MAX: 6.14 MIN: 1.63 / MAX: 2.59 MIN: 1.63 / MAX: 2.99 MIN: 1.64 / MAX: 2.7 MIN: 1.65 / MAX: 2.01 MIN: 1.64 / MAX: 3.01 MIN: 1.68 / MAX: 2.76 MIN: 1.69 / MAX: 2.81 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 RTX 3080 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3090 RTX 3080Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 3060 0.4545 0.909 1.3635 1.818 2.2725 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.78 1.81 1.85 1.86 1.90 1.92 1.92 1.92 1.93 1.94 1.97 1.98 2.01 2.02 MIN: 1.76 / MAX: 2.56 MIN: 1.8 / MAX: 2.09 MIN: 1.83 / MAX: 2.02 MIN: 1.83 / MAX: 4.81 MIN: 1.87 / MAX: 8.44 MIN: 1.9 / MAX: 2.79 MIN: 1.89 / MAX: 4.81 MIN: 1.89 / MAX: 4.79 MIN: 1.91 / MAX: 8.55 MIN: 1.92 / MAX: 3.04 MIN: 1.94 / MAX: 4.81 MIN: 1.95 / MAX: 8.5 MIN: 1.98 / MAX: 5.81 MIN: 1.97 / MAX: 12.09 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 2070 SUPER RTX 2060 SUPER RTX 2060 RTX 2070 RTX 3080 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080Ti RTX 3060Ti RTX 3070 RTX 3060 NVIDIA RTX 3060 0.729 1.458 2.187 2.916 3.645 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.92 2.96 3.02 3.05 3.05 3.08 3.08 3.09 3.09 3.12 3.13 3.13 3.21 3.24 MIN: 2.88 / MAX: 5.47 MIN: 2.92 / MAX: 9.52 MIN: 2.99 / MAX: 5.02 MIN: 3.02 / MAX: 4.81 MIN: 3.02 / MAX: 3.36 MIN: 3.06 / MAX: 4.67 MIN: 3.04 / MAX: 4.85 MIN: 3.06 / MAX: 6.04 MIN: 3.05 / MAX: 4.84 MIN: 3.09 / MAX: 4.84 MIN: 3.1 / MAX: 4.87 MIN: 3.1 / MAX: 4.82 MIN: 3.18 / MAX: 4.81 MIN: 3.19 / MAX: 4.87 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface NVIDIA RTX 3090 RTX 3080Ti RTX 3090 3090 RTX 3080 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 RTX 3060Ti RTX 3070 RTX 3070 Ti RTX 3060 NVIDIA RTX 3060 0.2138 0.4276 0.6414 0.8552 1.069 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.87 0.88 0.88 0.88 0.88 0.91 0.91 0.93 0.93 0.93 0.93 0.93 0.95 0.95 MIN: 0.85 / MAX: 1.89 MIN: 0.86 / MAX: 1.84 MIN: 0.85 / MAX: 1.76 MIN: 0.85 / MAX: 1.71 MIN: 0.86 / MAX: 1.91 MIN: 0.88 / MAX: 1.8 MIN: 0.89 / MAX: 1.94 MIN: 0.9 / MAX: 2.01 MIN: 0.91 / MAX: 2 MIN: 0.91 / MAX: 1.68 MIN: 0.91 / MAX: 1.8 MIN: 0.91 / MAX: 1.99 MIN: 0.93 / MAX: 1.89 MIN: 0.93 / MAX: 1.92 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 2070 SUPER RTX 3080 3090 RTX 3070 Ti RTX 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 2070 RTX 3060Ti RTX 2060 SUPER RTX 2060 RTX 3070 NVIDIA RTX 3060 RTX 3060 0.9675 1.935 2.9025 3.87 4.8375 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.00, N = 2 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 2 SE +/- 0.00, N = 2 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 3.86 3.90 3.92 3.93 4.02 4.08 4.11 4.13 4.14 4.19 4.21 4.24 4.28 4.30 MIN: 3.44 / MAX: 11.03 MIN: 3.51 / MAX: 17.33 MIN: 3.57 / MAX: 18.33 MIN: 3.59 / MAX: 13.6 MIN: 3.57 / MAX: 16.52 MIN: 3.57 / MAX: 15.4 MIN: 3.62 / MAX: 17.74 MIN: 3.63 / MAX: 11.49 MIN: 3.75 / MAX: 13.91 MIN: 3.57 / MAX: 12.23 MIN: 3.71 / MAX: 19.56 MIN: 3.72 / MAX: 13.94 MIN: 3.91 / MAX: 22.46 MIN: 3.91 / MAX: 15 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 4.01 4.03 4.04 4.13 4.36 5.07 5.43 5.76 7.24 7.25 7.90 8.78 8.87 9.96 MIN: 3.97 / MAX: 6.67 MIN: 3.98 / MAX: 10.03 MIN: 3.98 / MAX: 13.19 MIN: 4.1 / MAX: 7.68 MIN: 4.31 / MAX: 6.26 MIN: 5.02 / MAX: 9.32 MIN: 5.33 / MAX: 19.97 MIN: 5.68 / MAX: 13.67 MIN: 7.11 / MAX: 16.52 MIN: 7.15 / MAX: 16.65 MIN: 7.39 / MAX: 17.42 MIN: 8.15 / MAX: 25.5 MIN: 8.62 / MAX: 23.64 MIN: 9.52 / MAX: 24.93 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 NVIDIA RTX 3090 3090 RTX 3090 RTX 3080 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.51 1.51 1.52 1.52 1.53 1.62 1.64 1.70 1.90 1.90 1.93 1.99 2.00 2.19 MIN: 1.49 / MAX: 1.76 MIN: 1.49 / MAX: 1.7 MIN: 1.49 / MAX: 4.09 MIN: 1.49 / MAX: 2.49 MIN: 1.51 / MAX: 1.76 MIN: 1.61 / MAX: 3.82 MIN: 1.62 / MAX: 1.88 MIN: 1.68 / MAX: 4.79 MIN: 1.88 / MAX: 2.08 MIN: 1.88 / MAX: 2.05 MIN: 1.88 / MAX: 12.22 MIN: 1.97 / MAX: 2.15 MIN: 1.98 / MAX: 2.13 MIN: 2.17 / MAX: 2.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3090 NVIDIA RTX 3090 3090 RTX 3080 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 0.5918 1.1836 1.7754 2.3672 2.959 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.74 1.74 1.74 1.75 1.76 1.79 1.87 1.90 2.07 2.07 2.31 2.42 2.45 2.63 MIN: 1.72 / MAX: 1.89 MIN: 1.72 / MAX: 1.94 MIN: 1.72 / MAX: 1.92 MIN: 1.72 / MAX: 4.78 MIN: 1.74 / MAX: 1.92 MIN: 1.78 / MAX: 1.94 MIN: 1.83 / MAX: 4.81 MIN: 1.85 / MAX: 8.61 MIN: 2.03 / MAX: 5.86 MIN: 2.05 / MAX: 2.22 MIN: 2.06 / MAX: 3.47 MIN: 2.34 / MAX: 2.93 MIN: 2.39 / MAX: 4.82 MIN: 2.51 / MAX: 4.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3080 RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 2060 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 RTX 2060 1.0103 2.0206 3.0309 4.0412 5.0515 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 3.40 3.41 3.41 3.42 3.47 3.59 3.73 3.80 3.94 4.16 4.17 4.18 4.19 4.49 MIN: 3.37 / MAX: 3.58 MIN: 3.39 / MAX: 3.54 MIN: 3.39 / MAX: 4.83 MIN: 3.4 / MAX: 8.52 MIN: 3.45 / MAX: 4.72 MIN: 3.56 / MAX: 4.82 MIN: 3.67 / MAX: 4.82 MIN: 3.76 / MAX: 13.08 MIN: 3.91 / MAX: 4.89 MIN: 4.14 / MAX: 4.83 MIN: 4.15 / MAX: 4.26 MIN: 4.15 / MAX: 4.48 MIN: 4.16 / MAX: 4.31 MIN: 4.47 / MAX: 4.83 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3090 RTX 3080Ti NVIDIA RTX 3090 RTX 3080 3090 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 5.82 5.85 5.85 5.86 5.88 6.12 6.15 6.30 6.71 6.73 6.85 7.01 7.01 7.25 MIN: 5.57 / MAX: 6.24 MIN: 5.59 / MAX: 10.87 MIN: 5.6 / MAX: 6.5 MIN: 5.61 / MAX: 6.37 MIN: 5.58 / MAX: 12.45 MIN: 5.9 / MAX: 6.51 MIN: 5.94 / MAX: 6.41 MIN: 6.11 / MAX: 6.59 MIN: 6.58 / MAX: 7.1 MIN: 6.6 / MAX: 6.89 MIN: 6.66 / MAX: 7.27 MIN: 6.91 / MAX: 10.62 MIN: 6.92 / MAX: 16.05 MIN: 7.17 / MAX: 7.38 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3090 NVIDIA RTX 3090 RTX 3080 3090 RTX 3080Ti RTX 3060Ti RTX 3070 RTX 3070 Ti RTX 2070 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 1.161 2.322 3.483 4.644 5.805 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 2 SE +/- 0.17, N = 2 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 3.92 4.10 4.10 4.13 4.15 4.27 4.32 4.34 4.74 4.77 4.83 4.90 4.90 5.16 MIN: 3.85 / MAX: 4.41 MIN: 3.84 / MAX: 8.44 MIN: 3.89 / MAX: 8.62 MIN: 3.89 / MAX: 6.1 MIN: 3.9 / MAX: 7.31 MIN: 4.16 / MAX: 4.55 MIN: 4.04 / MAX: 9.9 MIN: 4.04 / MAX: 7.74 MIN: 4.52 / MAX: 9.57 MIN: 4.67 / MAX: 5.06 MIN: 4.63 / MAX: 14.6 MIN: 4.65 / MAX: 7.98 MIN: 4.66 / MAX: 8.68 MIN: 4.86 / MAX: 21.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 RTX 3080 RTX 3070 Ti NVIDIA RTX 3090 RTX 3060Ti RTX 3090 3090 RTX 3080Ti RTX 3070 NVIDIA RTX 3060 RTX 3060 0.5445 1.089 1.6335 2.178 2.7225 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 2.17 2.19 2.24 2.25 2.32 2.34 2.36 2.37 2.37 2.37 2.39 2.39 2.41 2.42 MIN: 2.15 / MAX: 2.49 MIN: 2.17 / MAX: 2.95 MIN: 2.23 / MAX: 2.46 MIN: 2.2 / MAX: 2.77 MIN: 2.3 / MAX: 3.35 MIN: 2.31 / MAX: 3.52 MIN: 2.35 / MAX: 2.94 MIN: 2.35 / MAX: 2.95 MIN: 2.35 / MAX: 2.86 MIN: 2.35 / MAX: 3.22 MIN: 2.36 / MAX: 2.88 MIN: 2.36 / MAX: 2.74 MIN: 2.39 / MAX: 3.22 MIN: 2.37 / MAX: 10.64 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 8 16 24 32 40 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 2.63, N = 15 SE +/- 2.61, N = 15 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 9.42 9.44 9.44 9.70 11.24 14.38 15.69 17.42 26.10 28.10 29.89 30.10 36.03
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX NVIDIA RTX 3090 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 30 60 90 120 150 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.30, N = 3 SE +/- 1.28, N = 3 SE +/- 1.24, N = 3 SE +/- 1.05, N = 3 28.51 28.56 28.61 29.61 33.85 42.76 45.71 52.05 73.10 89.01 142.69 146.40 146.87
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3090 NVIDIA RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 15 30 45 60 75 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 2.69, N = 15 SE +/- 2.71, N = 15 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 18.99 19.00 19.01 19.80 22.67 31.44 33.30 39.00 52.85 56.45 59.97 60.30 69.56
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 RTX 3090 3090 NVIDIA RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3060Ti RTX 3070 RTX 2070 RTX 2060 SUPER RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 10K 20K 30K 40K 50K SE +/- 315.62, N = 3 SE +/- 524.00, N = 3 SE +/- 516.79, N = 4 SE +/- 392.62, N = 9 SE +/- 495.84, N = 3 SE +/- 436.94, N = 4 SE +/- 189.63, N = 3 SE +/- 83.35, N = 3 SE +/- 85.43, N = 3 SE +/- 231.75, N = 3 SE +/- 219.94, N = 3 SE +/- 187.36, N = 3 SE +/- 157.50, N = 3 44486 43849 43830 43263 40852 37970 33746 31446 30028 29970 29335 27278 22746 1. (CXX) g++ options: -O3 -pthread
GravityMark Resolution: 1920 x 1080 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: OpenGL NVIDIA RTX 3090 RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 40 80 120 160 200 SE +/- 0.44, N = 3 SE +/- 0.22, N = 3 SE +/- 0.72, N = 3 SE +/- 0.12, N = 3 SE +/- 0.50, N = 3 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.50, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.43, N = 3 170.1 169.7 169.4 164.7 160.6 136.4 134.9 132.1 114.4 110.4 103.9 101.5 94.9
GravityMark Resolution: 1920 x 1080 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: Vulkan 3090 NVIDIA RTX 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 60 120 180 240 300 SE +/- 0.58, N = 3 SE +/- 0.03, N = 3 SE +/- 0.50, N = 3 SE +/- 0.20, N = 3 SE +/- 0.20, N = 3 SE +/- 0.32, N = 3 SE +/- 0.29, N = 3 SE +/- 0.27, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 269.9 269.3 269.2 262.5 248.2 212.2 201.3 188.0 149.6 149.3 139.1 138.8 116.4
GravityMark Resolution: 2560 x 1440 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: OpenGL 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 30 60 90 120 150 SE +/- 0.69, N = 3 SE +/- 0.35, N = 3 SE +/- 0.64, N = 3 SE +/- 0.42, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.40, N = 3 SE +/- 0.22, N = 3 SE +/- 0.12, N = 3 SE +/- 0.20, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 153.3 153.3 147.6 143.1 118.7 117.3 113.5 96.7 93.3 87.8 86.4 79.5
GravityMark Resolution: 2560 x 1440 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: Vulkan 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 50 100 150 200 250 SE +/- 0.21, N = 3 SE +/- 0.26, N = 3 SE +/- 0.15, N = 3 SE +/- 0.34, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.20, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 233.4 232.7 226.1 210.4 176.5 164.0 153.3 121.4 120.0 112.5 112.0 93.0
GravityMark Resolution: 3840 x 2160 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: OpenGL 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER NVIDIA RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 30 60 90 120 150 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.17, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 130.7 130.3 125.8 120.2 96.2 93.6 89.8 74.6 72.8 67.5 66.5 59.5
GravityMark Resolution: 3840 x 2160 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: Vulkan RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 40 80 120 160 200 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.18, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 178.6 178.5 173.5 158.1 128.9 116.1 108.5 84.0 83.6 78.4 77.8 64.3
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 3 6 9 12 15 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.028, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 SE +/- 0.010, N = 3 SE +/- 0.016, N = 3 SE +/- 0.028, N = 3 SE +/- 0.006, N = 3 SE +/- 0.018, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 5.606 5.614 5.729 6.113 7.155 7.898 8.384 10.093 10.456 11.524 11.671 12.901
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 20 40 60 80 100 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 28.73 28.74 29.81 32.85 41.30 47.05 51.30 63.88 68.16 75.69 76.68 86.36
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes 3090 RTX 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2060 SUPER RTX 2070 RTX 2060 1.3149 2.6298 3.9447 5.2596 6.5745 SE +/- 0.004, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.006, N = 3 SE +/- 0.005, N = 3 SE +/- 0.007, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.008, N = 3 SE +/- 0.007, N = 3 SE +/- 0.016, N = 3 SE +/- 0.024, N = 3 3.310 3.314 3.355 3.444 3.820 4.123 4.287 4.848 4.978 5.317 5.353 5.844
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms 3090 RTX 3080Ti RTX 3090 RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 2070 SUPER RTX 3060 RTX 2070 RTX 2060 SUPER RTX 2060 0.0379 0.0758 0.1137 0.1516 0.1895 SE +/- 0.00003, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00103, N = 3 SE +/- 0.00140, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00094, N = 3 SE +/- 0.00006, N = 3 SE +/- 0.00012, N = 3 SE +/- 0.00015, N = 3 SE +/- 0.00047, N = 3 SE +/- 0.00063, N = 3 SE +/- 0.00014, N = 3 0.11951 0.11958 0.12001 0.12250 0.12415 0.12726 0.12830 0.14020 0.15237 0.15287 0.15476 0.16856
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 8K 16K 24K 32K 40K SE +/- 412.81, N = 3 SE +/- 278.45, N = 3 SE +/- 111.06, N = 3 SE +/- 230.16, N = 3 SE +/- 231.99, N = 3 SE +/- 232.47, N = 3 SE +/- 168.30, N = 3 SE +/- 125.30, N = 3 SE +/- 129.25, N = 3 SE +/- 144.05, N = 3 SE +/- 87.16, N = 3 SE +/- 59.29, N = 3 39001 38687 38444 38103 35401 32980 30371 22236 21079 17674 17484 14473 1. (CXX) g++ options: -flto -pthread
Chaos Group V-RAY Mode: NVIDIA RTX GPU OpenBenchmarking.org vrays, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA RTX GPU RTX 3090 3090 RTX 3080Ti RTX 3080 RTX 3070 Ti RTX 3070 RTX 3060Ti RTX 3060 RTX 2070 SUPER RTX 2060 SUPER RTX 2070 RTX 2060 600 1200 1800 2400 3000 SE +/- 3.00, N = 3 SE +/- 8.88, N = 3 SE +/- 6.06, N = 3 SE +/- 4.73, N = 3 SE +/- 1.76, N = 3 SE +/- 1.00, N = 3 SE +/- 2.40, N = 3 SE +/- 1.45, N = 3 SE +/- 1.67, N = 3 SE +/- 0.88, N = 3 2928 2917 2850 2446 2034 1880 1716 1207 1055 826 798 733
Phoronix Test Suite v10.8.5