nvidia linux Tests for a future article. AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3080 10GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2110101-TJ-NVIDIALIN34&grs&rdt .
nvidia linux Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB eVGA NVIDIA GeForce GTX 1660 Ti 6GB NVIDIA TU116 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 20.04 5.11.0-37-generic (x86_64) GNOME Shell 3.36.9 X Server 1.20.11 NVIDIA 470.74 4.6.0 OpenCL 3.0 CUDA 11.4.136 1.2.175 GCC 9.3.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio eVGA NVIDIA GeForce GTX 1660 SUPER 6GB NVIDIA TU116 HD Audio eVGA NVIDIA GeForce RTX 3060 12GB NVIDIA Device 228e NVIDIA GeForce RTX 2070 SUPER 8GB NVIDIA TU104 HD Audio ASUS NVIDIA GeForce RTX 2070 8GB NVIDIA TU106 HD Audio NVIDIA GeForce RTX 2060 SUPER 8GB NVIDIA GeForce RTX 2060 6GB NVIDIA GeForce RTX 3060 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 Ti 12GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3090 24GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 10GB NVIDIA Device 1aef OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016 Graphics Details - GTX 1660Ti: BAR1 / Visible vRAM Size: 256 MiB - GTX 1060: BAR1 / Visible vRAM Size: 256 MiB - GTX 1660 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - NVIDIA RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - RTX 2070 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2070: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080Ti: BAR1 / Visible vRAM Size: 16384 MiB - RTX 3070: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - NVIDIA RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - 3090: BAR1 / Visible vRAM Size: 32768 MiB - RTX 3070 Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080: BAR1 / Visible vRAM Size: 256 MiB OpenCL Details - GTX 1660Ti: GPU Compute Cores: 1536 - GTX 1060: GPU Compute Cores: 1280 - GTX 1660 SUPER: GPU Compute Cores: 1408 - RTX 3060: GPU Compute Cores: 3584 - NVIDIA RTX 3060: GPU Compute Cores: 3584 - RTX 2070 SUPER: GPU Compute Cores: 2560 - RTX 2070: GPU Compute Cores: 2304 - RTX 2060 SUPER: GPU Compute Cores: 2176 - RTX 2060: GPU Compute Cores: 1920 - RTX 3060Ti: GPU Compute Cores: 4864 - RTX 3080Ti: GPU Compute Cores: 10240 - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - NVIDIA RTX 3090: GPU Compute Cores: 10496 - 3090: GPU Compute Cores: 10496 - RTX 3070 Ti: GPU Compute Cores: 6144 - RTX 3080: GPU Compute Cores: 8704 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected Compiler Details - RTX 3060, NVIDIA RTX 3060, RTX 2070 SUPER, RTX 2070, RTX 2060 SUPER, RTX 2060, RTX 3060Ti, RTX 3080Ti, RTX 3070, RTX 3090, NVIDIA RTX 3090, 3090, RTX 3070 Ti, RTX 3080: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
nvidia linux v-ray: NVIDIA CUDA GPU octanebench: Total Score hashcat: TrueCrypt RIPEMD160 + XTS hashcat: SHA-512 hashcat: 7-Zip hashcat: MD5 blender: Classroom - NVIDIA OptiX hashcat: SHA1 v-ray: NVIDIA RTX GPU blender: BMW27 - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX realsr-ncnn: 4x - Yes gravitymark: 3840 x 2160 - Vulkan lczero: OpenCL gravitymark: 2560 x 1440 - Vulkan ncnn: Vulkan GPU - vgg16 gravitymark: 1920 x 1080 - Vulkan realsr-ncnn: 4x - No gravitymark: 3840 x 2160 - OpenGL vkfft: gravitymark: 2560 x 1440 - OpenGL gravitymark: 1920 x 1080 - OpenGL waifu2x-ncnn: 2x - 3 - Yes ncnn: Vulkan GPU - alexnet etlegacy: 3840 x 2160 ncnn: Vulkan GPU - resnet18 namd-cuda: ATPase Simulation - 327,506 Atoms ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - shufflenet-v2 redshift: GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 442 133.125997 253767 854600000 355133 19620766667 6702033333 495.2 249 81.44449 137633 483533333 189133 13119800000 4455966667 445.2 456 133.086823 235133 792333333 330833 18355966667 6235366667 482.9 73.10 1207 26.10 56.45 68.156 22236 7.24 10.456 4.978 2.07 1.90 0.15237 4.17 4.77 6.71 2.02 1.92 2.42 4.30 4.38 3.21 2.14 0.95 1.70 851 294.020104 291333 992833333 410267 24825266667 7790600000 84.0 120.0 7.25 149.3 72.8 27278 93.3 110.4 2.07 590.6 1.93 4.18 4.83 6.73 2.01 1.91 2.41 4.28 4.39 3.24 2.15 0.95 1.71 834 261.828555 416900 1438900000 580233 35928633333 89.01 11276666667 1055 28.10 52.85 63.881 83.6 21079 121.4 7.90 149.6 10.093 74.6 29335 96.7 114.4 4.848 2.31 630.7 1.90 0.14020 3.94 4.74 6.85 1.78 1.72 2.17 3.86 4.13 2.92 1.94 0.91 1.59 513 244.190524 353967 1224300000 491500 30641800000 146.40 9694933333 798 30.10 59.97 75.692 78.4 17674 112.5 8.78 139.1 11.524 66.5 30028 86.4 101.5 5.353 2.45 591.6 2 0.15287 4.19 4.90 7.01 1.85 1.79 2.24 4.13 4.30 3.05 2.02 0.93 1.64 528 243.812534 348033 1198700000 482933 29907933333 142.69 9468200000 826 29.89 60.30 76.681 77.8 17484 112.0 8.87 138.8 11.671 67.5 29970 87.8 103.9 5.317 2.42 559.7 1.99 0.15476 4.16 4.90 7.01 1.81 1.76 2.19 4.19 4.26 2.96 1.97 0.91 1.6 505 195.639962 305833 1062933333 435700 26593433333 146.87 8390766667 733 36.03 69.56 86.359 64.3 14473 93.0 9.96 116.4 12.901 59.5 22746 79.5 94.9 5.844 2.63 557.6 2.19 0.16856 4.49 5.16 7.25 1.86 1.80 2.25 4.21 4.40 3.02 2.00 0.93 1.63 1260 384.119086 417467 1412966667 569333 35414300000 52.05 11069666667 1716 17.42 39.00 51.297 108.5 30371 153.3 5.76 188.0 8.384 89.8 33746 113.5 132.1 4.287 1.90 645.3 1.70 0.12830 3.80 4.27 6.30 1.98 1.88 2.37 4.14 4.17 3.13 2.11 0.93 1.67 2052 668.016818 805133 2762600000 1066767 68466466667 29.61 21732166667 2850 9.70 19.80 29.814 173.5 38444 226.1 4.13 262.5 5.729 125.8 43263 147.6 164.7 3.355 1.76 646.5 1.53 0.11958 3.47 4.15 5.85 1.94 1.83 2.39 4.11 4.01 3.12 2.09 0.88 1.67 1418 414.231909 488467 1682733333 663433 41900433333 45.71 13140600000 1880 15.69 33.30 47.047 116.1 32980 164.0 5.43 201.3 7.898 93.6 31446 117.3 134.9 4.123 1.87 645.5 1.64 0.12726 3.73 4.32 6.15 1.97 1.87 2.39 4.24 4.10 3.13 2.11 0.93 1.67 2111 684.778798 832767 2890933333 1113033 72520866667 28.61 22954666667 2928 9.42 18.99 28.744 178.6 39001 232.7 4.01 269.2 5.614 130.3 44486 153.3 169.7 3.314 1.74 654.5 1.52 0.12001 3.41 3.92 5.82 1.93 1.81 2.37 4.02 4.00 3.08 2.06 0.88 1.65 2112 680.453461 818267 2857066667 1104300 70873300000 28.51 22570933333 9.44 19.00 4.03 269.3 43830 170.1 1.74 581.5 1.51 3.41 4.10 5.85 1.92 1.82 2.36 4.08 4 3.08 2.06 0.87 1.66 2111 680.626427 822167 2861100000 1101967 70253400000 28.56 22452233333 2917 9.44 19.01 28.729 178.5 38687 233.4 4.04 269.9 5.606 130.7 43849 153.3 169.4 3.310 1.74 667.2 1.51 0.11951 3.42 4.13 5.88 1.92 1.82 2.37 3.92 4 3.09 2.07 0.88 1.66 1501 454.752121 505733 1717533333 709967 42901566667 42.76 13536633333 2034 14.38 31.44 41.302 128.9 35401 176.5 5.07 212.2 7.155 96.2 37970 118.7 136.4 3.820 1.79 648.3 1.62 0.12415 3.59 4.34 6.12 1.92 1.81 2.34 3.93 4.02 3.09 2.06 0.93 1.65 1774 570.414463 724700 2466033333 972500 61586233333 33.85 19440866667 2446 11.24 22.67 32.845 158.1 38103 210.4 4.36 248.2 6.113 120.2 40852 143.1 160.6 3.444 1.75 639.3 1.52 0.12250 3.40 4.10 5.86 1.90 1.79 2.32 3.90 3.96 3.05 2.04 0.88 1.64 OpenBenchmarking.org
Chaos Group V-RAY Mode: NVIDIA CUDA GPU OpenBenchmarking.org vpaths, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA CUDA GPU GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 500 1000 1500 2000 2500 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 1.15, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 1.86, N = 3 SE +/- 0.33, N = 3 SE +/- 2.60, N = 3 SE +/- 2.33, N = 3 SE +/- 2.19, N = 3 SE +/- 1.86, N = 3 442 249 456 851 834 513 528 505 1260 2052 1418 2111 2112 2111 1501 1774
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 150 300 450 600 750 133.13 81.44 133.09 294.02 261.83 244.19 243.81 195.64 384.12 668.02 414.23 684.78 680.45 680.63 454.75 570.41
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 200K 400K 600K 800K 1000K SE +/- 533.33, N = 3 SE +/- 33.33, N = 3 SE +/- 554.78, N = 3 SE +/- 600.93, N = 3 SE +/- 2318.05, N = 3 SE +/- 2602.78, N = 3 SE +/- 317.98, N = 3 SE +/- 1975.12, N = 3 SE +/- 3507.29, N = 3 SE +/- 7319.46, N = 3 SE +/- 4139.78, N = 3 SE +/- 5546.87, N = 3 SE +/- 688.80, N = 3 SE +/- 296.27, N = 3 SE +/- 2906.51, N = 3 SE +/- 2706.17, N = 3 253767 137633 235133 291333 416900 353967 348033 305833 417467 805133 488467 832767 818267 822167 505733 724700
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 600M 1200M 1800M 2400M 3000M SE +/- 115470.05, N = 3 SE +/- 66666.67, N = 3 SE +/- 864741.45, N = 3 SE +/- 1083717.88, N = 3 SE +/- 152752.52, N = 3 SE +/- 568624.07, N = 3 SE +/- 1500000.00, N = 3 SE +/- 1560270.63, N = 3 SE +/- 4611700.10, N = 3 SE +/- 4194043.40, N = 3 SE +/- 3238483.87, N = 3 SE +/- 5366666.67, N = 3 SE +/- 1039764.93, N = 3 SE +/- 1715614.56, N = 3 SE +/- 829323.69, N = 3 SE +/- 4117577.50, N = 3 854600000 483533333 792333333 992833333 1438900000 1224300000 1198700000 1062933333 1412966667 2762600000 1682733333 2890933333 2857066667 2861100000 1717533333 2466033333
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 200K 400K 600K 800K 1000K SE +/- 712.59, N = 3 SE +/- 578.31, N = 3 SE +/- 504.42, N = 3 SE +/- 533.33, N = 3 SE +/- 783.87, N = 3 SE +/- 493.29, N = 3 SE +/- 669.16, N = 3 SE +/- 680.69, N = 3 SE +/- 696.02, N = 3 SE +/- 1767.61, N = 3 SE +/- 1897.66, N = 3 SE +/- 5304.82, N = 3 SE +/- 1587.45, N = 3 SE +/- 920.75, N = 3 SE +/- 1785.43, N = 3 SE +/- 2685.76, N = 3 355133 189133 330833 410267 580233 491500 482933 435700 569333 1066767 663433 1113033 1104300 1101967 709967 972500
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 16000M 32000M 48000M 64000M 80000M SE +/- 33080726.18, N = 3 SE +/- 4813522.62, N = 3 SE +/- 61580741.94, N = 3 SE +/- 12235785.40, N = 3 SE +/- 34379515.86, N = 3 SE +/- 11557248.81, N = 3 SE +/- 53112532.52, N = 3 SE +/- 58270127.66, N = 3 SE +/- 62466737.82, N = 3 SE +/- 278660763.49, N = 3 SE +/- 52398642.90, N = 3 SE +/- 151860520.80, N = 3 SE +/- 89401584.62, N = 3 SE +/- 43362195.52, N = 3 SE +/- 53053631.15, N = 3 SE +/- 122029850.63, N = 3 19620766667 13119800000 18355966667 24825266667 35928633333 30641800000 29907933333 26593433333 35414300000 68466466667 41900433333 72520866667 70873300000 70253400000 42901566667 61586233333
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.30, N = 3 SE +/- 1.24, N = 3 SE +/- 1.28, N = 3 SE +/- 1.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 73.10 89.01 146.40 142.69 146.87 52.05 29.61 45.71 28.61 28.51 28.56 42.76 33.85
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 5000M 10000M 15000M 20000M 25000M SE +/- 16083670.12, N = 3 SE +/- 2008592.65, N = 3 SE +/- 10383694.48, N = 3 SE +/- 4454585.65, N = 3 SE +/- 14748144.89, N = 3 SE +/- 36354107.21, N = 3 SE +/- 5602677.93, N = 3 SE +/- 19016338.00, N = 3 SE +/- 11142461.33, N = 3 SE +/- 54926142.33, N = 3 SE +/- 17350024.02, N = 3 SE +/- 52625416.34, N = 3 SE +/- 40688750.83, N = 3 SE +/- 42808501.23, N = 3 SE +/- 7460414.05, N = 3 SE +/- 36421620.56, N = 3 6702033333 4455966667 6235366667 7790600000 11276666667 9694933333 9468200000 8390766667 11069666667 21732166667 13140600000 22954666667 22570933333 22452233333 13536633333 19440866667
Chaos Group V-RAY Mode: NVIDIA RTX GPU OpenBenchmarking.org vrays, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA RTX GPU RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 600 1200 1800 2400 3000 SE +/- 1.67, N = 3 SE +/- 1.45, N = 3 SE +/- 0.88, N = 3 SE +/- 2.40, N = 3 SE +/- 6.06, N = 3 SE +/- 1.00, N = 3 SE +/- 3.00, N = 3 SE +/- 8.88, N = 3 SE +/- 1.76, N = 3 SE +/- 4.73, N = 3 1207 1055 798 826 733 1716 2850 1880 2928 2917 2034 2446
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 8 16 24 32 40 SE +/- 2.63, N = 15 SE +/- 2.61, N = 15 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 26.10 28.10 30.10 29.89 36.03 17.42 9.70 15.69 9.42 9.44 9.44 14.38 11.24
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 15 30 45 60 75 SE +/- 2.71, N = 15 SE +/- 2.69, N = 15 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 56.45 52.85 59.97 60.30 69.56 39.00 19.80 33.30 18.99 19.00 19.01 31.44 22.67
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 68.16 63.88 75.69 76.68 86.36 51.30 29.81 47.05 28.74 28.73 41.30 32.85
GravityMark Resolution: 3840 x 2160 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 84.0 83.6 78.4 77.8 64.3 108.5 173.5 116.1 178.6 178.5 128.9 158.1
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 8K 16K 24K 32K 40K SE +/- 125.30, N = 3 SE +/- 129.25, N = 3 SE +/- 144.05, N = 3 SE +/- 87.16, N = 3 SE +/- 59.29, N = 3 SE +/- 168.30, N = 3 SE +/- 111.06, N = 3 SE +/- 232.47, N = 3 SE +/- 412.81, N = 3 SE +/- 278.45, N = 3 SE +/- 231.99, N = 3 SE +/- 230.16, N = 3 22236 21079 17674 17484 14473 30371 38444 32980 39001 38687 35401 38103 1. (CXX) g++ options: -flto -pthread
GravityMark Resolution: 2560 x 1440 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 50 100 150 200 250 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.28, N = 3 SE +/- 0.26, N = 3 SE +/- 0.21, N = 3 SE +/- 0.32, N = 3 SE +/- 0.34, N = 3 120.0 121.4 112.5 112.0 93.0 153.3 226.1 164.0 232.7 233.4 176.5 210.4
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 7.24 7.25 7.90 8.78 8.87 9.96 5.76 4.13 5.43 4.01 4.03 4.04 5.07 4.36 MIN: 7.11 / MAX: 16.52 MIN: 7.15 / MAX: 16.65 MIN: 7.39 / MAX: 17.42 MIN: 8.15 / MAX: 25.5 MIN: 8.62 / MAX: 23.64 MIN: 9.52 / MAX: 24.93 MIN: 5.68 / MAX: 13.67 MIN: 4.1 / MAX: 7.68 MIN: 5.33 / MAX: 19.97 MIN: 3.97 / MAX: 6.67 MIN: 3.98 / MAX: 10.03 MIN: 3.98 / MAX: 13.19 MIN: 5.02 / MAX: 9.32 MIN: 4.31 / MAX: 6.26 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
GravityMark Resolution: 1920 x 1080 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 60 120 180 240 300 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.27, N = 3 SE +/- 0.20, N = 3 SE +/- 0.29, N = 3 SE +/- 0.50, N = 3 SE +/- 0.03, N = 3 SE +/- 0.58, N = 3 SE +/- 0.32, N = 3 SE +/- 0.20, N = 3 149.3 149.6 139.1 138.8 116.4 188.0 262.5 201.3 269.2 269.3 269.9 212.2 248.2
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 3 6 9 12 15 SE +/- 0.006, N = 3 SE +/- 0.028, N = 3 SE +/- 0.018, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.016, N = 3 SE +/- 0.028, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.010, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 10.456 10.093 11.524 11.671 12.901 8.384 5.729 7.898 5.614 5.606 7.155 6.113
GravityMark Resolution: 3840 x 2160 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.23, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 72.8 74.6 66.5 67.5 59.5 89.8 125.8 93.6 130.3 130.7 96.2 120.2
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 10K 20K 30K 40K 50K SE +/- 187.36, N = 3 SE +/- 219.94, N = 3 SE +/- 85.43, N = 3 SE +/- 231.75, N = 3 SE +/- 157.50, N = 3 SE +/- 189.63, N = 3 SE +/- 392.62, N = 9 SE +/- 83.35, N = 3 SE +/- 315.62, N = 3 SE +/- 516.79, N = 4 SE +/- 524.00, N = 3 SE +/- 436.94, N = 4 SE +/- 495.84, N = 3 27278 29335 30028 29970 22746 33746 43263 31446 44486 43830 43849 37970 40852 1. (CXX) g++ options: -O3 -pthread
GravityMark Resolution: 2560 x 1440 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.20, N = 3 SE +/- 0.03, N = 3 SE +/- 0.40, N = 3 SE +/- 0.64, N = 3 SE +/- 0.15, N = 3 SE +/- 0.35, N = 3 SE +/- 0.69, N = 3 SE +/- 0.20, N = 3 SE +/- 0.42, N = 3 93.3 96.7 86.4 87.8 79.5 113.5 147.6 117.3 153.3 153.3 118.7 143.1
GravityMark Resolution: 1920 x 1080 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.50, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.43, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.44, N = 3 SE +/- 0.72, N = 3 SE +/- 0.07, N = 3 SE +/- 0.50, N = 3 110.4 114.4 101.5 103.9 94.9 132.1 164.7 134.9 169.7 170.1 169.4 136.4 160.6
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 1.3149 2.6298 3.9447 5.2596 6.5745 SE +/- 0.008, N = 3 SE +/- 0.001, N = 3 SE +/- 0.016, N = 3 SE +/- 0.007, N = 3 SE +/- 0.024, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.007, N = 3 SE +/- 0.006, N = 3 SE +/- 0.004, N = 3 SE +/- 0.005, N = 3 SE +/- 0.006, N = 3 4.978 4.848 5.353 5.317 5.844 4.287 3.355 4.123 3.314 3.310 3.820 3.444
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.5918 1.1836 1.7754 2.3672 2.959 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.07 2.07 2.31 2.45 2.42 2.63 1.90 1.76 1.87 1.74 1.74 1.74 1.79 1.75 MIN: 2.03 / MAX: 5.86 MIN: 2.05 / MAX: 2.22 MIN: 2.06 / MAX: 3.47 MIN: 2.39 / MAX: 4.82 MIN: 2.34 / MAX: 2.93 MIN: 2.51 / MAX: 4.77 MIN: 1.85 / MAX: 8.61 MIN: 1.74 / MAX: 1.92 MIN: 1.83 / MAX: 4.81 MIN: 1.72 / MAX: 1.89 MIN: 1.72 / MAX: 1.94 MIN: 1.72 / MAX: 1.92 MIN: 1.78 / MAX: 1.94 MIN: 1.72 / MAX: 4.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
ET: Legacy Resolution: 3840 x 2160 OpenBenchmarking.org Frames Per Second, More Is Better ET: Legacy 2.78 Resolution: 3840 x 2160 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 140 280 420 560 700 SE +/- 4.09, N = 3 SE +/- 1.20, N = 3 SE +/- 3.91, N = 3 SE +/- 2.08, N = 3 SE +/- 1.83, N = 3 SE +/- 2.35, N = 3 SE +/- 26.17, N = 12 SE +/- 0.44, N = 3 SE +/- 3.68, N = 3 SE +/- 1.67, N = 3 SE +/- 6.77, N = 3 SE +/- 6.42, N = 5 SE +/- 72.37, N = 9 SE +/- 1.66, N = 3 SE +/- 4.84, N = 3 SE +/- 1.47, N = 3 495.2 445.2 482.9 590.6 630.7 591.6 559.7 557.6 645.3 646.5 645.5 654.5 581.5 667.2 648.3 639.3
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.01, N = 2 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.90 1.93 1.90 2.00 1.99 2.19 1.70 1.53 1.64 1.52 1.51 1.51 1.62 1.52 MIN: 1.88 / MAX: 2.08 MIN: 1.88 / MAX: 12.22 MIN: 1.88 / MAX: 2.05 MIN: 1.98 / MAX: 2.13 MIN: 1.97 / MAX: 2.15 MIN: 2.17 / MAX: 2.33 MIN: 1.68 / MAX: 4.79 MIN: 1.51 / MAX: 1.76 MIN: 1.62 / MAX: 1.88 MIN: 1.49 / MAX: 4.09 MIN: 1.49 / MAX: 1.76 MIN: 1.49 / MAX: 1.7 MIN: 1.61 / MAX: 3.82 MIN: 1.49 / MAX: 2.49 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 0.0379 0.0758 0.1137 0.1516 0.1895 SE +/- 0.00015, N = 3 SE +/- 0.00012, N = 3 SE +/- 0.00047, N = 3 SE +/- 0.00063, N = 3 SE +/- 0.00014, N = 3 SE +/- 0.00006, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00094, N = 3 SE +/- 0.00103, N = 3 SE +/- 0.00003, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00140, N = 3 0.15237 0.14020 0.15287 0.15476 0.16856 0.12830 0.11958 0.12726 0.12001 0.11951 0.12415 0.12250
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 1.0103 2.0206 3.0309 4.0412 5.0515 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.17 4.18 3.94 4.19 4.16 4.49 3.80 3.47 3.73 3.41 3.41 3.42 3.59 3.40 MIN: 4.15 / MAX: 4.26 MIN: 4.15 / MAX: 4.48 MIN: 3.91 / MAX: 4.89 MIN: 4.16 / MAX: 4.31 MIN: 4.14 / MAX: 4.83 MIN: 4.47 / MAX: 4.83 MIN: 3.76 / MAX: 13.08 MIN: 3.45 / MAX: 4.72 MIN: 3.67 / MAX: 4.82 MIN: 3.39 / MAX: 3.54 MIN: 3.39 / MAX: 4.83 MIN: 3.4 / MAX: 8.52 MIN: 3.56 / MAX: 4.82 MIN: 3.37 / MAX: 3.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 1.161 2.322 3.483 4.644 5.805 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 2 SE +/- 0.11, N = 3 SE +/- 0.13, N = 2 4.77 4.83 4.74 4.90 4.90 5.16 4.27 4.15 4.32 3.92 4.10 4.13 4.34 4.10 MIN: 4.67 / MAX: 5.06 MIN: 4.63 / MAX: 14.6 MIN: 4.52 / MAX: 9.57 MIN: 4.65 / MAX: 7.98 MIN: 4.66 / MAX: 8.68 MIN: 4.86 / MAX: 21.65 MIN: 4.16 / MAX: 4.55 MIN: 3.9 / MAX: 7.31 MIN: 4.04 / MAX: 9.9 MIN: 3.85 / MAX: 4.41 MIN: 3.84 / MAX: 8.44 MIN: 3.89 / MAX: 6.1 MIN: 4.04 / MAX: 7.74 MIN: 3.89 / MAX: 8.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 6.71 6.73 6.85 7.01 7.01 7.25 6.30 5.85 6.15 5.82 5.85 5.88 6.12 5.86 MIN: 6.58 / MAX: 7.1 MIN: 6.6 / MAX: 6.89 MIN: 6.66 / MAX: 7.27 MIN: 6.91 / MAX: 10.62 MIN: 6.92 / MAX: 16.05 MIN: 7.17 / MAX: 7.38 MIN: 6.11 / MAX: 6.59 MIN: 5.59 / MAX: 10.87 MIN: 5.94 / MAX: 6.41 MIN: 5.57 / MAX: 6.24 MIN: 5.6 / MAX: 6.5 MIN: 5.58 / MAX: 12.45 MIN: 5.9 / MAX: 6.51 MIN: 5.61 / MAX: 6.37 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4545 0.909 1.3635 1.818 2.2725 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.02 2.01 1.78 1.85 1.81 1.86 1.98 1.94 1.97 1.93 1.92 1.92 1.92 1.90 MIN: 1.97 / MAX: 12.09 MIN: 1.98 / MAX: 5.81 MIN: 1.76 / MAX: 2.56 MIN: 1.83 / MAX: 2.02 MIN: 1.8 / MAX: 2.09 MIN: 1.83 / MAX: 4.81 MIN: 1.95 / MAX: 8.5 MIN: 1.92 / MAX: 3.04 MIN: 1.94 / MAX: 4.81 MIN: 1.91 / MAX: 8.55 MIN: 1.9 / MAX: 2.79 MIN: 1.89 / MAX: 4.81 MIN: 1.89 / MAX: 4.79 MIN: 1.87 / MAX: 8.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.432 0.864 1.296 1.728 2.16 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.92 1.91 1.72 1.79 1.76 1.80 1.88 1.83 1.87 1.81 1.82 1.82 1.81 1.79 MIN: 1.88 / MAX: 8.45 MIN: 1.89 / MAX: 2.84 MIN: 1.7 / MAX: 3.09 MIN: 1.76 / MAX: 2.81 MIN: 1.73 / MAX: 2.62 MIN: 1.78 / MAX: 2.99 MIN: 1.84 / MAX: 5.51 MIN: 1.81 / MAX: 4.77 MIN: 1.84 / MAX: 4.81 MIN: 1.79 / MAX: 3.1 MIN: 1.79 / MAX: 8.7 MIN: 1.79 / MAX: 4.97 MIN: 1.79 / MAX: 4.69 MIN: 1.77 / MAX: 3.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.5445 1.089 1.6335 2.178 2.7225 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.42 2.41 2.17 2.24 2.19 2.25 2.37 2.39 2.39 2.37 2.36 2.37 2.34 2.32 MIN: 2.37 / MAX: 10.64 MIN: 2.39 / MAX: 3.22 MIN: 2.15 / MAX: 2.49 MIN: 2.23 / MAX: 2.46 MIN: 2.17 / MAX: 2.95 MIN: 2.2 / MAX: 2.77 MIN: 2.35 / MAX: 2.95 MIN: 2.36 / MAX: 2.88 MIN: 2.36 / MAX: 2.74 MIN: 2.35 / MAX: 2.86 MIN: 2.35 / MAX: 2.94 MIN: 2.35 / MAX: 3.22 MIN: 2.31 / MAX: 3.52 MIN: 2.3 / MAX: 3.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.9675 1.935 2.9025 3.87 4.8375 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 2 SE +/- 0.04, N = 3 SE +/- 0.07, N = 2 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.00, N = 2 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 4.30 4.28 3.86 4.13 4.19 4.21 4.14 4.11 4.24 4.02 4.08 3.92 3.93 3.90 MIN: 3.91 / MAX: 15 MIN: 3.91 / MAX: 22.46 MIN: 3.44 / MAX: 11.03 MIN: 3.63 / MAX: 11.49 MIN: 3.57 / MAX: 12.23 MIN: 3.71 / MAX: 19.56 MIN: 3.75 / MAX: 13.91 MIN: 3.62 / MAX: 17.74 MIN: 3.72 / MAX: 13.94 MIN: 3.57 / MAX: 16.52 MIN: 3.57 / MAX: 15.4 MIN: 3.57 / MAX: 18.33 MIN: 3.59 / MAX: 13.6 MIN: 3.51 / MAX: 17.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.99 1.98 2.97 3.96 4.95 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 4.38 4.39 4.13 4.30 4.26 4.40 4.17 4.01 4.10 4.00 4.00 4.00 4.02 3.96 MIN: 4.31 / MAX: 4.57 MIN: 4.33 / MAX: 4.54 MIN: 4.09 / MAX: 6.52 MIN: 4.21 / MAX: 12.49 MIN: 4.2 / MAX: 4.47 MIN: 4.35 / MAX: 4.57 MIN: 4.12 / MAX: 4.36 MIN: 3.96 / MAX: 4.13 MIN: 4.05 / MAX: 4.23 MIN: 3.92 / MAX: 7.83 MIN: 3.94 / MAX: 4.48 MIN: 3.95 / MAX: 4.44 MIN: 3.97 / MAX: 4.21 MIN: 3.89 / MAX: 4.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.729 1.458 2.187 2.916 3.645 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.21 3.24 2.92 3.05 2.96 3.02 3.13 3.12 3.13 3.08 3.08 3.09 3.09 3.05 MIN: 3.18 / MAX: 4.81 MIN: 3.19 / MAX: 4.87 MIN: 2.88 / MAX: 5.47 MIN: 3.02 / MAX: 4.81 MIN: 2.92 / MAX: 9.52 MIN: 2.99 / MAX: 5.02 MIN: 3.1 / MAX: 4.87 MIN: 3.09 / MAX: 4.84 MIN: 3.1 / MAX: 4.82 MIN: 3.06 / MAX: 4.67 MIN: 3.04 / MAX: 4.85 MIN: 3.06 / MAX: 6.04 MIN: 3.05 / MAX: 4.84 MIN: 3.02 / MAX: 3.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4838 0.9676 1.4514 1.9352 2.419 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.14 2.15 1.94 2.02 1.97 2.00 2.11 2.09 2.11 2.06 2.06 2.07 2.06 2.04 MIN: 2.11 / MAX: 4.76 MIN: 2.12 / MAX: 4.81 MIN: 1.92 / MAX: 3 MIN: 2 / MAX: 4.82 MIN: 1.95 / MAX: 3.04 MIN: 1.98 / MAX: 2.91 MIN: 2.07 / MAX: 4.83 MIN: 2.06 / MAX: 4.83 MIN: 2.08 / MAX: 3.71 MIN: 2.05 / MAX: 2.49 MIN: 2.04 / MAX: 2.62 MIN: 2.05 / MAX: 2.62 MIN: 2.04 / MAX: 4.66 MIN: 2.02 / MAX: 2.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.2138 0.4276 0.6414 0.8552 1.069 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.95 0.95 0.91 0.93 0.91 0.93 0.93 0.88 0.93 0.88 0.87 0.88 0.93 0.88 MIN: 0.93 / MAX: 1.89 MIN: 0.93 / MAX: 1.92 MIN: 0.88 / MAX: 1.8 MIN: 0.9 / MAX: 2.01 MIN: 0.89 / MAX: 1.94 MIN: 0.91 / MAX: 2 MIN: 0.91 / MAX: 1.68 MIN: 0.86 / MAX: 1.84 MIN: 0.91 / MAX: 1.8 MIN: 0.85 / MAX: 1.76 MIN: 0.85 / MAX: 1.89 MIN: 0.85 / MAX: 1.71 MIN: 0.91 / MAX: 1.99 MIN: 0.86 / MAX: 1.91 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.3848 0.7696 1.1544 1.5392 1.924 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.70 1.71 1.59 1.64 1.60 1.63 1.67 1.67 1.67 1.65 1.66 1.66 1.65 1.64 MIN: 1.68 / MAX: 2.76 MIN: 1.69 / MAX: 2.81 MIN: 1.57 / MAX: 2.93 MIN: 1.62 / MAX: 2.66 MIN: 1.59 / MAX: 2.59 MIN: 1.61 / MAX: 2.77 MIN: 1.64 / MAX: 2.7 MIN: 1.65 / MAX: 2.01 MIN: 1.64 / MAX: 3.01 MIN: 1.64 / MAX: 2.43 MIN: 1.63 / MAX: 2.59 MIN: 1.63 / MAX: 2.99 MIN: 1.62 / MAX: 6.14 MIN: 1.61 / MAX: 2.43 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Phoronix Test Suite v10.8.5