RTX 4070 SUPER Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) and NVIDIA GeForce RTX 3090 24GB on EndeavourOS rolling via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2402116-SADD-240207012&sro .
RTX 4070 SUPER Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Compiler File-System Screen Resolution NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads) ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) Intel Device 7a27 32GB 4001GB Seagate ZP4000GP304001 ASUS NVIDIA GeForce RTX 4070 SUPER 12GB Realtek ALC1220 ARZOPA Intel I226-V + Intel Device 7a70 EndeavourOS rolling 6.7.1-arch1-1 (x86_64) KDE Plasma 5.27.10 X Server 1.21.1.11 NVIDIA 550.40.07 4.6.0 OpenCL 3.0 CUDA 12.4.74 GCC 13.2.1 20230801 ext4 1920x1080 MSI NVIDIA GeForce RTX 4070 12GB GCC 13.2.1 20230801 + CUDA 12.3 NVIDIA GeForce RTX 4070 Ti 12GB NVIDIA GeForce RTX 3090 24GB PI-KVM Video 6.7.4-arch1-1 (x86_64) OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - NVIDIA RTX 4070 SUPER: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - NVIDIA RTX 4070: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - NVIDIA RTX 4070 TI: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - NVIDIA RTX 3090: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11d Graphics Details - NVIDIA RTX 4070 SUPER: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1 - NVIDIA RTX 4070: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2a - NVIDIA RTX 4070 TI: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.31.00.36 - NVIDIA RTX 3090: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 94.02.26.08.ba Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected Environment Details - NVIDIA RTX 4070, NVIDIA RTX 4070 TI, NVIDIA RTX 3090: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin" Python Details - NVIDIA RTX 4070, NVIDIA RTX 4070 TI, NVIDIA RTX 3090: Python 3.11.6
RTX 4070 SUPER opencl-benchmark: FP64 Compute opencl-benchmark: FP32 Compute opencl-benchmark: INT64 Compute opencl-benchmark: INT32 Compute opencl-benchmark: INT16 Compute opencl-benchmark: INT8 Compute opencl-benchmark: Memory Bandwidth Coalesced Read opencl-benchmark: Memory Bandwidth Coalesced Write pytorch: NVIDIA CUDA GPU - 1 - ResNet-50 pytorch: NVIDIA CUDA GPU - 1 - ResNet-152 pytorch: NVIDIA CUDA GPU - 16 - ResNet-50 pytorch: NVIDIA CUDA GPU - 32 - ResNet-50 pytorch: NVIDIA CUDA GPU - 64 - ResNet-50 pytorch: NVIDIA CUDA GPU - 16 - ResNet-152 pytorch: NVIDIA CUDA GPU - 256 - ResNet-50 pytorch: NVIDIA CUDA GPU - 32 - ResNet-152 pytorch: NVIDIA CUDA GPU - 512 - ResNet-50 pytorch: NVIDIA CUDA GPU - 64 - ResNet-152 pytorch: NVIDIA CUDA GPU - 256 - ResNet-152 pytorch: NVIDIA CUDA GPU - 512 - ResNet-152 pytorch: NVIDIA CUDA GPU - 1 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 16 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 32 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 64 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 256 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 512 - Efficientnet_v2_l gpuowl: 57885161 gpuowl: 77936867 gpuowl: 332220523 realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes waifu2x-ncnn: 2x - 3 - Yes vkfft: FFT + iFFT R2C / C2R vkfft: FFT + iFFT C2C 1D batched in half precision vkfft: FFT + iFFT C2C Bluestein in single precision vkfft: FFT + iFFT C2C 1D batched in double precision vkfft: FFT + iFFT C2C 1D batched in single precision vkfft: FFT + iFFT C2C multidimensional in single precision vkfft: FFT + iFFT C2C Bluestein benchmark in double precision vkfft: FFT + iFFT C2C 1D batched in single precision, no reshuffling hashcat: MD5 hashcat: SHA1 hashcat: 7-Zip hashcat: SHA-512 hashcat: TrueCrypt RIPEMD160 + XTS cl-mem: Copy cl-mem: Read cl-mem: Write namd-cuda: ATPase Simulation - 327,506 Atoms vkresample: 2x - Double vkresample: 2x - Single octanebench: Total Score fahbench: clpeak: Integer Compute INT clpeak: Single-Precision Float clpeak: Double-Precision Double clpeak: Global Memory Bandwidth rodinia: OpenCL Particle Filter luxcorerender: DLSC - GPU luxcorerender: Danish Mood - GPU luxcorerender: Orange Juice - GPU luxcorerender: LuxCore Benchmark - GPU luxcorerender: Rainbow Colors and Prism - GPU financebench: Black-Scholes OpenCL viennacl: CPU BLAS - sCOPY viennacl: CPU BLAS - sAXPY viennacl: CPU BLAS - sDOT viennacl: CPU BLAS - dCOPY viennacl: CPU BLAS - dAXPY viennacl: CPU BLAS - dDOT viennacl: CPU BLAS - dGEMV-N viennacl: CPU BLAS - dGEMV-T viennacl: CPU BLAS - dGEMM-NN viennacl: CPU BLAS - dGEMM-NT viennacl: CPU BLAS - dGEMM-TN viennacl: CPU BLAS - dGEMM-TT viennacl: OpenCL BLAS - sCOPY viennacl: OpenCL BLAS - sAXPY viennacl: OpenCL BLAS - sDOT viennacl: OpenCL BLAS - dCOPY viennacl: OpenCL BLAS - dAXPY viennacl: OpenCL BLAS - dDOT viennacl: OpenCL BLAS - dGEMV-N viennacl: OpenCL BLAS - dGEMV-T viennacl: OpenCL BLAS - dGEMM-NN viennacl: OpenCL BLAS - dGEMM-NT viennacl: OpenCL BLAS - dGEMM-TN viennacl: OpenCL BLAS - dGEMM-TT blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX blender: Barbershop - NVIDIA OptiX blender: Pabellon Barcelona - NVIDIA OptiX indigobench: OpenCL GPU - Bedroom indigobench: OpenCL GPU - Supercar mandelgpu: GPU neatbench: GPU tensorflow: GPU - 1 - VGG-16 tensorflow: GPU - 1 - AlexNet tensorflow: GPU - 16 - VGG-16 tensorflow: GPU - 32 - VGG-16 tensorflow: GPU - 64 - VGG-16 tensorflow: GPU - 16 - AlexNet tensorflow: GPU - 256 - VGG-16 tensorflow: GPU - 32 - AlexNet tensorflow: GPU - 64 - AlexNet tensorflow: GPU - 1 - GoogLeNet tensorflow: GPU - 1 - ResNet-50 tensorflow: GPU - 256 - AlexNet tensorflow: GPU - 512 - AlexNet tensorflow: GPU - 16 - GoogLeNet tensorflow: GPU - 16 - ResNet-50 tensorflow: GPU - 32 - GoogLeNet tensorflow: GPU - 32 - ResNet-50 tensorflow: GPU - 64 - GoogLeNet tensorflow: GPU - 64 - ResNet-50 libplacebo: deband_heavy libplacebo: polar_nocompute libplacebo: hdr_peakdetect libplacebo: hdr_lut libplacebo: av1_grain_lap ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - vision_transformer ncnn: Vulkan GPU - FastestDet vkpeak: fp32-scalar vkpeak: fp32-vec4 vkpeak: fp16-scalar vkpeak: fp16-vec4 vkpeak: fp64-scalar vkpeak: fp64-vec4 vkpeak: int32-scalar vkpeak: int32-vec4 vkpeak: int16-scalar vkpeak: int16-vec4 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 0.621 38.594 4.214 19.889 17.170 14.307 464.86 455.01 557.73 201.94 509.45 501.50 507.45 195.40 504.67 195.39 504.27 196.07 194.58 195.30 106.37 102.60 102.60 103.17 103.57 869.07 646.41 137.44 6.323 34.885 2.855 54794 131705 15166 24317 73929 50299 4451 75078 67583033333 22132600000 1176467 3232733333 802967 331.8 446.2 407.5 0.06791 339.593 18.489 720.973789 366.0576 18170.54 35492.69 630.11 437.65 3.480 13.59 10.56 11.72 12.82 27.67 5.912 132 156 165 70.8 87.2 96.8 102 109 119 117 115 122 334 392 370 423 437 458 210 389 577 584 599 613 5.57 12.60 9.45 51.30 14.29 19.801 52.813 587219538.2 4070 1.35 13.92 1.48 1.50 31.59 33.4 33.97 12.62 4.35 34.16 35.10 15.67 5.46 15.61 5.51 15.52 5.55 2186.70 2327.55 3292.37 3905.98 4171.00 8.62 3.03 2.25 2.31 3.85 5.07 0.84 11.04 117.81 8.97 16.17 46.26 63.82 6.86 11.11 844.61 2.86 0.510 31.768 3.443 16.377 14.284 12.116 465.18 459.43 546.76 198.18 458.39 459.94 458.36 187.26 459.93 187.69 459.27 186.63 187.27 187.51 107.59 103.68 102.90 101.55 101.24 101.43 714.80 530.32 112.61 7.092 42.852 3.168 47097 137762 13714 22390 77774 47212 3886 79057 56147866667 18202466667 976967 2673300000 660967 330.3 446.3 406.7 0.07498 415.160 18.016 647.997867 317.1952 14555.19 28479.39 515.17 437.21 4.098 11.74 8.89 10.40 10.92 23.26 6.906 131 153 166 71.0 86.8 96.7 103 109 122 122 121 118 330 389 362 423 455 456 209 387 473 477 494 502 6.21 14.86 11.03 58.44 16.55 18.203 48.517 516770131.2 4070 1.36 14.04 1.50 1.5 1.50 31.45 33.32 33.93 12.78 4.34 35.21 15.66 5.49 15.63 5.55 15.54 5.55 1843.26 1968.37 3329.26 3946.90 4152.41 7.20 2.48 2.15 2.08 2.24 3.59 0.84 6.06 45.52 5.11 5.78 8.72 20.74 5.18 6.21 382.82 2.67 0.660 40.914 4.420 21.047 18.281 15.731 465.07 457.17 535.39 201.19 502.92 505.55 505.62 194.29 198.82 504.66 197.02 195.86 194.87 108.59 103.45 96.50 103.20 103.24 103.50 919.13 676.59 145.84 5.962 33.626 2.854 55446 136210 15125 25431 73942 51528 4647 75141 73312233333 23532400000 1262633 3462500000 858600 333.3 446.3 412.2 0.06788 322.064 18.456 735.940593 382.1637 19821.10 38691.73 667.05 437.63 3.291 13.95 10.99 11.89 13.23 27.71 5.226 132 156 168 71.3 87.3 96.4 103 102.7 117 118 125 124 336 393 365 424 437 457 211 391 604 612 634 648 5.43 12.30 9.02 50.73 13.97 20.256 53.589 619106132.5 4070 1.38 14.79 1.49 1.5 1.5 31.70 1.5 33.29 34.06 12.79 4.32 34.61 35.44 15.69 5.46 15.81 5.50 15.50 5.53 2306.56 2459.03 3475.06 3976.04 4143.96 7.45 2.54 2.09 2.01 4.14 3.46 0.82 7.37 34.49 7.74 6.07 12.25 16.37 6.13 5.89 497.66 3.04 0.637 39.395 3.135 20.027 17.001 13.727 864.11 887.31 525.12 197.12 419.76 420.29 419.03 164.14 416.89 163.74 416.20 164.14 161.01 164.35 105.55 98.11 99.05 99.84 99.43 99.25 866.31 645.99 137.32 5.556 30.313 3.202 48418 273221 14205 30912 141876 50856 4195 144311 67177300000 21323733333 1056000 3081866667 797833 360.8 825.8 753.8 0.10822 333.639 10.323 674.250912 343.0199 17923.33 34906.79 642.23 816.55 3.844 12.99 10.20 12.14 13.12 33.29 5.741 132 154 132.1 70.2 86.2 95.2 103 110 113 119 121 113 363 498 376 605 724 659 187 374 592 595 594 593 6.31 15.26 10.64 54.30 17.30 20.959 52.014 484098913.8 3090 1.38 14.45 1.49 1.5 1.51 31.98 1.51 33.53 33.93 12.82 4.35 34.46 35.58 15.68 5.49 15.67 5.57 15.63 5.57 2020.16 2116.79 5055.88 3369.88 4100.36 7.27 2.34 2.21 2.04 2.16 3.34 0.87 6.14 17.88 4.12 3.60 12.70 11.29 4.90 6.73 354.57 2.65 20353.95 26699.66 20151.44 39860.80 638.84 638.74 20295.27 20009.73 13264.91 16329.72 OpenBenchmarking.org
ProjectPhysX OpenCL-Benchmark Operation: FP64 Compute OpenBenchmarking.org TFLOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: FP64 Compute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.1485 0.297 0.4455 0.594 0.7425 SE +/- 0.001, N = 3 SE +/- 0.001, N = 3 SE +/- 0.000, N = 3 SE +/- 0.001, N = 3 0.637 0.510 0.621 0.660 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: FP32 Compute OpenBenchmarking.org TFLOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: FP32 Compute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 9 18 27 36 45 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 39.40 31.77 38.59 40.91 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: INT64 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT64 Compute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.9945 1.989 2.9835 3.978 4.9725 SE +/- 0.003, N = 3 SE +/- 0.004, N = 3 SE +/- 0.015, N = 3 SE +/- 0.016, N = 3 3.135 3.443 4.214 4.420 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: INT32 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT32 Compute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 5 10 15 20 25 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 20.03 16.38 19.89 21.05 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: INT16 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT16 Compute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 17.00 14.28 17.17 18.28 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: INT8 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT8 Compute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 13.73 12.12 14.31 15.73 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: Memory Bandwidth Coalesced Read OpenBenchmarking.org GB/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: Memory Bandwidth Coalesced Read NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200 400 600 800 1000 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 864.11 465.18 464.86 465.07 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: Memory Bandwidth Coalesced Write OpenBenchmarking.org GB/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: Memory Bandwidth Coalesced Write NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200 400 600 800 1000 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 887.31 459.43 455.01 457.17 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 120 240 360 480 600 SE +/- 3.09, N = 3 SE +/- 11.16, N = 12 525.12 546.76 557.73 535.39 MIN: 458.54 / MAX: 542.46 MIN: 195.25 / MAX: 556.94 MIN: 513.63 / MAX: 563.37 MIN: 428.43 / MAX: 572.99
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.09, N = 2 SE +/- 0.36, N = 3 SE +/- 0.73, N = 3 197.12 198.18 201.94 201.19 MIN: 137.37 / MAX: 198.9 MIN: 181.27 / MAX: 200.06 MIN: 183.53 / MAX: 206.5 MIN: 180.79 / MAX: 203.92
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 110 220 330 440 550 SE +/- 0.89, N = 2 SE +/- 0.26, N = 3 SE +/- 2.23, N = 3 419.76 458.39 509.45 502.92 MIN: 376.2 / MAX: 422.17 MIN: 404.5 / MAX: 461.01 MIN: 430.1 / MAX: 516.48 MIN: 415.65 / MAX: 520.39
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 110 220 330 440 550 SE +/- 0.13, N = 2 SE +/- 2.17, N = 2 SE +/- 1.69, N = 3 420.29 459.94 501.50 505.55 MIN: 376.81 / MAX: 421.58 MIN: 403.65 / MAX: 462.59 MIN: 415.94 / MAX: 510.69 MIN: 419.93 / MAX: 512.69
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 110 220 330 440 550 SE +/- 0.24, N = 3 SE +/- 0.27, N = 3 SE +/- 0.92, N = 3 SE +/- 1.92, N = 3 419.03 458.36 507.45 505.62 MIN: 376 / MAX: 422 MIN: 404.89 / MAX: 461.01 MIN: 423.41 / MAX: 512.88 MIN: 426.6 / MAX: 513.25
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.29, N = 3 164.14 187.26 195.40 194.29 MIN: 145.67 / MAX: 165.38 MIN: 179.81 / MAX: 188.21 MIN: 186.09 / MAX: 197.7 MIN: 182.25 / MAX: 197.39
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.14, N = 3 SE +/- 0.34, N = 3 SE +/- 1.39, N = 3 416.89 459.93 504.67 MIN: 329.77 / MAX: 420.82 MIN: 403.65 / MAX: 462.74 MIN: 412.34 / MAX: 514.07
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.29, N = 3 163.74 187.69 195.39 198.82 MIN: 144.93 / MAX: 165.03 MIN: 182.03 / MAX: 188.31 MIN: 183.94 / MAX: 198.7 MIN: 188.33 / MAX: 201.47
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 110 220 330 440 550 SE +/- 0.40, N = 3 SE +/- 0.43, N = 2 SE +/- 4.43, N = 2 SE +/- 0.83, N = 2 416.20 459.27 504.27 504.66 MIN: 355.45 / MAX: 419.05 MIN: 405.48 / MAX: 461.88 MIN: 418.22 / MAX: 512.44 MIN: 424.27 / MAX: 509.08
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.34, N = 3 SE +/- 0.51, N = 3 SE +/- 0.78, N = 2 164.14 186.63 196.07 197.02 MIN: 149 / MAX: 165 MIN: 180.51 / MAX: 187.79 MIN: 171.95 / MAX: 199.96 MIN: 183.92 / MAX: 200.54
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.17, N = 3 SE +/- 1.14, N = 2 SE +/- 0.19, N = 2 161.01 187.27 194.58 195.86 MIN: 138.12 / MAX: 165.16 MIN: 179.9 / MAX: 188.08 MIN: 183.74 / MAX: 198.52 MIN: 181.64 / MAX: 199.2
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.33, N = 2 SE +/- 0.05, N = 3 SE +/- 1.38, N = 2 164.35 187.51 195.30 194.87 MIN: 149.91 / MAX: 166.09 MIN: 181.57 / MAX: 188.05 MIN: 182 / MAX: 199.43 MIN: 180.8 / MAX: 198
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.55, N = 3 105.55 107.59 106.37 108.59 MIN: 91.76 / MAX: 107.42 MIN: 98.77 / MAX: 109.43 MIN: 97.91 / MAX: 108.16 MIN: 99.04 / MAX: 110.68
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.53, N = 2 SE +/- 0.52, N = 2 98.11 103.68 103.45 MIN: 89.88 / MAX: 100.25 MIN: 96.86 / MAX: 105.56 MIN: 95.22 / MAX: 105.88
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.13, N = 3 SE +/- 6.65, N = 5 99.05 102.90 102.60 96.50 MIN: 91.8 / MAX: 100.69 MIN: 95.98 / MAX: 104.54 MIN: 94.84 / MAX: 104.25 MIN: 64.35 / MAX: 104.79
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.14, N = 3 SE +/- 0.45, N = 3 SE +/- 1.49, N = 2 SE +/- 0.39, N = 2 99.84 101.55 102.60 103.20 MIN: 92.73 / MAX: 101.46 MIN: 93.44 / MAX: 103.08 MIN: 79.69 / MAX: 105.28 MIN: 95.31 / MAX: 105.27
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.57, N = 3 SE +/- 0.05, N = 2 99.43 101.24 103.17 103.24 MIN: 90.49 / MAX: 101.97 MIN: 93.33 / MAX: 102.92 MIN: 95.79 / MAX: 105.15 MIN: 95.41 / MAX: 104.9
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.19, N = 3 SE +/- 0.39, N = 3 SE +/- 0.36, N = 2 99.25 101.43 103.57 103.50 MIN: 91.16 / MAX: 101.18 MIN: 93.27 / MAX: 103.58 MIN: 95.95 / MAX: 105.54 MIN: 94.95 / MAX: 105.61
GpuOwl Exponent: 57885161 OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 57885161 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200 400 600 800 1000 SE +/- 2.01, N = 3 SE +/- 0.00, N = 3 SE +/- 1.26, N = 3 SE +/- 2.53, N = 3 866.31 714.80 869.07 919.13
GpuOwl Exponent: 77936867 OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 77936867 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 150 300 450 600 750 SE +/- 0.00, N = 3 SE +/- 0.09, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 645.99 530.32 646.41 676.59
GpuOwl Exponent: 332220523 OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 332220523 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 137.32 112.61 137.44 145.84
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.016, N = 3 SE +/- 0.006, N = 3 SE +/- 0.150, N = 15 SE +/- 0.039, N = 3 5.556 7.092 6.323 5.962
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 10 20 30 40 50 SE +/- 0.06, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 30.31 42.85 34.89 33.63
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.7205 1.441 2.1615 2.882 3.6025 SE +/- 0.011, N = 3 SE +/- 0.028, N = 3 SE +/- 0.014, N = 3 SE +/- 0.009, N = 3 3.202 3.168 2.855 2.854
VkFFT Test: FFT + iFFT R2C / C2R OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT R2C / C2R NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 12K 24K 36K 48K 60K SE +/- 320.62, N = 3 SE +/- 745.02, N = 13 SE +/- 702.53, N = 15 SE +/- 520.37, N = 3 48418 47097 54794 55446 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C 1D batched in half precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in half precision NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 60K 120K 180K 240K 300K SE +/- 160.60, N = 3 SE +/- 1301.92, N = 3 SE +/- 159.17, N = 3 SE +/- 1708.38, N = 3 273221 137762 131705 136210 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C Bluestein in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein in single precision NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3K 6K 9K 12K 15K SE +/- 115.62, N = 3 SE +/- 52.09, N = 3 SE +/- 102.52, N = 3 SE +/- 118.41, N = 3 14205 13714 15166 15125 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C 1D batched in double precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in double precision NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 7K 14K 21K 28K 35K SE +/- 50.66, N = 3 SE +/- 125.94, N = 3 SE +/- 146.69, N = 3 SE +/- 302.46, N = 3 30912 22390 24317 25431 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C 1D batched in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30K 60K 90K 120K 150K SE +/- 9.64, N = 3 SE +/- 13.72, N = 3 SE +/- 7.94, N = 3 SE +/- 0.88, N = 3 141876 77774 73929 73942 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C multidimensional in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C multidimensional in single precision NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 11K 22K 33K 44K 55K SE +/- 407.28, N = 15 SE +/- 476.57, N = 5 SE +/- 407.19, N = 15 SE +/- 417.77, N = 15 50856 47212 50299 51528 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C Bluestein benchmark in double precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein benchmark in double precision NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 1000 2000 3000 4000 5000 SE +/- 9.84, N = 3 SE +/- 4.51, N = 3 SE +/- 12.55, N = 3 SE +/- 11.35, N = 3 4195 3886 4451 4647 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30K 60K 90K 120K 150K SE +/- 37.44, N = 3 SE +/- 5.84, N = 3 SE +/- 37.77, N = 3 SE +/- 28.54, N = 3 144311 79057 75078 75141 1. (CXX) g++ options: -O3 -lrt
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 16000M 32000M 48000M 64000M 80000M SE +/- 53667246.37, N = 3 SE +/- 33772046.30, N = 3 SE +/- 22430807.19, N = 3 SE +/- 11283665.68, N = 3 67177300000 56147866667 67583033333 73312233333
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 5000M 10000M 15000M 20000M 25000M SE +/- 26244639.66, N = 3 SE +/- 6318315.53, N = 3 SE +/- 5140363.15, N = 3 SE +/- 15926811.78, N = 3 21323733333 18202466667 22132600000 23532400000
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 300K 600K 900K 1200K 1500K SE +/- 1587.45, N = 3 SE +/- 2062.63, N = 3 SE +/- 1991.93, N = 3 SE +/- 2339.04, N = 3 1056000 976967 1176467 1262633
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 700M 1400M 2100M 2800M 3500M SE +/- 3288532.26, N = 3 SE +/- 1059874.21, N = 3 SE +/- 1530068.99, N = 3 SE +/- 721110.26, N = 3 3081866667 2673300000 3232733333 3462500000
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200K 400K 600K 800K 1000K SE +/- 1757.21, N = 3 SE +/- 176.38, N = 3 SE +/- 633.33, N = 3 SE +/- 888.82, N = 3 797833 660967 802967 858600
cl-mem Benchmark: Copy OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Copy NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 80 160 240 320 400 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 360.8 330.3 331.8 333.3 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Read OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200 400 600 800 1000 SE +/- 0.32, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 SE +/- 0.00, N = 3 825.8 446.3 446.2 446.3 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Write OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 160 320 480 640 800 SE +/- 0.83, N = 3 SE +/- 0.55, N = 3 SE +/- 1.11, N = 3 SE +/- 0.12, N = 3 753.8 406.7 407.5 412.2 1. (CC) gcc options: -O2 -flto -lOpenCL
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.0243 0.0486 0.0729 0.0972 0.1215 SE +/- 0.00042, N = 3 SE +/- 0.00021, N = 3 SE +/- 0.00031, N = 3 SE +/- 0.00061, N = 3 0.10822 0.07498 0.06791 0.06788
VkResample Upscale: 2x - Precision: Double OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 90 180 270 360 450 SE +/- 0.30, N = 3 SE +/- 0.77, N = 3 SE +/- 0.30, N = 3 SE +/- 0.35, N = 3 333.64 415.16 339.59 322.06 1. (CXX) g++ options: -O3
VkResample Upscale: 2x - Precision: Single OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 10.32 18.02 18.49 18.46 1. (CXX) g++ options: -O3
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 160 320 480 640 800 674.25 648.00 720.97 735.94
FAHBench OpenBenchmarking.org Ns Per Day, More Is Better FAHBench 2.3.2 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 80 160 240 320 400 SE +/- 0.26, N = 3 SE +/- 0.12, N = 3 SE +/- 0.39, N = 3 SE +/- 0.26, N = 3 343.02 317.20 366.06 382.16
clpeak OpenCL Test: Integer Compute INT OpenBenchmarking.org GIOPS, More Is Better clpeak 1.1.2 OpenCL Test: Integer Compute INT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4K 8K 12K 16K 20K SE +/- 16.49, N = 3 SE +/- 15.26, N = 3 SE +/- 3.14, N = 3 SE +/- 2.50, N = 3 17923.33 14555.19 18170.54 19821.10 1. (CXX) g++ options: -O3
clpeak OpenCL Test: Single-Precision Float OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Single-Precision Float NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8K 16K 24K 32K 40K SE +/- 113.39, N = 3 SE +/- 5.46, N = 3 SE +/- 0.99, N = 3 SE +/- 11.67, N = 3 34906.79 28479.39 35492.69 38691.73 1. (CXX) g++ options: -O3
clpeak OpenCL Test: Double-Precision Double OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Double-Precision Double NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 140 280 420 560 700 SE +/- 1.63, N = 3 SE +/- 0.21, N = 3 SE +/- 0.98, N = 3 SE +/- 1.33, N = 3 642.23 515.17 630.11 667.05 1. (CXX) g++ options: -O3
clpeak OpenCL Test: Global Memory Bandwidth OpenBenchmarking.org GBPS, More Is Better clpeak 1.1.2 OpenCL Test: Global Memory Bandwidth NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200 400 600 800 1000 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 816.55 437.21 437.65 437.63 1. (CXX) g++ options: -O3
Rodinia Test: OpenCL Particle Filter OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.9221 1.8442 2.7663 3.6884 4.6105 SE +/- 0.030, N = 15 SE +/- 0.008, N = 3 SE +/- 0.039, N = 4 SE +/- 0.002, N = 3 3.844 4.098 3.480 3.291 1. (CXX) g++ options: -O2 -lOpenCL
LuxCoreRender Scene: DLSC - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 1.13, N = 12 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 12.99 11.74 13.59 13.95 MIN: 0.52 / MAX: 14.69 MIN: 11.35 / MAX: 11.83 MIN: 12.52 / MAX: 13.84 MIN: 13.67 / MAX: 14.14
LuxCoreRender Scene: Danish Mood - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 10.20 8.89 10.56 10.99 MIN: 4.07 / MAX: 11.93 MIN: 3.32 / MAX: 10.26 MIN: 3.7 / MAX: 12.17 MIN: 4.17 / MAX: 12.71
LuxCoreRender Scene: Orange Juice - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.00, N = 3 12.14 10.40 11.72 11.89 MIN: 10.24 / MAX: 16.71 MIN: 8.31 / MAX: 13.9 MIN: 9.6 / MAX: 15.44 MIN: 9.85 / MAX: 15.88
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.03, N = 2 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 13.12 10.92 12.82 13.23 MIN: 4.85 / MAX: 15.21 MIN: 4.45 / MAX: 12.42 MIN: 4.84 / MAX: 14.62 MIN: 5.41 / MAX: 15.13
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8 16 24 32 40 SE +/- 0.36, N = 5 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 33.29 23.26 27.67 27.71 MIN: 30.4 / MAX: 36.21 MIN: 20.92 / MAX: 24.3 MIN: 24.87 / MAX: 29.03 MIN: 25.01 / MAX: 29.15
FinanceBench Benchmark: Black-Scholes OpenCL OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.006, N = 3 SE +/- 0.003, N = 3 SE +/- 0.114, N = 15 SE +/- 0.003, N = 3 5.741 6.906 5.912 5.226 1. (CXX) g++ options: -O3 -march=native -fopenmp
ViennaCL Test: CPU BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 SE +/- 0.88, N = 3 132 131 132 132 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 0.33, N = 3 SE +/- 4.81, N = 3 SE +/- 2.19, N = 3 SE +/- 2.00, N = 3 154 153 156 156 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 35.40, N = 3 SE +/- 3.76, N = 3 SE +/- 2.73, N = 3 SE +/- 2.40, N = 3 132.1 166.0 165.0 168.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 16 32 48 64 80 SE +/- 0.72, N = 3 SE +/- 0.25, N = 3 SE +/- 0.32, N = 3 SE +/- 0.74, N = 3 70.2 71.0 70.8 71.3 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.94, N = 3 SE +/- 0.44, N = 3 SE +/- 0.12, N = 3 SE +/- 0.57, N = 3 86.2 86.8 87.2 87.3 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.84, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.58, N = 3 95.2 96.7 96.8 96.4 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.88, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 103 103 102 103 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 6.30, N = 3 110.0 109.0 109.0 102.7 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 1.86, N = 3 SE +/- 1.86, N = 3 SE +/- 4.04, N = 3 SE +/- 1.15, N = 3 113 122 119 117 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 3.28, N = 3 SE +/- 1.76, N = 3 SE +/- 2.08, N = 3 SE +/- 1.20, N = 3 119 122 117 118 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 2.08, N = 3 SE +/- 2.31, N = 3 SE +/- 1.00, N = 2 SE +/- 2.08, N = 3 121 121 115 125 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 0.88, N = 3 SE +/- 1.20, N = 3 SE +/- 2.08, N = 3 SE +/- 2.08, N = 3 113 118 122 124 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 80 160 240 320 400 SE +/- 1.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 363 330 334 336 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 110 220 330 440 550 SE +/- 0.58, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 498 389 392 393 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 80 160 240 320 400 SE +/- 0.58, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 376 362 370 365 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 130 260 390 520 650 SE +/- 0.58, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 605 423 423 424 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 160 320 480 640 800 SE +/- 0.58, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 724 455 437 437 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 140 280 420 560 700 SE +/- 0.88, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 659 456 458 457 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 187 209 210 211 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 374 387 389 391 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 130 260 390 520 650 SE +/- 2.31, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 592 473 577 604 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 130 260 390 520 650 SE +/- 2.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 595 477 584 612 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 140 280 420 560 700 SE +/- 2.03, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.67, N = 3 594 494 599 634 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 140 280 420 560 700 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 593 502 613 648 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: BMW27 - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.06, N = 14 SE +/- 0.01, N = 3 SE +/- 0.06, N = 13 SE +/- 0.02, N = 3 6.31 6.21 5.57 5.43
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Classroom - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 15.26 14.86 12.60 12.30
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Fishy Cat - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.08, N = 9 SE +/- 0.03, N = 3 SE +/- 0.06, N = 13 SE +/- 0.01, N = 3 10.64 11.03 9.45 9.02
Blender Blend File: Barbershop - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Barbershop - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 13 26 39 52 65 SE +/- 0.02, N = 2 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 54.30 58.44 51.30 50.73
Blender Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 17.30 16.55 14.29 13.97
IndigoBench Acceleration: OpenCL GPU - Scene: Bedroom OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Bedroom NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 20.96 18.20 19.80 20.26
IndigoBench Acceleration: OpenCL GPU - Scene: Supercar OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 52.01 48.52 52.81 53.59
MandelGPU OpenCL Device: GPU OpenBenchmarking.org Samples/sec, More Is Better MandelGPU 1.3pts1 OpenCL Device: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 130M 260M 390M 520M 650M SE +/- 794770.01, N = 3 SE +/- 1783157.89, N = 3 SE +/- 467034.80, N = 3 SE +/- 1202791.77, N = 3 484098913.8 516770131.2 587219538.2 619106132.5 1. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL
NeatBench Acceleration: GPU OpenBenchmarking.org FPS, More Is Better NeatBench 5 Acceleration: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 900 1800 2700 3600 4500 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 3090 4070 4070 4070
TensorFlow Device: GPU - Batch Size: 1 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: VGG-16 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.3105 0.621 0.9315 1.242 1.5525 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.01, N = 3 1.38 1.36 1.35 1.38
TensorFlow Device: GPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: AlexNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.20, N = 15 SE +/- 0.16, N = 3 SE +/- 0.22, N = 2 SE +/- 0.06, N = 2 14.45 14.04 13.92 14.79
TensorFlow Device: GPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: VGG-16 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 2 1.49 1.50 1.48 1.49
TensorFlow Device: GPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: VGG-16 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 2 1.50 1.50 1.50 1.50
TensorFlow Device: GPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: VGG-16 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI 0.3398 0.6796 1.0194 1.3592 1.699 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.51 1.50 1.50
TensorFlow Device: GPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: AlexNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 7 14 21 28 35 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.08, N = 3 31.98 31.45 31.59 31.70
TensorFlow Device: GPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 256 - Model: VGG-16 NVIDIA RTX 3090 NVIDIA RTX 4070 TI 0.3398 0.6796 1.0194 1.3592 1.699 SE +/- 0.00, N = 3 1.51 1.50
TensorFlow Device: GPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: AlexNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.15, N = 2 SE +/- 0.04, N = 3 33.53 33.32 33.40 33.29
TensorFlow Device: GPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: AlexNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.14, N = 3 SE +/- 0.06, N = 3 33.93 33.93 33.97 34.06
TensorFlow Device: GPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: GoogLeNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 2 SE +/- 0.30, N = 2 12.82 12.78 12.62 12.79
TensorFlow Device: GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.9788 1.9576 2.9364 3.9152 4.894 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 2 4.35 4.34 4.35 4.32
TensorFlow Device: GPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 256 - Model: AlexNet NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 2 34.46 34.16 34.61
TensorFlow Device: GPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 512 - Model: AlexNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 2 SE +/- 0.09, N = 2 35.58 35.21 35.10 35.44
TensorFlow Device: GPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: GoogLeNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 15.68 15.66 15.67 15.69
TensorFlow Device: GPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 1.2353 2.4706 3.7059 4.9412 6.1765 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 2 SE +/- 0.01, N = 3 5.49 5.49 5.46 5.46
TensorFlow Device: GPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: GoogLeNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 2 SE +/- 0.03, N = 3 15.67 15.63 15.61 15.81
TensorFlow Device: GPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 1.2533 2.5066 3.7599 5.0132 6.2665 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.01, N = 2 SE +/- 0.02, N = 3 5.57 5.55 5.51 5.50
TensorFlow Device: GPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: GoogLeNet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 2 15.63 15.54 15.52 15.50
TensorFlow Device: GPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 1.2533 2.5066 3.7599 5.0132 6.2665 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 2 SE +/- 0.01, N = 2 5.57 5.55 5.55 5.53
Libplacebo Test: deband_heavy OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: deband_heavy NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 500 1000 1500 2000 2500 SE +/- 2.90, N = 3 SE +/- 0.12, N = 3 SE +/- 2.26, N = 3 SE +/- 0.40, N = 3 2015.93 1843.26 2186.70 2306.56 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
Libplacebo Test: polar_nocompute OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: polar_nocompute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 500 1000 1500 2000 2500 SE +/- 3.16, N = 3 SE +/- 0.01, N = 3 SE +/- 0.24, N = 3 SE +/- 1.70, N = 3 2116.50 1968.37 2327.55 2459.03 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
Libplacebo Test: hdr_peakdetect OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_peakdetect NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 1100 2200 3300 4400 5500 SE +/- 75.68, N = 3 SE +/- 11.75, N = 3 SE +/- 3.65, N = 3 SE +/- 165.74, N = 3 4969.74 3310.02 3292.37 3475.06 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
Libplacebo Test: hdr_lut OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_lut NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 900 1800 2700 3600 4500 SE +/- 13.62, N = 3 SE +/- 10.06, N = 3 SE +/- 12.09, N = 3 SE +/- 5.47, N = 3 3313.26 3927.11 3905.98 3971.61 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
Libplacebo Test: av1_grain_lap OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: av1_grain_lap NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 900 1800 2700 3600 4500 SE +/- 42.82, N = 3 SE +/- 66.69, N = 3 SE +/- 5.52, N = 3 SE +/- 21.66, N = 3 4096.48 4103.40 4171.00 4140.87 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mobilenet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.22, N = 9 SE +/- 0.21, N = 12 SE +/- 0.47, N = 9 SE +/- 0.25, N = 12 6.92 7.20 8.62 7.45 MIN: 6.06 / MAX: 8.65 MIN: 6.2 / MAX: 11.13 MIN: 6.42 / MAX: 1101.3 MIN: 6.87 / MAX: 734.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 1.0553 2.1106 3.1659 4.2212 5.2765 SE +/- 0.15, N = 3 SE +/- 0.07, N = 12 SE +/- 0.44, N = 9 SE +/- 0.07, N = 9 2.34 2.48 3.03 2.43 MIN: 2.04 / MAX: 2.63 MIN: 2.02 / MAX: 5.82 MIN: 2.38 / MAX: 970.87 MIN: 2.09 / MAX: 5.8 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.09, N = 9 SE +/- 0.08, N = 12 SE +/- 0.16, N = 9 SE +/- 0.09, N = 9 2.20 2.15 2.25 2.09 MIN: 1.91 / MAX: 2.71 MIN: 1.81 / MAX: 2.58 MIN: 1.75 / MAX: 343.7 MIN: 1.78 / MAX: 2.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.9383 1.8766 2.8149 3.7532 4.6915 SE +/- 0.21, N = 3 SE +/- 0.09, N = 11 SE +/- 0.34, N = 8 SE +/- 0.08, N = 12 2.04 2.08 2.31 2.01 MIN: 1.8 / MAX: 5.8 MIN: 1.82 / MAX: 2.59 MIN: 1.76 / MAX: 421.42 MIN: 1.73 / MAX: 3.86 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mnasnet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.9315 1.863 2.7945 3.726 4.6575 SE +/- 0.14, N = 3 SE +/- 0.08, N = 8 SE +/- 1.31, N = 9 SE +/- 0.05, N = 9 2.16 2.22 3.85 2.30 MIN: 2.01 / MAX: 2.55 MIN: 1.83 / MAX: 2.54 MIN: 1.89 / MAX: 1093.29 MIN: 2.15 / MAX: 2.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.17, N = 3 SE +/- 0.09, N = 9 SE +/- 0.97, N = 9 SE +/- 0.07, N = 12 3.34 3.46 5.07 3.46 MIN: 3.14 / MAX: 4 MIN: 2.91 / MAX: 3.79 MIN: 3.22 / MAX: 1124.2 MIN: 3.13 / MAX: 7.03 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: blazeface NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.1958 0.3916 0.5874 0.7832 0.979 SE +/- 0.03, N = 9 SE +/- 0.03, N = 9 SE +/- 0.04, N = 9 SE +/- 0.03, N = 9 0.84 0.84 0.84 0.81 MIN: 0.63 / MAX: 1.13 MIN: 0.64 / MAX: 0.96 MIN: 0.65 / MAX: 4.63 MIN: 0.61 / MAX: 1.19 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: googlenet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.18, N = 9 SE +/- 0.14, N = 9 SE +/- 1.21, N = 9 SE +/- 0.14, N = 9 6.11 6.06 11.04 5.87 MIN: 5.25 / MAX: 9.16 MIN: 5.33 / MAX: 8.36 MIN: 5.28 / MAX: 1769.19 MIN: 5.2 / MAX: 6.88 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vgg16 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 13.24, N = 12 SE +/- 29.60, N = 9 SE +/- 11.81, N = 9 17.88 45.52 117.81 32.05 MIN: 17.3 / MAX: 18.57 MIN: 17.49 / MAX: 643.35 MIN: 17.16 / MAX: 647.67 MIN: 17.34 / MAX: 644.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet18 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.07, N = 3 SE +/- 0.73, N = 12 SE +/- 3.49, N = 9 SE +/- 1.33, N = 9 4.12 5.11 8.97 5.47 MIN: 3.97 / MAX: 4.51 MIN: 3.99 / MAX: 916.69 MIN: 3.94 / MAX: 922.04 MIN: 3.95 / MAX: 726.67 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: alexnet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 1.70, N = 12 SE +/- 5.86, N = 9 SE +/- 0.03, N = 9 3.60 5.78 16.17 3.74 MIN: 3.44 / MAX: 3.79 MIN: 3.6 / MAX: 397.75 MIN: 3.52 / MAX: 436.52 MIN: 3.61 / MAX: 3.98 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 10 20 30 40 50 SE +/- 0.12, N = 9 SE +/- 0.10, N = 9 SE +/- 14.70, N = 9 SE +/- 4.00, N = 12 8.20 8.24 46.26 12.25 MIN: 7.69 / MAX: 11.69 MIN: 7.87 / MAX: 9.87 MIN: 7.71 / MAX: 1829.99 MIN: 8 / MAX: 1777.17 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 14 28 42 56 70 SE +/- 0.21, N = 3 SE +/- 5.37, N = 12 SE +/- 10.56, N = 9 SE +/- 3.10, N = 12 11.29 20.74 63.82 16.37 MIN: 10.82 / MAX: 11.93 MIN: 10.3 / MAX: 854.36 MIN: 10.28 / MAX: 858.44 MIN: 10.57 / MAX: 855.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.19, N = 3 SE +/- 0.12, N = 12 SE +/- 1.76, N = 9 SE +/- 0.29, N = 9 4.90 5.18 6.86 5.36 MIN: 4.47 / MAX: 5.27 MIN: 4.67 / MAX: 6.88 MIN: 4.34 / MAX: 1630.01 MIN: 4.55 / MAX: 496.3 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.32, N = 8 SE +/- 0.24, N = 12 SE +/- 3.28, N = 9 SE +/- 0.18, N = 12 6.47 6.21 11.11 5.89 MIN: 5.44 / MAX: 9.3 MIN: 5.53 / MAX: 8.99 MIN: 5.49 / MAX: 4942.19 MIN: 5.42 / MAX: 7.57 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200 400 600 800 1000 SE +/- 52.80, N = 9 SE +/- 61.31, N = 9 SE +/- 87.53, N = 9 SE +/- 25.65, N = 9 327.82 281.56 844.61 390.18 MIN: 46.48 / MAX: 1816.93 MIN: 46.48 / MAX: 1913.33 MIN: 46.34 / MAX: 1866.93 MIN: 46.49 / MAX: 1816.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: FastestDet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.08, N = 8 SE +/- 0.10, N = 9 SE +/- 0.29, N = 9 SE +/- 0.12, N = 8 2.50 2.34 2.86 2.84 MIN: 2.1 / MAX: 32.36 MIN: 2 / MAX: 3.86 MIN: 2.17 / MAX: 577.17 MIN: 2.4 / MAX: 5.07 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
vkpeak fp32-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp32-scalar NVIDIA RTX 3090 4K 8K 12K 16K 20K SE +/- 36.15, N = 3 20263.13
vkpeak fp32-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp32-vec4 NVIDIA RTX 3090 6K 12K 18K 24K 30K SE +/- 1.51, N = 3 26563.72
vkpeak fp16-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp16-scalar NVIDIA RTX 3090 4K 8K 12K 16K 20K SE +/- 34.71, N = 3 20080.47
vkpeak fp16-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp16-vec4 NVIDIA RTX 3090 9K 18K 27K 36K 45K SE +/- 75.11, N = 3 39746.91
vkpeak fp64-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp64-scalar NVIDIA RTX 3090 140 280 420 560 700 SE +/- 0.03, N = 3 638.70
vkpeak fp64-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp64-vec4 NVIDIA RTX 3090 140 280 420 560 700 SE +/- 0.02, N = 3 638.72
vkpeak int32-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int32-scalar NVIDIA RTX 3090 4K 8K 12K 16K 20K SE +/- 3.21, N = 3 20280.33
vkpeak int32-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int32-vec4 NVIDIA RTX 3090 4K 8K 12K 16K 20K SE +/- 2.34, N = 3 19996.92
vkpeak int16-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int16-scalar NVIDIA RTX 3090 3K 6K 9K 12K 15K SE +/- 23.55, N = 3 13225.17
vkpeak int16-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int16-vec4 NVIDIA RTX 3090 4K 8K 12K 16K 20K SE +/- 28.77, N = 3 16302.58
Phoronix Test Suite v10.8.5