Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) and MSI NVIDIA GeForce RTX 4070 12GB on EndeavourOS rolling via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401299-NE-2401275NE83 RTX 4070 SUPER - Phoronix Test Suite RTX 4070 SUPER Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) and MSI NVIDIA GeForce RTX 4070 12GB on EndeavourOS rolling via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401299-NE-2401275NE83&grs&sor&rro .
RTX 4070 SUPER Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Compiler File-System Screen Resolution NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads) ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) Intel Device 7a27 32GB 4001GB Seagate ZP4000GP304001 ASUS NVIDIA GeForce RTX 4070 SUPER 12GB Realtek ALC1220 ARZOPA Intel I226-V + Intel Device 7a70 EndeavourOS rolling 6.7.1-arch1-1 (x86_64) KDE Plasma 5.27.10 X Server 1.21.1.11 NVIDIA 550.40.07 4.6.0 OpenCL 3.0 CUDA 12.4.74 GCC 13.2.1 20230801 ext4 1920x1080 MSI NVIDIA GeForce RTX 4070 12GB GCC 13.2.1 20230801 + CUDA 12.3 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11d Graphics Details - NVIDIA RTX 4070 SUPER: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1 - NVIDIA RTX 4070: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2a Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected Environment Details - NVIDIA RTX 4070: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin" Python Details - NVIDIA RTX 4070: Python 3.11.6
RTX 4070 SUPER clpeak: Integer Compute INT clpeak: Single-Precision Float realsr-ncnn: 4x - Yes viennacl: OpenCL BLAS - dGEMM-NT opencl-benchmark: INT64 Compute clpeak: Double-Precision Double vkresample: 2x - Double viennacl: OpenCL BLAS - dGEMM-TT gpuowl: 332220523 viennacl: OpenCL BLAS - dGEMM-NN gpuowl: 77936867 opencl-benchmark: FP64 Compute hashcat: SHA1 gpuowl: 57885161 opencl-benchmark: FP32 Compute hashcat: TrueCrypt RIPEMD160 + XTS opencl-benchmark: INT32 Compute viennacl: OpenCL BLAS - dGEMM-TN hashcat: SHA-512 hashcat: 7-Zip hashcat: MD5 opencl-benchmark: INT16 Compute luxcorerender: Rainbow Colors and Prism - GPU luxcorerender: Danish Mood - GPU libplacebo: deband_heavy libplacebo: polar_nocompute opencl-benchmark: INT8 Compute blender: Classroom - NVIDIA OptiX rodinia: OpenCL Particle Filter luxcorerender: LuxCore Benchmark - GPU blender: Fishy Cat - NVIDIA OptiX vkfft: FFT + iFFT R2C / C2R blender: Pabellon Barcelona - NVIDIA OptiX luxcorerender: DLSC - GPU fahbench: vkfft: FFT + iFFT C2C Bluestein benchmark in double precision blender: Barbershop - NVIDIA OptiX mandelgpu: GPU luxcorerender: Orange Juice - GPU blender: BMW27 - NVIDIA OptiX octanebench: Total Score pytorch: NVIDIA CUDA GPU - 16 - ResNet-50 waifu2x-ncnn: 2x - 3 - Yes pytorch: NVIDIA CUDA GPU - 64 - ResNet-50 vkfft: FFT + iFFT C2C Bluestein in single precision namd-cuda: ATPase Simulation - 327,506 Atoms pytorch: NVIDIA CUDA GPU - 512 - ResNet-50 pytorch: NVIDIA CUDA GPU - 256 - ResNet-50 pytorch: NVIDIA CUDA GPU - 32 - ResNet-50 indigobench: OpenCL GPU - Supercar indigobench: OpenCL GPU - Bedroom vkfft: FFT + iFFT C2C 1D batched in double precision vkfft: FFT + iFFT C2C multidimensional in single precision vkfft: FFT + iFFT C2C 1D batched in single precision, no reshuffling viennacl: CPU BLAS - dGEMM-TN vkfft: FFT + iFFT C2C 1D batched in single precision pytorch: NVIDIA CUDA GPU - 64 - ResNet-152 vkfft: FFT + iFFT C2C 1D batched in half precision pytorch: NVIDIA CUDA GPU - 16 - ResNet-152 viennacl: CPU BLAS - dGEMM-NT pytorch: NVIDIA CUDA GPU - 512 - ResNet-152 viennacl: OpenCL BLAS - dAXPY pytorch: NVIDIA CUDA GPU - 32 - ResNet-152 pytorch: NVIDIA CUDA GPU - 256 - ResNet-152 viennacl: CPU BLAS - dGEMM-TT vkresample: 2x - Single viennacl: CPU BLAS - dGEMM-NN viennacl: OpenCL BLAS - sDOT pytorch: NVIDIA CUDA GPU - 512 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 1 - ResNet-50 viennacl: CPU BLAS - sAXPY pytorch: NVIDIA CUDA GPU - 256 - Efficientnet_v2_l pytorch: NVIDIA CUDA GPU - 1 - ResNet-152 libplacebo: av1_grain_lap tensorflow: GPU - 16 - VGG-16 tensorflow: GPU - 1 - GoogLeNet viennacl: OpenCL BLAS - sCOPY pytorch: NVIDIA CUDA GPU - 1 - Efficientnet_v2_l libplacebo: hdr_lut pytorch: NVIDIA CUDA GPU - 64 - Efficientnet_v2_l viennacl: CPU BLAS - dGEMV-N opencl-benchmark: Memory Bandwidth Coalesced Write tensorflow: GPU - 1 - AlexNet viennacl: OpenCL BLAS - sAXPY viennacl: CPU BLAS - sCOPY tensorflow: GPU - 1 - VGG-16 tensorflow: GPU - 32 - ResNet-50 viennacl: CPU BLAS - sDOT tensorflow: GPU - 16 - ResNet-50 viennacl: OpenCL BLAS - dGEMV-T viennacl: OpenCL BLAS - dGEMV-N viennacl: CPU BLAS - dAXPY cl-mem: Copy tensorflow: GPU - 16 - AlexNet viennacl: OpenCL BLAS - dDOT tensorflow: GPU - 512 - AlexNet pytorch: NVIDIA CUDA GPU - 32 - Efficientnet_v2_l viennacl: CPU BLAS - dCOPY tensorflow: GPU - 32 - AlexNet tensorflow: GPU - 1 - ResNet-50 cl-mem: Write tensorflow: GPU - 64 - GoogLeNet tensorflow: GPU - 32 - GoogLeNet tensorflow: GPU - 64 - AlexNet viennacl: CPU BLAS - dDOT clpeak: Global Memory Bandwidth opencl-benchmark: Memory Bandwidth Coalesced Read tensorflow: GPU - 16 - GoogLeNet cl-mem: Read tensorflow: GPU - 64 - ResNet-50 tensorflow: GPU - 256 - AlexNet tensorflow: GPU - 64 - VGG-16 tensorflow: GPU - 32 - VGG-16 neatbench: GPU viennacl: OpenCL BLAS - dCOPY viennacl: CPU BLAS - dGEMV-T pytorch: NVIDIA CUDA GPU - 16 - Efficientnet_v2_l ncnn: Vulkan GPU - FastestDet ncnn: Vulkan GPU - vision_transformer ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU - mobilenet libplacebo: hdr_peakdetect financebench: Black-Scholes OpenCL realsr-ncnn: 4x - No vkpeak: NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 18170.54 35492.69 34.885 584 4.214 630.11 339.593 613 137.44 577 646.41 0.621 22132600000 869.07 38.594 802967 19.889 599 3232733333 1176467 67583033333 17.170 27.67 10.56 2186.70 2327.55 14.307 12.60 3.480 12.82 9.45 54794 14.29 13.59 366.0576 4451 51.30 587219538.2 11.72 5.57 720.973789 509.45 2.855 507.45 15166 0.06791 504.27 504.67 501.50 52.813 19.801 24317 50299 75078 115 73929 196.07 131705 195.40 117 195.30 437 195.39 194.58 122 18.489 119 370 103.57 557.73 156 103.17 201.94 4171.00 1.48 12.62 334 106.37 3905.98 102.60 102 455.01 13.92 392 132 1.35 5.51 165 5.46 389 210 87.2 331.8 31.59 458 35.10 102.60 70.8 33.4 4.35 407.5 15.52 15.61 33.97 96.8 437.65 464.86 15.67 446.2 5.55 34.16 1.50 4070 423 109 2.86 844.61 11.11 6.86 63.82 46.26 16.17 8.97 117.81 11.04 0.84 5.07 3.85 2.31 2.25 3.03 8.62 3292.37 5.912 6.323 14555.19 28479.39 42.852 477 3.443 515.17 415.160 502 112.61 473 530.32 0.510 18202466667 714.80 31.768 660967 16.377 494 2673300000 976967 56147866667 14.284 23.26 8.89 1843.26 1968.37 12.116 14.86 4.098 10.92 11.03 47097 16.55 11.74 317.1952 3886 58.44 516770131.2 10.40 6.21 647.997867 458.39 3.168 458.36 13714 0.07498 459.27 459.93 459.94 48.517 18.203 22390 47212 79057 121 77774 186.63 137762 187.26 122 187.51 455 187.69 187.27 118 18.016 122 362 101.43 546.76 153 101.24 198.18 4152.41 1.50 12.78 330 107.59 3946.90 101.55 103 459.43 14.04 389 131 1.36 5.55 166 5.49 387 209 86.8 330.3 31.45 456 35.21 102.90 71.0 33.32 4.34 406.7 15.54 15.63 33.93 96.7 437.21 465.18 15.66 446.3 5.55 1.50 1.5 4070 423 109 103.68 2.67 382.82 6.21 5.18 20.74 8.72 5.78 5.11 45.52 6.06 0.84 3.59 2.24 2.08 2.15 2.48 7.20 3329.26 6.906 7.092 OpenBenchmarking.org
clpeak OpenCL Test: Integer Compute INT OpenBenchmarking.org GIOPS, More Is Better clpeak 1.1.2 OpenCL Test: Integer Compute INT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4K 8K 12K 16K 20K SE +/- 15.26, N = 3 SE +/- 3.14, N = 3 14555.19 18170.54 1. (CXX) g++ options: -O3
clpeak OpenCL Test: Single-Precision Float OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Single-Precision Float NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 8K 16K 24K 32K 40K SE +/- 5.46, N = 3 SE +/- 0.99, N = 3 28479.39 35492.69 1. (CXX) g++ options: -O3
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 10 20 30 40 50 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 42.85 34.89
ViennaCL Test: OpenCL BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 477 584 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: INT64 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT64 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.9482 1.8964 2.8446 3.7928 4.741 SE +/- 0.004, N = 3 SE +/- 0.015, N = 3 3.443 4.214 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
clpeak OpenCL Test: Double-Precision Double OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Double-Precision Double NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 140 280 420 560 700 SE +/- 0.21, N = 3 SE +/- 0.98, N = 3 515.17 630.11 1. (CXX) g++ options: -O3
VkResample Upscale: 2x - Precision: Double OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.77, N = 3 SE +/- 0.30, N = 3 415.16 339.59 1. (CXX) g++ options: -O3
ViennaCL Test: OpenCL BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 502 613 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
GpuOwl Exponent: 332220523 OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 332220523 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 112.61 137.44
ViennaCL Test: OpenCL BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 120 240 360 480 600 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 473 577 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
GpuOwl Exponent: 77936867 OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 77936867 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 140 280 420 560 700 SE +/- 0.09, N = 3 SE +/- 0.00, N = 3 530.32 646.41
ProjectPhysX OpenCL-Benchmark Operation: FP64 Compute OpenBenchmarking.org TFLOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: FP64 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.1397 0.2794 0.4191 0.5588 0.6985 SE +/- 0.001, N = 3 SE +/- 0.000, N = 3 0.510 0.621 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 5000M 10000M 15000M 20000M 25000M SE +/- 6318315.53, N = 3 SE +/- 5140363.15, N = 3 18202466667 22132600000
GpuOwl Exponent: 57885161 OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 57885161 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 200 400 600 800 1000 SE +/- 0.00, N = 3 SE +/- 1.26, N = 3 714.80 869.07
ProjectPhysX OpenCL-Benchmark Operation: FP32 Compute OpenBenchmarking.org TFLOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: FP32 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 9 18 27 36 45 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 31.77 38.59 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 200K 400K 600K 800K 1000K SE +/- 176.38, N = 3 SE +/- 633.33, N = 3 660967 802967
ProjectPhysX OpenCL-Benchmark Operation: INT32 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT32 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 16.38 19.89 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 494 599 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 700M 1400M 2100M 2800M 3500M SE +/- 1059874.21, N = 3 SE +/- 1530068.99, N = 3 2673300000 3232733333
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 300K 600K 900K 1200K 1500K SE +/- 2062.63, N = 3 SE +/- 1991.93, N = 3 976967 1176467
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 14000M 28000M 42000M 56000M 70000M SE +/- 33772046.30, N = 3 SE +/- 22430807.19, N = 3 56147866667 67583033333
ProjectPhysX OpenCL-Benchmark Operation: INT16 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT16 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 14.28 17.17 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 7 14 21 28 35 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 23.26 27.67 MIN: 20.92 / MAX: 24.3 MIN: 24.87 / MAX: 29.03
LuxCoreRender Scene: Danish Mood - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 8.89 10.56 MIN: 3.32 / MAX: 10.26 MIN: 3.7 / MAX: 12.17
Libplacebo Test: deband_heavy OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: deband_heavy NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 500 1000 1500 2000 2500 SE +/- 0.12, N = 3 SE +/- 2.26, N = 3 1843.26 2186.70 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
Libplacebo Test: polar_nocompute OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: polar_nocompute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 500 1000 1500 2000 2500 SE +/- 0.01, N = 3 SE +/- 0.24, N = 3 1968.37 2327.55 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
ProjectPhysX OpenCL-Benchmark Operation: INT8 Compute OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT8 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 12.12 14.31 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Classroom - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 14.86 12.60
Rodinia Test: OpenCL Particle Filter OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.9221 1.8442 2.7663 3.6884 4.6105 SE +/- 0.008, N = 3 SE +/- 0.039, N = 4 4.098 3.480 1. (CXX) g++ options: -O2 -lOpenCL
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 10.92 12.82 MIN: 4.45 / MAX: 12.42 MIN: 4.84 / MAX: 14.62
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Fishy Cat - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.06, N = 13 11.03 9.45
VkFFT Test: FFT + iFFT R2C / C2R OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT R2C / C2R NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 12K 24K 36K 48K 60K SE +/- 745.02, N = 13 SE +/- 702.53, N = 15 47097 54794 1. (CXX) g++ options: -O3 -lrt
Blender Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 16.55 14.29
LuxCoreRender Scene: DLSC - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 11.74 13.59 MIN: 11.35 / MAX: 11.83 MIN: 12.52 / MAX: 13.84
FAHBench OpenBenchmarking.org Ns Per Day, More Is Better FAHBench 2.3.2 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 80 160 240 320 400 SE +/- 0.12, N = 3 SE +/- 0.39, N = 3 317.20 366.06
VkFFT Test: FFT + iFFT C2C Bluestein benchmark in double precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein benchmark in double precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1000 2000 3000 4000 5000 SE +/- 4.51, N = 3 SE +/- 12.55, N = 3 3886 4451 1. (CXX) g++ options: -O3 -lrt
Blender Blend File: Barbershop - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Barbershop - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 13 26 39 52 65 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 58.44 51.30
MandelGPU OpenCL Device: GPU OpenBenchmarking.org Samples/sec, More Is Better MandelGPU 1.3pts1 OpenCL Device: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130M 260M 390M 520M 650M SE +/- 1783157.89, N = 3 SE +/- 467034.80, N = 3 516770131.2 587219538.2 1. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL
LuxCoreRender Scene: Orange Juice - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 10.40 11.72 MIN: 8.31 / MAX: 13.9 MIN: 9.6 / MAX: 15.44
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: BMW27 - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.06, N = 13 6.21 5.57
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 160 320 480 640 800 648.00 720.97
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.26, N = 3 458.39 509.45 MIN: 404.5 / MAX: 461.01 MIN: 430.1 / MAX: 516.48
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.7128 1.4256 2.1384 2.8512 3.564 SE +/- 0.028, N = 3 SE +/- 0.014, N = 3 3.168 2.855
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.27, N = 3 SE +/- 0.92, N = 3 458.36 507.45 MIN: 404.89 / MAX: 461.01 MIN: 423.41 / MAX: 512.88
VkFFT Test: FFT + iFFT C2C Bluestein in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein in single precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3K 6K 9K 12K 15K SE +/- 52.09, N = 3 SE +/- 102.52, N = 3 13714 15166 1. (CXX) g++ options: -O3 -lrt
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.0169 0.0338 0.0507 0.0676 0.0845 SE +/- 0.00021, N = 3 SE +/- 0.00031, N = 3 0.07498 0.06791
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.43, N = 2 SE +/- 4.43, N = 2 459.27 504.27 MIN: 405.48 / MAX: 461.88 MIN: 418.22 / MAX: 512.44
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.34, N = 3 SE +/- 1.39, N = 3 459.93 504.67 MIN: 403.65 / MAX: 462.74 MIN: 412.34 / MAX: 514.07
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.13, N = 2 SE +/- 2.17, N = 2 459.94 501.50 MIN: 403.65 / MAX: 462.59 MIN: 415.94 / MAX: 510.69
IndigoBench Acceleration: OpenCL GPU - Scene: Supercar OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 48.52 52.81
IndigoBench Acceleration: OpenCL GPU - Scene: Bedroom OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Bedroom NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 18.20 19.80
VkFFT Test: FFT + iFFT C2C 1D batched in double precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in double precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 5K 10K 15K 20K 25K SE +/- 125.94, N = 3 SE +/- 146.69, N = 3 22390 24317 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C multidimensional in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C multidimensional in single precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 11K 22K 33K 44K 55K SE +/- 476.57, N = 5 SE +/- 407.19, N = 15 47212 50299 1. (CXX) g++ options: -O3 -lrt
VkFFT Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 20K 40K 60K 80K 100K SE +/- 37.77, N = 3 SE +/- 5.84, N = 3 75078 79057 1. (CXX) g++ options: -O3 -lrt
ViennaCL Test: CPU BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 30 60 90 120 150 SE +/- 1.00, N = 2 SE +/- 2.31, N = 3 115 121 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
VkFFT Test: FFT + iFFT C2C 1D batched in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 17K 34K 51K 68K 85K SE +/- 7.94, N = 3 SE +/- 13.72, N = 3 73929 77774 1. (CXX) g++ options: -O3 -lrt
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.34, N = 3 SE +/- 0.51, N = 3 186.63 196.07 MIN: 180.51 / MAX: 187.79 MIN: 171.95 / MAX: 199.96
VkFFT Test: FFT + iFFT C2C 1D batched in half precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in half precision NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 30K 60K 90K 120K 150K SE +/- 159.17, N = 3 SE +/- 1301.92, N = 3 131705 137762 1. (CXX) g++ options: -O3 -lrt
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.29, N = 3 187.26 195.40 MIN: 179.81 / MAX: 188.21 MIN: 186.09 / MAX: 197.7
ViennaCL Test: CPU BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 30 60 90 120 150 SE +/- 2.08, N = 3 SE +/- 1.76, N = 3 117 122 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.05, N = 3 SE +/- 1.38, N = 2 187.51 195.30 MIN: 181.57 / MAX: 188.05 MIN: 182 / MAX: 199.43
ViennaCL Test: OpenCL BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 100 200 300 400 500 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 437 455 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 187.69 195.39 MIN: 182.03 / MAX: 188.31 MIN: 183.94 / MAX: 198.7
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.17, N = 3 SE +/- 1.14, N = 2 187.27 194.58 MIN: 179.9 / MAX: 188.08 MIN: 183.74 / MAX: 198.52
ViennaCL Test: CPU BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 1.20, N = 3 SE +/- 2.08, N = 3 118 122 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
VkResample Upscale: 2x - Precision: Single OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 18.49 18.02 1. (CXX) g++ options: -O3
ViennaCL Test: CPU BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 30 60 90 120 150 SE +/- 4.04, N = 3 SE +/- 1.86, N = 3 119 122 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 362 370 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.39, N = 3 101.43 103.57 MIN: 93.27 / MAX: 103.58 MIN: 95.95 / MAX: 105.54
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 120 240 360 480 600 SE +/- 3.09, N = 3 546.76 557.73 MIN: 195.25 / MAX: 556.94 MIN: 513.63 / MAX: 563.37
ViennaCL Test: CPU BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 4.81, N = 3 SE +/- 2.19, N = 3 153 156 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.05, N = 2 101.24 103.17 MIN: 93.33 / MAX: 102.92 MIN: 95.79 / MAX: 105.15
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.36, N = 3 198.18 201.94 MIN: 181.27 / MAX: 200.06 MIN: 183.53 / MAX: 206.5
Libplacebo Test: av1_grain_lap OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: av1_grain_lap NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 900 1800 2700 3600 4500 SE +/- 66.69, N = 3 SE +/- 5.52, N = 3 4103.40 4171.00 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
TensorFlow Device: GPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: VGG-16 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 2 SE +/- 0.01, N = 2 1.48 1.50
TensorFlow Device: GPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: GoogLeNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 3 6 9 12 15 SE +/- 0.17, N = 2 SE +/- 0.10, N = 3 12.62 12.78
ViennaCL Test: OpenCL BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 70 140 210 280 350 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 330 334 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 20 40 60 80 100 SE +/- 0.55, N = 3 106.37 107.59 MIN: 97.91 / MAX: 108.16 MIN: 98.77 / MAX: 109.43
Libplacebo Test: hdr_lut OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_lut NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 800 1600 2400 3200 4000 SE +/- 12.09, N = 3 SE +/- 10.06, N = 3 3905.98 3927.11 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.45, N = 3 SE +/- 1.49, N = 2 101.55 102.60 MIN: 93.44 / MAX: 103.08 MIN: 79.69 / MAX: 105.28
ViennaCL Test: CPU BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 102 103 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ProjectPhysX OpenCL-Benchmark Operation: Memory Bandwidth Coalesced Write OpenBenchmarking.org GB/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: Memory Bandwidth Coalesced Write NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 100 200 300 400 500 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 455.01 459.43 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
TensorFlow Device: GPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: AlexNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 4 8 12 16 20 SE +/- 0.22, N = 2 SE +/- 0.16, N = 3 13.92 14.04
ViennaCL Test: OpenCL BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 389 392 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 131 132 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
TensorFlow Device: GPU - Batch Size: 1 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: VGG-16 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 0.306 0.612 0.918 1.224 1.53 SE +/- 0.01, N = 2 1.35 1.36
TensorFlow Device: GPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 1.2488 2.4976 3.7464 4.9952 6.244 SE +/- 0.01, N = 2 SE +/- 0.01, N = 2 5.51 5.55
ViennaCL Test: CPU BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 40 80 120 160 200 SE +/- 2.73, N = 3 SE +/- 3.76, N = 3 165 166 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
TensorFlow Device: GPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 1.2353 2.4706 3.7059 4.9412 6.1765 SE +/- 0.00, N = 2 SE +/- 0.02, N = 3 5.46 5.49
ViennaCL Test: OpenCL BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 387 389 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 209 210 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.44, N = 3 SE +/- 0.12, N = 3 86.8 87.2 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
cl-mem Benchmark: Copy OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Copy NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 70 140 210 280 350 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 330.3 331.8 1. (CC) gcc options: -O2 -flto -lOpenCL
TensorFlow Device: GPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 7 14 21 28 35 SE +/- 0.17, N = 3 31.45 31.59
ViennaCL Test: OpenCL BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 100 200 300 400 500 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 456 458 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
TensorFlow Device: GPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 512 - Model: AlexNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 8 16 24 32 40 SE +/- 0.02, N = 2 SE +/- 0.03, N = 3 35.10 35.21
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 20 40 60 80 100 102.60 102.90 MIN: 94.84 / MAX: 104.25 MIN: 95.98 / MAX: 104.54
ViennaCL Test: CPU BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 16 32 48 64 80 SE +/- 0.32, N = 3 SE +/- 0.25, N = 3 70.8 71.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
TensorFlow Device: GPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 8 16 24 32 40 SE +/- 0.18, N = 3 SE +/- 0.15, N = 2 33.32 33.40
TensorFlow Device: GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.9788 1.9576 2.9364 3.9152 4.894 SE +/- 0.01, N = 3 4.34 4.35
cl-mem Benchmark: Write OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.55, N = 3 SE +/- 1.11, N = 3 406.7 407.5 1. (CC) gcc options: -O2 -flto -lOpenCL
TensorFlow Device: GPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: GoogLeNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 4 8 12 16 20 SE +/- 0.07, N = 3 15.52 15.54
TensorFlow Device: GPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: GoogLeNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 4 8 12 16 20 SE +/- 0.01, N = 2 SE +/- 0.03, N = 3 15.61 15.63
TensorFlow Device: GPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 8 16 24 32 40 SE +/- 0.14, N = 3 33.93 33.97
ViennaCL Test: CPU BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 96.7 96.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
clpeak OpenCL Test: Global Memory Bandwidth OpenBenchmarking.org GBPS, More Is Better clpeak 1.1.2 OpenCL Test: Global Memory Bandwidth NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 437.21 437.65 1. (CXX) g++ options: -O3
ProjectPhysX OpenCL-Benchmark Operation: Memory Bandwidth Coalesced Read OpenBenchmarking.org GB/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: Memory Bandwidth Coalesced Read NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 100 200 300 400 500 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 464.86 465.18 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
TensorFlow Device: GPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: GoogLeNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 15.66 15.67
cl-mem Benchmark: Read OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 100 200 300 400 500 SE +/- 0.12, N = 3 SE +/- 0.00, N = 3 446.2 446.3 1. (CC) gcc options: -O2 -flto -lOpenCL
TensorFlow Device: GPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 1.2488 2.4976 3.7464 4.9952 6.244 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 5.55 5.55
TensorFlow Device: GPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 256 - Model: AlexNet NVIDIA RTX 4070 SUPER 8 16 24 32 40 SE +/- 0.01, N = 3 34.16
TensorFlow Device: GPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: VGG-16 NVIDIA RTX 4070 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 1.50
TensorFlow Device: GPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: VGG-16 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.50 1.50
NeatBench Acceleration: GPU OpenBenchmarking.org FPS, More Is Better NeatBench 5 Acceleration: GPU NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 900 1800 2700 3600 4500 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4070 4070
ViennaCL Test: OpenCL BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 90 180 270 360 450 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 423 423 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 109 109 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l NVIDIA RTX 4070 20 40 60 80 100 103.68 MIN: 96.86 / MAX: 105.56
NCNN Target: Vulkan GPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: FastestDet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 0.6435 1.287 1.9305 2.574 3.2175 SE +/- 0.29, N = 9 SE +/- 0.13, N = 12 2.86 2.67 MIN: 2.17 / MAX: 577.17 MIN: 2.04 / MAX: 3.47 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 200 400 600 800 1000 SE +/- 87.53, N = 9 SE +/- 58.37, N = 12 844.61 382.82 MIN: 46.34 / MAX: 1866.93 MIN: 46.51 / MAX: 1840 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 3 6 9 12 15 SE +/- 3.28, N = 9 SE +/- 0.31, N = 8 11.11 6.50 MIN: 5.49 / MAX: 4942.19 MIN: 5.52 / MAX: 460.02 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 2 4 6 8 10 SE +/- 1.76, N = 9 SE +/- 0.17, N = 9 6.86 5.27 MIN: 4.34 / MAX: 1630.01 MIN: 4.53 / MAX: 7.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 14 28 42 56 70 SE +/- 10.56, N = 9 SE +/- 7.50, N = 9 63.82 25.11 MIN: 10.28 / MAX: 858.44 MIN: 10.66 / MAX: 857.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet50 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 10 20 30 40 50 SE +/- 14.70, N = 9 SE +/- 0.49, N = 12 46.26 8.72 MIN: 7.71 / MAX: 1829.99 MIN: 7.94 / MAX: 935.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: alexnet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 4 8 12 16 20 SE +/- 5.86, N = 9 SE +/- 3.71, N = 9 16.17 9.33 MIN: 3.52 / MAX: 436.52 MIN: 3.5 / MAX: 430.03 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet18 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 3 6 9 12 15 SE +/- 3.49, N = 9 SE +/- 3.20, N = 9 8.97 8.58 MIN: 3.94 / MAX: 922.04 MIN: 3.98 / MAX: 912.04 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vgg16 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 30 60 90 120 150 SE +/- 29.60, N = 9 SE +/- 19.29, N = 9 117.81 54.54 MIN: 17.16 / MAX: 647.67 MIN: 17.54 / MAX: 646.66 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: googlenet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 3 6 9 12 15 SE +/- 1.21, N = 9 SE +/- 0.14, N = 9 11.04 6.06 MIN: 5.28 / MAX: 1769.19 MIN: 5.33 / MAX: 8.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: blazeface NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.189 0.378 0.567 0.756 0.945 SE +/- 0.03, N = 9 SE +/- 0.04, N = 9 0.84 0.84 MIN: 0.64 / MAX: 0.96 MIN: 0.65 / MAX: 4.63 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 1.1408 2.2816 3.4224 4.5632 5.704 SE +/- 0.97, N = 9 SE +/- 0.20, N = 12 5.07 3.59 MIN: 3.22 / MAX: 1124.2 MIN: 3.02 / MAX: 509.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mnasnet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 0.8663 1.7326 2.5989 3.4652 4.3315 SE +/- 1.31, N = 9 SE +/- 0.05, N = 10 3.85 2.24 MIN: 1.89 / MAX: 1093.29 MIN: 2 / MAX: 2.6 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 0.5198 1.0396 1.5594 2.0792 2.599 SE +/- 0.34, N = 8 SE +/- 0.12, N = 7 2.31 2.11 MIN: 1.76 / MAX: 421.42 MIN: 1.77 / MAX: 2.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 6.77, N = 8 SE +/- 0.16, N = 9 8.71 2.25 MIN: 1.73 / MAX: 1561.29 MIN: 1.75 / MAX: 343.7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1.0553 2.1106 3.1659 4.2212 5.2765 SE +/- 2.36, N = 9 SE +/- 0.44, N = 9 4.69 3.03 MIN: 1.91 / MAX: 1305.64 MIN: 2.38 / MAX: 970.87 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mobilenet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 2.50, N = 9 SE +/- 0.47, N = 9 10.14 8.62 MIN: 6.53 / MAX: 1509.26 MIN: 6.42 / MAX: 1101.3 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Libplacebo Test: hdr_peakdetect OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_peakdetect NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 700 1400 2100 2800 3500 SE +/- 3.65, N = 3 SE +/- 11.75, N = 3 3292.37 3310.02 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
FinanceBench Benchmark: Black-Scholes OpenCL OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.003, N = 3 SE +/- 0.114, N = 15 6.906 5.912 1. (CXX) g++ options: -O3 -march=native -fopenmp
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.006, N = 3 SE +/- 0.150, N = 15 7.092 6.323
Phoronix Test Suite v10.8.4