Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) and MSI NVIDIA GeForce RTX 4070 12GB on EndeavourOS rolling via the Phoronix Test Suite.
NVIDIA RTX 4070 SUPER Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: ASUS NVIDIA GeForce RTX 4070 SUPER 12GB, Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
NVIDIA RTX 4070 Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: MSI NVIDIA GeForce RTX 4070 12GB , Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801 + CUDA 12.3, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysEnvironment Notes: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Compiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2aPython Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
OpenBenchmarking.org GB/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: Memory Bandwidth Coalesced Write NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 100 200 300 400 500 SE +/- 0.16, N = 3 SE +/- 0.14, N = 3 459.43 455.01 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
PyTorch This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Currently this test profile is catered to CPU-based testing. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 120 240 360 480 600 SE +/- 3.09, N = 3 546.76 557.73 MIN: 195.25 / MAX: 556.94 MIN: 513.63 / MAX: 563.37
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.36, N = 3 198.18 201.94 MIN: 181.27 / MAX: 200.06 MIN: 183.53 / MAX: 206.5
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.26, N = 3 458.39 509.45 MIN: 404.5 / MAX: 461.01 MIN: 430.1 / MAX: 516.48
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.13, N = 2 SE +/- 2.17, N = 2 459.94 501.50 MIN: 403.65 / MAX: 462.59 MIN: 415.94 / MAX: 510.69
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.27, N = 3 SE +/- 0.92, N = 3 458.36 507.45 MIN: 404.89 / MAX: 461.01 MIN: 423.41 / MAX: 512.88
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.29, N = 3 187.26 195.40 MIN: 179.81 / MAX: 188.21 MIN: 186.09 / MAX: 197.7
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.34, N = 3 SE +/- 1.39, N = 3 459.93 504.67 MIN: 403.65 / MAX: 462.74 MIN: 412.34 / MAX: 514.07
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 187.69 195.39 MIN: 182.03 / MAX: 188.31 MIN: 183.94 / MAX: 198.7
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.43, N = 2 SE +/- 4.43, N = 2 459.27 504.27 MIN: 405.48 / MAX: 461.88 MIN: 418.22 / MAX: 512.44
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.34, N = 3 SE +/- 0.51, N = 3 186.63 196.07 MIN: 180.51 / MAX: 187.79 MIN: 171.95 / MAX: 199.96
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.17, N = 3 SE +/- 1.14, N = 2 187.27 194.58 MIN: 179.9 / MAX: 188.08 MIN: 183.74 / MAX: 198.52
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.05, N = 3 SE +/- 1.38, N = 2 187.51 195.30 MIN: 181.57 / MAX: 188.05 MIN: 182 / MAX: 199.43
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.55, N = 3 107.59 106.37 MIN: 98.77 / MAX: 109.43 MIN: 97.91 / MAX: 108.16
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l NVIDIA RTX 4070 20 40 60 80 100 103.68 MIN: 96.86 / MAX: 105.56
Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: AttributeError: 'tuple' object has no attribute '_compiled_call_impl'
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 102.90 102.60 MIN: 95.98 / MAX: 104.54 MIN: 94.84 / MAX: 104.25
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.45, N = 3 SE +/- 1.49, N = 2 101.55 102.60 MIN: 93.44 / MAX: 103.08 MIN: 79.69 / MAX: 105.28
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.05, N = 2 101.24 103.17 MIN: 93.33 / MAX: 102.92 MIN: 95.79 / MAX: 105.15
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.39, N = 3 101.43 103.57 MIN: 93.27 / MAX: 103.58 MIN: 95.95 / MAX: 105.54
OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 77936867 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 140 280 420 560 700 SE +/- 0.09, N = 3 SE +/- 0.00, N = 3 530.32 646.41
OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 332220523 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 112.61 137.44
vkpeak Vkpeak is a Vulkan compute benchmark inspired by OpenCL's clpeak. Vkpeak provides Vulkan compute performance measurements for FP16 / FP32 / FP64 / INT16 / INT32 scalar and vec4 performance. Learn more via the OpenBenchmarking.org test page.
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.
RealSR-NCNN RealSR-NCNN is an NCNN neural network implementation of the RealSR project and accelerated using the Vulkan API. RealSR is the Real-World Super Resolution via Kernel Estimation and Noise Injection. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image by a scale of 4x with Vulkan. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.006, N = 3 SE +/- 0.150, N = 15 7.092 6.323
Waifu2x-NCNN Vulkan Waifu2x-NCNN is an NCNN neural network implementation of the Waifu2x converter project and accelerated using the Vulkan API. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image with Vulkan. Learn more via the OpenBenchmarking.org test page.
Scale: 2x - Denoise: 3 - TAA: No
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT R2C / C2R NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 12K 24K 36K 48K 60K SE +/- 745.02, N = 13 SE +/- 702.53, N = 15 47097 54794 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in half precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30K 60K 90K 120K 150K SE +/- 1301.92, N = 3 SE +/- 159.17, N = 3 137762 131705 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein in single precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3K 6K 9K 12K 15K SE +/- 52.09, N = 3 SE +/- 102.52, N = 3 13714 15166 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in double precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 5K 10K 15K 20K 25K SE +/- 125.94, N = 3 SE +/- 146.69, N = 3 22390 24317 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 17K 34K 51K 68K 85K SE +/- 13.72, N = 3 SE +/- 7.94, N = 3 77774 73929 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C multidimensional in single precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 11K 22K 33K 44K 55K SE +/- 476.57, N = 5 SE +/- 407.19, N = 15 47212 50299 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein benchmark in double precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1000 2000 3000 4000 5000 SE +/- 4.51, N = 3 SE +/- 12.55, N = 3 3886 4451 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20K 40K 60K 80K 100K SE +/- 5.84, N = 3 SE +/- 37.77, N = 3 79057 75078 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 5000M 10000M 15000M 20000M 25000M SE +/- 6318315.53, N = 3 SE +/- 5140363.15, N = 3 18202466667 22132600000
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 300K 600K 900K 1200K 1500K SE +/- 2062.63, N = 3 SE +/- 1991.93, N = 3 976967 1176467
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 700M 1400M 2100M 2800M 3500M SE +/- 1059874.21, N = 3 SE +/- 1530068.99, N = 3 2673300000 3232733333
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 200K 400K 600K 800K 1000K SE +/- 176.38, N = 3 SE +/- 633.33, N = 3 660967 802967
Libplacebo Libplacebo is a multimedia rendering library based on the core rendering code of the MPV player. The libplacebo benchmark relies on the Vulkan API and tests various primitives. Learn more via the OpenBenchmarking.org test page.
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: libplacebo: line 3: ./src/bench: No such file or directory
OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 100 200 300 400 500 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 446.3 446.2 1. (CC) gcc options: -O2 -flto -lOpenCL
OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.55, N = 3 SE +/- 1.11, N = 3 406.7 407.5 1. (CC) gcc options: -O2 -flto -lOpenCL
NAMD CUDA NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. This version of the NAMD test profile uses CUDA GPU acceleration. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.0169 0.0338 0.0507 0.0676 0.0845 SE +/- 0.00021, N = 3 SE +/- 0.00031, N = 3 0.07498 0.06791
VkResample VkResample is a Vulkan-based image upscaling library based on VkFFT. The sample input file is upscaling a 4K image to 8K using Vulkan-based GPU acceleration. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.77, N = 3 SE +/- 0.30, N = 3 415.16 339.59 1. (CXX) g++ options: -O3
OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 18.02 18.49 1. (CXX) g++ options: -O3
OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Single-Precision Float NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 8K 16K 24K 32K 40K SE +/- 5.46, N = 3 SE +/- 0.99, N = 3 28479.39 35492.69 1. (CXX) g++ options: -O3
OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Double-Precision Double NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 140 280 420 560 700 SE +/- 0.21, N = 3 SE +/- 0.98, N = 3 515.17 630.11 1. (CXX) g++ options: -O3
OpenBenchmarking.org GBPS, More Is Better clpeak 1.1.2 OpenCL Test: Global Memory Bandwidth NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 437.21 437.65 1. (CXX) g++ options: -O3
LeelaChessZero LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.
Backend: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
Rodinia Rodinia is a suite focused upon accelerating compute-intensive applications with accelerators. CUDA, OpenMP, and OpenCL parallel models are supported by the included applications. This profile utilizes select OpenCL, NVIDIA CUDA and OpenMP test binaries at the moment. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.9221 1.8442 2.7663 3.6884 4.6105 SE +/- 0.008, N = 3 SE +/- 0.039, N = 4 4.098 3.480 1. (CXX) g++ options: -O2 -lOpenCL
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 11.74 13.59 MIN: 11.35 / MAX: 11.83 MIN: 12.52 / MAX: 13.84
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 8.89 10.56 MIN: 3.32 / MAX: 10.26 MIN: 3.7 / MAX: 12.17
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 10.40 11.72 MIN: 8.31 / MAX: 13.9 MIN: 9.6 / MAX: 15.44
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 10.92 12.82 MIN: 4.45 / MAX: 12.42 MIN: 4.84 / MAX: 14.62
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 7 14 21 28 35 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 23.26 27.67 MIN: 20.92 / MAX: 24.3 MIN: 24.87 / MAX: 29.03
ArrayFire ArrayFire is an GPU and CPU numeric processing library, this test uses the built-in CPU and OpenCL ArrayFire benchmarks. Learn more via the OpenBenchmarking.org test page.
Test: Conjugate Gradient OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: arrayfire: line 3: ./cg_opencl: No such file or directory
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: arrayfire: line 3: ./cg_opencl: No such file or directory
FinanceBench FinanceBench is a collection of financial program benchmarks with support for benchmarking on the GPU via OpenCL and CPU benchmarking with OpenMP. The FinanceBench test cases are focused on Black-Sholes-Merton Process with Analytic European Option engine, QMC (Sobol) Monte-Carlo method (Equity Option Example), Bonds Fixed-rate bond with flat forward curve, and Repo Securities repurchase agreement. FinanceBench was originally written by the Cavazos Lab at University of Delaware. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.003, N = 3 SE +/- 0.114, N = 15 6.906 5.912 1. (CXX) g++ options: -O3 -march=native -fopenmp
ViennaCL ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 131 132 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 4.81, N = 3 SE +/- 2.19, N = 3 153 156 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 3.76, N = 3 SE +/- 2.73, N = 3 166 165 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 16 32 48 64 80 SE +/- 0.25, N = 3 SE +/- 0.32, N = 3 71.0 70.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.44, N = 3 SE +/- 0.12, N = 3 86.8 87.2 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 96.7 96.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 103 102 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 109 109 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 1.86, N = 3 SE +/- 4.04, N = 3 122 119 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 1.76, N = 3 SE +/- 2.08, N = 3 122 117 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 2.31, N = 3 SE +/- 1.00, N = 2 121 115 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 1.20, N = 3 SE +/- 2.08, N = 3 118 122 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 70 140 210 280 350 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 330 334 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 389 392 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 362 370 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 90 180 270 360 450 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 423 423 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 100 200 300 400 500 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 455 437 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 100 200 300 400 500 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 456 458 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 209 210 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 387 389 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 120 240 360 480 600 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 473 577 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 477 584 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 494 599 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 502 613 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
Caffe This is a benchmark of the Caffe deep learning framework and currently supports the AlexNet and Googlenet model and execution on both CPUs and NVIDIA GPUs. Learn more via the OpenBenchmarking.org test page.
Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 100
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7dd7c6de3450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7b80311e3450 google::LogMessageFatal::~LogMessageFatal()
Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 200
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7b5ea59be450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7c31ed79d450 google::LogMessageFatal::~LogMessageFatal()
Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 1000
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7670bcda4450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7bb89c5be450 google::LogMessageFatal::~LogMessageFatal()
Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 100
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x73552c3e3450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x71f0ea05a450 google::LogMessageFatal::~LogMessageFatal()
Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 200
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7d7151816450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7e64df79d450 google::LogMessageFatal::~LogMessageFatal()
Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 1000
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x74746a490450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7493bdbbc450 google::LogMessageFatal::~LogMessageFatal()
NCNN NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.
Target: Vulkan GPU
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ncnn: line 3: ./benchncnn: No such file or directory
PlaidML This test profile uses PlaidML deep learning framework developed by Intel for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.
FP16: No - Mode: Training - Network: Mobilenet - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test run did not produce a result.
FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test quit with a non-zero exit status.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test quit with a non-zero exit status. E: AttributeError: 'method_descriptor' object has no attribute 'default'
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test quit with a non-zero exit status. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: BMW27 - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.06, N = 13 6.21 5.57
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Classroom - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 14.86 12.60
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Fishy Cat - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.06, N = 13 11.03 9.45
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Barbershop - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 13 26 39 52 65 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 58.44 51.30
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 16.55 14.29
OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 48.52 52.81
MandelGPU MandelGPU is an OpenCL benchmark and this test runs with the OpenCL rendering float4 kernel with a maximum of 4096 iterations. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Samples/sec, More Is Better MandelGPU 1.3pts1 OpenCL Device: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 130M 260M 390M 520M 650M SE +/- 1783157.89, N = 3 SE +/- 467034.80, N = 3 516770131.2 587219538.2 1. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: VGG-16 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.306 0.612 0.918 1.224 1.53 SE +/- 0.01, N = 2 1.36 1.35
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.16, N = 3 SE +/- 0.22, N = 2 14.04 13.92
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: VGG-16 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.01, N = 2 SE +/- 0.00, N = 2 1.50 1.48
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: VGG-16 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.50 1.50
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: VGG-16 NVIDIA RTX 4070 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 1.50
Device: GPU - Batch Size: 64 - Model: VGG-16
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: UnboundLocalError: cannot access local variable 'decorators' where it is not associated with a value
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 7 14 21 28 35 SE +/- 0.17, N = 3 31.45 31.59
Device: GPU - Batch Size: 256 - Model: VGG-16
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: AttributeError: 'collections.OrderedDict' object has no attribute 'empty'
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 8 16 24 32 40 SE +/- 0.18, N = 3 SE +/- 0.15, N = 2 33.32 33.40
Device: GPU - Batch Size: 512 - Model: VGG-16
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: Fatal Python error: Segmentation fault
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: AttributeError: 'function' object has no attribute 'empty'
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 8 16 24 32 40 SE +/- 0.14, N = 3 33.93 33.97
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: GoogLeNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.10, N = 3 SE +/- 0.17, N = 2 12.78 12.62
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.9788 1.9576 2.9364 3.9152 4.894 SE +/- 0.01, N = 3 4.34 4.35
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 256 - Model: AlexNet NVIDIA RTX 4070 SUPER 8 16 24 32 40 SE +/- 0.01, N = 3 34.16
Device: GPU - Batch Size: 256 - Model: AlexNet
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: UnboundLocalError: cannot access local variable 'kind' where it is not associated with a value
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 512 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.02, N = 2 35.21 35.10
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: GoogLeNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 15.66 15.67
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1.2353 2.4706 3.7059 4.9412 6.1765 SE +/- 0.02, N = 3 SE +/- 0.00, N = 2 5.49 5.46
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: GoogLeNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.01, N = 2 15.63 15.61
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1.2488 2.4976 3.7464 4.9952 6.244 SE +/- 0.01, N = 2 SE +/- 0.01, N = 2 5.55 5.51
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: GoogLeNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 0.07, N = 3 15.54 15.52
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1.2488 2.4976 3.7464 4.9952 6.244 SE +/- 0.00, N = 3 SE +/- 0.01, N = 2 5.55 5.55
Libplacebo Libplacebo is a multimedia rendering library based on the core rendering code of the MPV player. The libplacebo benchmark relies on the Vulkan API and tests various primitives. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: deband_heavy NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 500 1000 1500 2000 2500 SE +/- 0.12, N = 3 SE +/- 2.26, N = 3 1843.26 2186.70 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: polar_nocompute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 500 1000 1500 2000 2500 SE +/- 0.01, N = 3 SE +/- 0.24, N = 3 1968.37 2327.55 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_peakdetect NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 700 1400 2100 2800 3500 SE +/- 11.75, N = 3 SE +/- 3.65, N = 3 3310.02 3292.37 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_lut NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 800 1600 2400 3200 4000 SE +/- 10.06, N = 3 SE +/- 12.09, N = 3 3927.11 3905.98 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: av1_grain_lap NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 900 1800 2700 3600 4500 SE +/- 66.69, N = 3 SE +/- 5.52, N = 3 4103.40 4171.00 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
NCNN NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mobilenet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.21, N = 12 SE +/- 0.47, N = 9 7.20 8.62 MIN: 6.2 / MAX: 11.13 MIN: 6.42 / MAX: 1101.3 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1.0553 2.1106 3.1659 4.2212 5.2765 SE +/- 0.07, N = 12 SE +/- 0.44, N = 9 2.48 3.03 MIN: 2.02 / MAX: 5.82 MIN: 2.38 / MAX: 970.87 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.08, N = 12 SE +/- 0.16, N = 9 2.15 2.25 MIN: 1.81 / MAX: 2.58 MIN: 1.75 / MAX: 343.7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.5198 1.0396 1.5594 2.0792 2.599 SE +/- 0.09, N = 11 SE +/- 0.34, N = 8 2.08 2.31 MIN: 1.82 / MAX: 2.59 MIN: 1.76 / MAX: 421.42 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mnasnet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.8663 1.7326 2.5989 3.4652 4.3315 SE +/- 0.08, N = 8 SE +/- 1.31, N = 9 2.22 3.85 MIN: 1.83 / MAX: 2.54 MIN: 1.89 / MAX: 1093.29 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 1.1408 2.2816 3.4224 4.5632 5.704 SE +/- 0.09, N = 9 SE +/- 0.97, N = 9 3.46 5.07 MIN: 2.91 / MAX: 3.79 MIN: 3.22 / MAX: 1124.2 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: blazeface NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.189 0.378 0.567 0.756 0.945 SE +/- 0.03, N = 9 SE +/- 0.04, N = 9 0.84 0.84 MIN: 0.64 / MAX: 0.96 MIN: 0.65 / MAX: 4.63 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: googlenet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.14, N = 9 SE +/- 1.21, N = 9 6.06 11.04 MIN: 5.33 / MAX: 8.36 MIN: 5.28 / MAX: 1769.19 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vgg16 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 30 60 90 120 150 SE +/- 13.24, N = 12 SE +/- 29.60, N = 9 45.52 117.81 MIN: 17.49 / MAX: 643.35 MIN: 17.16 / MAX: 647.67 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet18 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.73, N = 12 SE +/- 3.49, N = 9 5.11 8.97 MIN: 3.99 / MAX: 916.69 MIN: 3.94 / MAX: 922.04 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: alexnet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 4 8 12 16 20 SE +/- 1.70, N = 12 SE +/- 5.86, N = 9 5.78 16.17 MIN: 3.6 / MAX: 397.75 MIN: 3.52 / MAX: 436.52 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet50 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 10 20 30 40 50 SE +/- 0.10, N = 9 SE +/- 14.70, N = 9 8.24 46.26 MIN: 7.87 / MAX: 9.87 MIN: 7.71 / MAX: 1829.99 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 14 28 42 56 70 SE +/- 5.37, N = 12 SE +/- 10.56, N = 9 20.74 63.82 MIN: 10.3 / MAX: 854.36 MIN: 10.28 / MAX: 858.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 2 4 6 8 10 SE +/- 0.12, N = 12 SE +/- 1.76, N = 9 5.18 6.86 MIN: 4.67 / MAX: 6.88 MIN: 4.34 / MAX: 1630.01 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 3 6 9 12 15 SE +/- 0.24, N = 12 SE +/- 3.28, N = 9 6.21 11.11 MIN: 5.53 / MAX: 8.99 MIN: 5.49 / MAX: 4942.19 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 200 400 600 800 1000 SE +/- 61.31, N = 9 SE +/- 87.53, N = 9 281.56 844.61 MIN: 46.48 / MAX: 1913.33 MIN: 46.34 / MAX: 1866.93 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: FastestDet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 0.6435 1.287 1.9305 2.574 3.2175 SE +/- 0.10, N = 9 SE +/- 0.29, N = 9 2.34 2.86 MIN: 2 / MAX: 3.86 MIN: 2.17 / MAX: 577.17 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NVIDIA RTX 4070 SUPER Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: ASUS NVIDIA GeForce RTX 4070 SUPER 12GB, Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 25 January 2024 21:36 by user test.
NVIDIA RTX 4070 Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: MSI NVIDIA GeForce RTX 4070 12GB, Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801 + CUDA 12.3, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysEnvironment Notes: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Compiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2aPython Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 28 January 2024 13:02 by user test.