RTX 4070 SUPER

Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) and NVIDIA GeForce RTX 4070 Ti 12GB on EndeavourOS rolling via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2401307-NE-2401299NE85&rdt&grr.

RTX 4070 SUPERProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLCompilerFile-SystemScreen ResolutionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TIIntel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads)ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS)Intel Device 7a2732GB4001GB Seagate ZP4000GP304001ASUS NVIDIA GeForce RTX 4070 SUPER 12GBRealtek ALC1220ARZOPAIntel I226-V + Intel Device 7a70EndeavourOS rolling6.7.1-arch1-1 (x86_64)KDE Plasma 5.27.10X Server 1.21.1.11NVIDIA 550.40.074.6.0OpenCL 3.0 CUDA 12.4.74GCC 13.2.1 20230801ext41920x1080MSI NVIDIA GeForce RTX 4070 12GBGCC 13.2.1 20230801 + CUDA 12.3NVIDIA GeForce RTX 4070 Ti 12GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Details- NVIDIA RTX 4070 SUPER: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1- NVIDIA RTX 4070: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2a- NVIDIA RTX 4070 TI: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.31.00.36Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected Environment Details- NVIDIA RTX 4070, NVIDIA RTX 4070 TI: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Python Details- NVIDIA RTX 4070, NVIDIA RTX 4070 TI: Python 3.11.6

RTX 4070 SUPERtensorflow: GPU - 64 - VGG-16tensorflow: GPU - 256 - VGG-16tensorflow: GPU - 32 - VGG-16tensorflow: GPU - 512 - AlexNettensorflow: GPU - 64 - ResNet-50ncnn: Vulkan GPU - googlenetncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v3-v3 - mobilenet-v3tensorflow: GPU - 16 - VGG-16tensorflow: GPU - 32 - ResNet-50tensorflow: GPU - 256 - AlexNettensorflow: GPU - 64 - GoogLeNettensorflow: GPU - 16 - ResNet-50tensorflow: GPU - 32 - GoogLeNetgpuowl: 77936867tensorflow: GPU - 64 - AlexNetgpuowl: 332220523octanebench: Total Scorevkfft: FFT + iFFT C2C multidimensional in single precisiongpuowl: 57885161tensorflow: GPU - 16 - GoogLeNetvkfft: FFT + iFFT C2C Bluestein benchmark in double precisionfahbench: tensorflow: GPU - 32 - AlexNetvkresample: 2x - Doubleindigobench: OpenCL GPU - Bedroomindigobench: OpenCL GPU - Supercarvkfft: FFT + iFFT C2C 1D batched in double precisionluxcorerender: LuxCore Benchmark - GPUluxcorerender: DLSC - GPUvkfft: FFT + iFFT C2C Bluestein in single precisionluxcorerender: Orange Juice - GPUluxcorerender: Danish Mood - GPUvkfft: FFT + iFFT R2C / C2Rblender: Barbershop - NVIDIA OptiXtensorflow: GPU - 1 - VGG-16vkfft: FFT + iFFT C2C 1D batched in single precisionvkfft: FFT + iFFT C2C 1D batched in single precision, no reshufflingtensorflow: GPU - 16 - AlexNetlibplacebo: av1_grain_laplibplacebo: hdr_lutlibplacebo: hdr_peakdetectlibplacebo: polar_nocomputelibplacebo: deband_heavyrealsr-ncnn: 4x - Yesvkfft: FFT + iFFT C2C 1D batched in half precisionnamd-cuda: ATPase Simulation - 327,506 Atomspytorch: NVIDIA CUDA GPU - 32 - Efficientnet_v2_lblender: Fishy Cat - NVIDIA OptiXpytorch: NVIDIA CUDA GPU - 64 - Efficientnet_v2_lviennacl: CPU BLAS - dGEMM-TTviennacl: CPU BLAS - dGEMM-TNviennacl: CPU BLAS - dGEMM-NTviennacl: CPU BLAS - dGEMM-NNviennacl: CPU BLAS - dGEMV-Tviennacl: CPU BLAS - dGEMV-Nviennacl: CPU BLAS - dDOTviennacl: CPU BLAS - dAXPYviennacl: CPU BLAS - dCOPYviennacl: CPU BLAS - sDOTviennacl: CPU BLAS - sAXPYviennacl: CPU BLAS - sCOPYviennacl: OpenCL BLAS - dGEMM-TTviennacl: OpenCL BLAS - dGEMM-TNviennacl: OpenCL BLAS - dGEMM-NTviennacl: OpenCL BLAS - dGEMM-NNviennacl: OpenCL BLAS - dGEMV-Tviennacl: OpenCL BLAS - dGEMV-Nviennacl: OpenCL BLAS - dDOTviennacl: OpenCL BLAS - dAXPYviennacl: OpenCL BLAS - dCOPYviennacl: OpenCL BLAS - sDOTviennacl: OpenCL BLAS - sAXPYviennacl: OpenCL BLAS - sCOPYtensorflow: GPU - 1 - ResNet-50pytorch: NVIDIA CUDA GPU - 512 - Efficientnet_v2_lblender: Pabellon Barcelona - NVIDIA OptiXrealsr-ncnn: 4x - Nopytorch: NVIDIA CUDA GPU - 256 - Efficientnet_v2_lblender: Classroom - NVIDIA OptiXpytorch: NVIDIA CUDA GPU - 64 - ResNet-152blender: BMW27 - NVIDIA OptiXopencl-benchmark: Memory Bandwidth Coalesced Writeopencl-benchmark: Memory Bandwidth Coalesced Readopencl-benchmark: INT8 Computeopencl-benchmark: INT16 Computeopencl-benchmark: INT32 Computeopencl-benchmark: INT64 Computeopencl-benchmark: FP32 Computeopencl-benchmark: FP64 Computepytorch: NVIDIA CUDA GPU - 256 - ResNet-152pytorch: NVIDIA CUDA GPU - 16 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 512 - ResNet-152pytorch: NVIDIA CUDA GPU - 1 - ResNet-50vkresample: 2x - Singletensorflow: GPU - 1 - GoogLeNetpytorch: NVIDIA CUDA GPU - 16 - ResNet-152pytorch: NVIDIA CUDA GPU - 1 - Efficientnet_v2_ltensorflow: GPU - 1 - AlexNetclpeak: Double-Precision Doublepytorch: NVIDIA CUDA GPU - 64 - ResNet-50luxcorerender: Rainbow Colors and Prism - GPUhashcat: SHA1hashcat: SHA-512pytorch: NVIDIA CUDA GPU - 1 - ResNet-152hashcat: MD5pytorch: NVIDIA CUDA GPU - 16 - ResNet-50pytorch: NVIDIA CUDA GPU - 32 - ResNet-152pytorch: NVIDIA CUDA GPU - 256 - ResNet-50pytorch: NVIDIA CUDA GPU - 32 - ResNet-50pytorch: NVIDIA CUDA GPU - 512 - ResNet-50hashcat: TrueCrypt RIPEMD160 + XTScl-mem: Copycl-mem: Readcl-mem: Writerodinia: OpenCL Particle Filterhashcat: 7-Zipwaifu2x-ncnn: 2x - 3 - Yesclpeak: Global Memory Bandwidthmandelgpu: GPUfinancebench: Black-Scholes OpenCLclpeak: Integer Compute INTclpeak: Single-Precision Floatneatbench: GPUncnn: Vulkan GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1.5035.105.5511.040.842.86844.6111.116.8663.8246.2616.178.97117.815.073.852.313.038.622.251.485.5134.1615.525.4615.61646.4133.97137.44720.97378950299869.0715.674451366.057633.4339.59319.80152.8132431712.8213.591516611.7210.565479451.301.35739297507831.594171.003905.983292.372327.552186.7034.8851317050.06791102.609.45102.6012211511711910910296.887.270.81651561326135995845773892104584374233703923344.35103.5714.296.323103.1712.60196.075.57455.01464.8614.30717.17019.8894.21438.5940.621194.58195.30557.7318.48912.62195.40106.3713.92630.11507.4527.67221326000003232733333201.9467583033333509.45195.39504.67501.50504.27802967331.8446.2407.53.48011764672.855437.65587219538.25.91218170.5435492.6940701.501.535.215.556.060.842.34281.566.505.2725.118.249.338.5854.543.462.222.114.6910.148.711.505.5515.545.4915.63530.3233.93112.61647.99786747212714.8015.663886317.195233.32415.16018.20348.5172239010.9211.741371410.408.894709758.441.36777747905731.454103.403927.113310.021972.781847.9842.8521377620.07498102.9011.03101.5511812112212210910396.786.871.01661531315024944774733872094564554233623893304.34101.4316.557.092101.2414.86186.636.21459.43465.1812.11614.28416.3773.44331.7680.510187.27103.68187.51546.7618.01612.78187.26107.5914.04515.17458.3623.26182024666672673300000198.1856147866667458.39187.69459.93459.94459.27660967330.3446.3406.74.0989769673.168437.21516770131.26.90614555.1928479.3940701.51.51.535.445.535.870.812.84390.185.975.3616.4714.323.745.4732.053.492.302.032.438.432.091.495.5034.6115.505.4615.81676.5934.06145.84735.94059351528919.1315.694647382.163733.29322.06420.25653.5892543113.2313.951512511.8910.995544650.731.38739427514131.704140.873971.613544.602461.232306.6733.6261362100.0678896.509.02103.20124125118117102.710396.487.371.31681561326486346126043912114574374243653933364.32103.5013.975.962103.2412.30197.025.43457.17465.0715.73118.28121.0474.42040.9140.660195.86103.45194.87535.3918.45612.79194.29108.5914.79667.05505.6227.71235324000003462500000201.1973312233333502.92198.82505.55504.66858600333.3446.3412.23.29112626332.854437.63619106132.55.22619821.1038691.734070OpenBenchmarking.org

TensorFlow

Device: GPU - Batch Size: 64 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: VGG-16NVIDIA RTX 4070NVIDIA RTX 4070 TI0.33750.6751.01251.351.6875SE +/- 0.00, N = 3SE +/- 0.00, N = 31.501.50

TensorFlow

Device: GPU - Batch Size: 256 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 256 - Model: VGG-16NVIDIA RTX 4070 TI0.33750.6751.01251.351.68751.5

TensorFlow

Device: GPU - Batch Size: 32 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: VGG-16NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.33750.6751.01251.351.6875SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 21.501.501.50

TensorFlow

Device: GPU - Batch Size: 512 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 512 - Model: AlexNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI816243240SE +/- 0.02, N = 2SE +/- 0.03, N = 3SE +/- 0.09, N = 235.1035.2135.44

TensorFlow

Device: GPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1.24882.49763.74644.99526.244SE +/- 0.01, N = 2SE +/- 0.00, N = 3SE +/- 0.01, N = 25.555.555.53

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetNVIDIA RTX 4070 TINVIDIA RTX 4070 SUPERNVIDIA RTX 40703691215SE +/- 1.04, N = 12SE +/- 1.21, N = 9SE +/- 0.14, N = 97.3711.046.06MIN: 5.33 / MAX: 1653.33MIN: 5.28 / MAX: 1769.19MIN: 5.33 / MAX: 8.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceNVIDIA RTX 4070 TINVIDIA RTX 4070 SUPERNVIDIA RTX 40700.1890.3780.5670.7560.945SE +/- 0.03, N = 12SE +/- 0.04, N = 9SE +/- 0.03, N = 90.820.840.84MIN: 0.63 / MAX: 2.58MIN: 0.65 / MAX: 4.63MIN: 0.64 / MAX: 0.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER0.6841.3682.0522.7363.42SE +/- 0.13, N = 12SE +/- 0.32, N = 10SE +/- 0.29, N = 92.673.042.86MIN: 2.04 / MAX: 3.47MIN: 2.14 / MAX: 847.58MIN: 2.17 / MAX: 577.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER2004006008001000SE +/- 58.37, N = 12SE +/- 58.07, N = 12SE +/- 87.53, N = 9382.82497.66844.61MIN: 46.51 / MAX: 1840MIN: 46.41 / MAX: 1886.67MIN: 46.34 / MAX: 1866.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER3691215SE +/- 0.24, N = 12SE +/- 0.18, N = 12SE +/- 3.28, N = 96.215.8911.11MIN: 5.53 / MAX: 8.99MIN: 5.42 / MAX: 7.57MIN: 5.49 / MAX: 4942.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER246810SE +/- 0.12, N = 12SE +/- 0.93, N = 12SE +/- 1.76, N = 95.186.136.86MIN: 4.67 / MAX: 6.88MIN: 4.75 / MAX: 1633.33MIN: 4.34 / MAX: 1630.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER1428425670SE +/- 5.37, N = 12SE +/- 3.10, N = 12SE +/- 10.56, N = 920.7416.3763.82MIN: 10.3 / MAX: 854.36MIN: 10.57 / MAX: 855.36MIN: 10.28 / MAX: 858.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER1020304050SE +/- 0.49, N = 12SE +/- 4.00, N = 12SE +/- 14.70, N = 98.7212.2546.26MIN: 7.94 / MAX: 935.44MIN: 8 / MAX: 1777.17MIN: 7.71 / MAX: 1829.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER48121620SE +/- 1.70, N = 12SE +/- 2.33, N = 12SE +/- 5.86, N = 95.786.0716.17MIN: 3.6 / MAX: 397.75MIN: 3.63 / MAX: 432.24MIN: 3.52 / MAX: 436.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER3691215SE +/- 0.73, N = 12SE +/- 1.74, N = 12SE +/- 3.49, N = 95.117.748.97MIN: 3.99 / MAX: 916.69MIN: 3.96 / MAX: 898.97MIN: 3.94 / MAX: 922.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER306090120150SE +/- 13.24, N = 12SE +/- 8.53, N = 12SE +/- 29.60, N = 945.5234.49117.81MIN: 17.49 / MAX: 643.35MIN: 17.35 / MAX: 644.35MIN: 17.16 / MAX: 647.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER1.14082.28163.42244.56325.704SE +/- 0.20, N = 12SE +/- 0.07, N = 12SE +/- 0.97, N = 93.593.465.07MIN: 3.02 / MAX: 509.97MIN: 3.13 / MAX: 7.03MIN: 3.22 / MAX: 1124.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER0.93151.8632.79453.7264.6575SE +/- 0.05, N = 10SE +/- 1.94, N = 12SE +/- 1.31, N = 92.244.143.85MIN: 2 / MAX: 2.6MIN: 1.95 / MAX: 1020MIN: 1.89 / MAX: 1093.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER0.51981.03961.55942.07922.599SE +/- 0.09, N = 11SE +/- 0.08, N = 12SE +/- 0.34, N = 82.082.012.31MIN: 1.82 / MAX: 2.59MIN: 1.73 / MAX: 3.86MIN: 1.76 / MAX: 421.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER1.05532.11063.16594.22125.2765SE +/- 0.07, N = 12SE +/- 0.06, N = 12SE +/- 0.44, N = 92.482.543.03MIN: 2.02 / MAX: 5.82MIN: 2.07 / MAX: 15.69MIN: 2.38 / MAX: 970.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER3691215SE +/- 0.21, N = 12SE +/- 0.25, N = 12SE +/- 0.47, N = 97.207.458.62MIN: 6.2 / MAX: 11.13MIN: 6.87 / MAX: 734.65MIN: 6.42 / MAX: 1101.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TI246810SE +/- 0.08, N = 12SE +/- 0.16, N = 9SE +/- 0.09, N = 92.152.252.09MIN: 1.81 / MAX: 2.58MIN: 1.75 / MAX: 343.7MIN: 1.78 / MAX: 2.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TensorFlow

Device: GPU - Batch Size: 16 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: VGG-16NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.33750.6751.01251.351.6875SE +/- 0.00, N = 2SE +/- 0.01, N = 21.481.501.49

TensorFlow

Device: GPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1.24882.49763.74644.99526.244SE +/- 0.01, N = 2SE +/- 0.01, N = 2SE +/- 0.02, N = 35.515.555.50

TensorFlow

Device: GPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 256 - Model: AlexNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TI816243240SE +/- 0.01, N = 3SE +/- 0.07, N = 234.1634.61

TensorFlow

Device: GPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: GoogLeNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.07, N = 3SE +/- 0.06, N = 215.5215.5415.50

TensorFlow

Device: GPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1.23532.47063.70594.94126.1765SE +/- 0.00, N = 2SE +/- 0.02, N = 3SE +/- 0.01, N = 35.465.495.46

TensorFlow

Device: GPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: GoogLeNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.01, N = 2SE +/- 0.03, N = 3SE +/- 0.03, N = 315.6115.6315.81

GpuOwl

Exponent: 77936867

OpenBenchmarking.orgIterations / Second, More Is BetterGpuOwl 7.2.1Exponent: 77936867NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI150300450600750SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3646.41530.32676.59

TensorFlow

Device: GPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: AlexNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI816243240SE +/- 0.14, N = 3SE +/- 0.06, N = 333.9733.9334.06

GpuOwl

Exponent: 332220523

OpenBenchmarking.orgIterations / Second, More Is BetterGpuOwl 7.2.1Exponent: 332220523NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI306090120150SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3137.44112.61145.84

OctaneBench

Total Score

OpenBenchmarking.orgScore, More Is BetterOctaneBench 2020.1Total ScoreNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI160320480640800720.97648.00735.94

VkFFT

Test: FFT + iFFT C2C multidimensional in single precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C multidimensional in single precisionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI11K22K33K44K55KSE +/- 407.19, N = 15SE +/- 476.57, N = 5SE +/- 417.77, N = 155029947212515281. (CXX) g++ options: -O3 -lrt

GpuOwl

Exponent: 57885161

OpenBenchmarking.orgIterations / Second, More Is BetterGpuOwl 7.2.1Exponent: 57885161NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI2004006008001000SE +/- 1.26, N = 3SE +/- 0.00, N = 3SE +/- 2.53, N = 3869.07714.80919.13

TensorFlow

Device: GPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: GoogLeNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 315.6715.6615.69

VkFFT

Test: FFT + iFFT C2C Bluestein benchmark in double precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C Bluestein benchmark in double precisionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI10002000300040005000SE +/- 12.55, N = 3SE +/- 4.51, N = 3SE +/- 11.35, N = 34451388646471. (CXX) g++ options: -O3 -lrt

FAHBench

OpenBenchmarking.orgNs Per Day, More Is BetterFAHBench 2.3.2NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI80160240320400SE +/- 0.39, N = 3SE +/- 0.12, N = 3SE +/- 0.26, N = 3366.06317.20382.16

TensorFlow

Device: GPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: AlexNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI816243240SE +/- 0.15, N = 2SE +/- 0.18, N = 3SE +/- 0.04, N = 333.4033.3233.29

VkResample

Upscale: 2x - Precision: Double

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: DoubleNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI90180270360450SE +/- 0.30, N = 3SE +/- 0.77, N = 3SE +/- 0.35, N = 3339.59415.16322.061. (CXX) g++ options: -O3

IndigoBench

Acceleration: OpenCL GPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: BedroomNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 319.8018.2020.26

IndigoBench

Acceleration: OpenCL GPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: SupercarNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1224364860SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 352.8148.5253.59

VkFFT

Test: FFT + iFFT C2C 1D batched in double precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in double precisionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI5K10K15K20K25KSE +/- 146.69, N = 3SE +/- 125.94, N = 3SE +/- 302.46, N = 32431722390254311. (CXX) g++ options: -O3 -lrt

LuxCoreRender

Scene: LuxCore Benchmark - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.8210.9213.23MIN: 4.84 / MAX: 14.62MIN: 4.45 / MAX: 12.42MIN: 5.41 / MAX: 15.13

LuxCoreRender

Scene: DLSC - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 313.5911.7413.95MIN: 12.52 / MAX: 13.84MIN: 11.35 / MAX: 11.83MIN: 13.67 / MAX: 14.14

VkFFT

Test: FFT + iFFT C2C Bluestein in single precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C Bluestein in single precisionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI3K6K9K12K15KSE +/- 102.52, N = 3SE +/- 52.09, N = 3SE +/- 118.41, N = 31516613714151251. (CXX) g++ options: -O3 -lrt

LuxCoreRender

Scene: Orange Juice - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI3691215SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 311.7210.4011.89MIN: 9.6 / MAX: 15.44MIN: 8.31 / MAX: 13.9MIN: 9.85 / MAX: 15.88

LuxCoreRender

Scene: Danish Mood - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Danish Mood - Acceleration: GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI3691215SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 310.568.8910.99MIN: 3.7 / MAX: 12.17MIN: 3.32 / MAX: 10.26MIN: 4.17 / MAX: 12.71

VkFFT

Test: FFT + iFFT R2C / C2R

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT R2C / C2RNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI12K24K36K48K60KSE +/- 702.53, N = 15SE +/- 745.02, N = 13SE +/- 520.37, N = 35479447097554461. (CXX) g++ options: -O3 -lrt

Blender

Blend File: Barbershop - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: NVIDIA OptiXNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1326395265SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 351.3058.4450.73

TensorFlow

Device: GPU - Batch Size: 1 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: VGG-16NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.31050.6210.93151.2421.5525SE +/- 0.01, N = 2SE +/- 0.01, N = 31.351.361.38

VkFFT

Test: FFT + iFFT C2C 1D batched in single precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in single precisionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI17K34K51K68K85KSE +/- 7.94, N = 3SE +/- 13.72, N = 3SE +/- 0.88, N = 37392977774739421. (CXX) g++ options: -O3 -lrt

VkFFT

Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in single precision, no reshufflingNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20K40K60K80K100KSE +/- 37.77, N = 3SE +/- 5.84, N = 3SE +/- 28.54, N = 37507879057751411. (CXX) g++ options: -O3 -lrt

TensorFlow

Device: GPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: AlexNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI714212835SE +/- 0.17, N = 3SE +/- 0.08, N = 331.5931.4531.70

Libplacebo

Test: av1_grain_lap

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: av1_grain_lapNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER9001800270036004500SE +/- 72.31, N = 3SE +/- 35.33, N = 3SE +/- 5.52, N = 34126.404143.964171.001. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: hdr_lut

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: hdr_lutNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER9001800270036004500SE +/- 0.24, N = 3SE +/- 33.96, N = 3SE +/- 12.09, N = 33940.403976.043905.981. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: hdr_peakdetect

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: hdr_peakdetectNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER8001600240032004000SE +/- 144.09, N = 3SE +/- 165.74, N = 3SE +/- 3.65, N = 33452.433475.063292.371. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: polar_nocompute

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: polar_nocomputeNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER5001000150020002500SE +/- 0.29, N = 3SE +/- 1.70, N = 3SE +/- 0.24, N = 31969.192459.032327.551. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: deband_heavy

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: deband_heavyNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 SUPER5001000150020002500SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 2.26, N = 31844.082306.562186.701. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

RealSR-NCNN

Scale: 4x - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: YesNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1020304050SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.03, N = 334.8942.8533.63

VkFFT

Test: FFT + iFFT C2C 1D batched in half precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in half precisionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI30K60K90K120K150KSE +/- 159.17, N = 3SE +/- 1301.92, N = 3SE +/- 1708.38, N = 31317051377621362101. (CXX) g++ options: -O3 -lrt

NAMD CUDA

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD CUDA 2.14ATPase Simulation - 327,506 AtomsNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.01690.03380.05070.06760.0845SE +/- 0.00031, N = 3SE +/- 0.00021, N = 3SE +/- 0.00061, N = 30.067910.074980.06788

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_lNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 6.65, N = 5102.60102.9096.50MIN: 94.84 / MAX: 104.25MIN: 95.98 / MAX: 104.54MIN: 64.35 / MAX: 104.79

Blender

Blend File: Fishy Cat - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: NVIDIA OptiXNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI3691215SE +/- 0.06, N = 13SE +/- 0.03, N = 3SE +/- 0.01, N = 39.4511.039.02

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_lNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 1.49, N = 2SE +/- 0.45, N = 3SE +/- 0.39, N = 2102.60101.55103.20MIN: 79.69 / MAX: 105.28MIN: 93.44 / MAX: 103.08MIN: 95.31 / MAX: 105.27

ViennaCL

Test: CPU BLAS - dGEMM-TT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI306090120150SE +/- 2.08, N = 3SE +/- 1.20, N = 3SE +/- 2.08, N = 31221181241. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-TN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TNNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI306090120150SE +/- 1.00, N = 2SE +/- 2.31, N = 3SE +/- 2.08, N = 31151211251. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-NT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI306090120150SE +/- 2.08, N = 3SE +/- 1.76, N = 3SE +/- 1.20, N = 31171221181. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-NN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NNNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI306090120150SE +/- 4.04, N = 3SE +/- 1.86, N = 3SE +/- 1.15, N = 31191221171. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMV-T

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-TNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 6.30, N = 3109.0109.0102.71. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMV-N

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-NNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 31021031031. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dDOTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.58, N = 396.896.796.41. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dAXPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.12, N = 3SE +/- 0.44, N = 3SE +/- 0.57, N = 387.286.887.31. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dCOPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI1632486480SE +/- 0.32, N = 3SE +/- 0.25, N = 3SE +/- 0.74, N = 370.871.071.31. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sDOTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4080120160200SE +/- 2.73, N = 3SE +/- 3.76, N = 3SE +/- 2.40, N = 31651661681. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sAXPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI306090120150SE +/- 2.19, N = 3SE +/- 4.81, N = 3SE +/- 2.00, N = 31561531561. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sCOPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI306090120150SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 31321311321. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMM-TT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI140280420560700SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 36135026481. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMM-TN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TNNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI140280420560700SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 35994946341. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMM-NT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI130260390520650SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 35844776121. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMM-NN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NNNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI130260390520650SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 35774736041. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMV-T

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-TNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI80160240320400SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 33893873911. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMV-N

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-NNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI50100150200250SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 32102092111. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dDOTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI100200300400500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34584564571. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dAXPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI100200300400500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 34374554371. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dCOPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI90180270360450SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34234234241. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - sDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sDOTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI80160240320400SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33703623651. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - sAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sAXPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI90180270360450SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33923893931. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - sCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sCOPYNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI70140210280350SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 33343303361. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

TensorFlow

Device: GPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.97881.95762.93643.91524.894SE +/- 0.01, N = 3SE +/- 0.02, N = 24.354.344.32

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_lNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.39, N = 3SE +/- 0.36, N = 2103.57101.43103.50MIN: 95.95 / MAX: 105.54MIN: 93.27 / MAX: 103.58MIN: 94.95 / MAX: 105.61

Blender

Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: NVIDIA OptiXNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 314.2916.5513.97

RealSR-NCNN

Scale: 4x - TAA: No

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: NoNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI246810SE +/- 0.150, N = 15SE +/- 0.006, N = 3SE +/- 0.039, N = 36.3237.0925.962

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_lNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.05, N = 2103.17101.24103.24MIN: 95.79 / MAX: 105.15MIN: 93.33 / MAX: 102.92MIN: 95.41 / MAX: 104.9

Blender

Blend File: Classroom - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: NVIDIA OptiXNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 312.6014.8612.30

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4080120160200SE +/- 0.51, N = 3SE +/- 0.34, N = 3SE +/- 0.78, N = 2196.07186.63197.02MIN: 171.95 / MAX: 199.96MIN: 180.51 / MAX: 187.79MIN: 183.92 / MAX: 200.54

Blender

Blend File: BMW27 - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: NVIDIA OptiXNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI246810SE +/- 0.06, N = 13SE +/- 0.01, N = 3SE +/- 0.02, N = 35.576.215.43

ProjectPhysX OpenCL-Benchmark

Operation: Memory Bandwidth Coalesced Write

OpenBenchmarking.orgGB/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: Memory Bandwidth Coalesced WriteNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI100200300400500SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 3455.01459.43457.171. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: Memory Bandwidth Coalesced Read

OpenBenchmarking.orgGB/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: Memory Bandwidth Coalesced ReadNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI100200300400500SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3464.86465.18465.071. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT8 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT8 ComputeNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 314.3112.1215.731. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT16 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT16 ComputeNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 317.1714.2818.281. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT32 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT32 ComputeNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 319.8916.3821.051. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT64 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT64 ComputeNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.99451.9892.98353.9784.9725SE +/- 0.015, N = 3SE +/- 0.004, N = 3SE +/- 0.016, N = 34.2143.4434.4201. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: FP32 Compute

OpenBenchmarking.orgTFLOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: FP32 ComputeNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI918273645SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 338.5931.7740.911. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: FP64 Compute

OpenBenchmarking.orgTFLOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: FP64 ComputeNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.14850.2970.44550.5940.7425SE +/- 0.000, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.6210.5100.6601. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4080120160200SE +/- 1.14, N = 2SE +/- 0.17, N = 3SE +/- 0.19, N = 2194.58187.27195.86MIN: 183.74 / MAX: 198.52MIN: 179.9 / MAX: 188.08MIN: 181.64 / MAX: 199.2

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_lNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.52, N = 2103.68103.45MIN: 96.86 / MAX: 105.56MIN: 95.22 / MAX: 105.88

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4080120160200SE +/- 1.38, N = 2SE +/- 0.05, N = 3195.30187.51194.87MIN: 182 / MAX: 199.43MIN: 181.57 / MAX: 188.05MIN: 180.8 / MAX: 198

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI120240360480600SE +/- 3.09, N = 3SE +/- 11.16, N = 12557.73546.76535.39MIN: 513.63 / MAX: 563.37MIN: 195.25 / MAX: 556.94MIN: 428.43 / MAX: 572.99

VkResample

Upscale: 2x - Precision: Single

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: SingleNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 318.4918.0218.461. (CXX) g++ options: -O3

TensorFlow

Device: GPU - Batch Size: 1 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: GoogLeNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI3691215SE +/- 0.17, N = 2SE +/- 0.10, N = 3SE +/- 0.30, N = 212.6212.7812.79

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4080120160200SE +/- 0.29, N = 3195.40187.26194.29MIN: 186.09 / MAX: 197.7MIN: 179.81 / MAX: 188.21MIN: 182.25 / MAX: 197.39

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_lNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI20406080100SE +/- 0.55, N = 3106.37107.59108.59MIN: 97.91 / MAX: 108.16MIN: 98.77 / MAX: 109.43MIN: 99.04 / MAX: 110.68

TensorFlow

Device: GPU - Batch Size: 1 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: AlexNetNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI48121620SE +/- 0.22, N = 2SE +/- 0.16, N = 3SE +/- 0.06, N = 213.9214.0414.79

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Double-Precision DoubleNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI140280420560700SE +/- 0.98, N = 3SE +/- 0.21, N = 3SE +/- 1.33, N = 3630.11515.17667.051. (CXX) g++ options: -O3

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI110220330440550SE +/- 0.92, N = 3SE +/- 0.27, N = 3SE +/- 1.92, N = 3507.45458.36505.62MIN: 423.41 / MAX: 512.88MIN: 404.89 / MAX: 461.01MIN: 426.6 / MAX: 513.25

LuxCoreRender

Scene: Rainbow Colors and Prism - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Rainbow Colors and Prism - Acceleration: GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI714212835SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 327.6723.2627.71MIN: 24.87 / MAX: 29.03MIN: 20.92 / MAX: 24.3MIN: 25.01 / MAX: 29.15

Hashcat

Benchmark: SHA1

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA1NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI5000M10000M15000M20000M25000MSE +/- 5140363.15, N = 3SE +/- 6318315.53, N = 3SE +/- 15926811.78, N = 3221326000001820246666723532400000

Hashcat

Benchmark: SHA-512

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA-512NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI700M1400M2100M2800M3500MSE +/- 1530068.99, N = 3SE +/- 1059874.21, N = 3SE +/- 721110.26, N = 3323273333326733000003462500000

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4080120160200SE +/- 0.36, N = 3SE +/- 0.73, N = 3201.94198.18201.19MIN: 183.53 / MAX: 206.5MIN: 181.27 / MAX: 200.06MIN: 180.79 / MAX: 203.92

Hashcat

Benchmark: MD5

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: MD5NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI16000M32000M48000M64000M80000MSE +/- 22430807.19, N = 3SE +/- 33772046.30, N = 3SE +/- 11283665.68, N = 3675830333335614786666773312233333

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI110220330440550SE +/- 0.26, N = 3SE +/- 2.23, N = 3509.45458.39502.92MIN: 430.1 / MAX: 516.48MIN: 404.5 / MAX: 461.01MIN: 415.65 / MAX: 520.39

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4080120160200195.39187.69198.82MIN: 183.94 / MAX: 198.7MIN: 182.03 / MAX: 188.31MIN: 188.33 / MAX: 201.47

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070110220330440550SE +/- 1.39, N = 3SE +/- 0.34, N = 3504.67459.93MIN: 412.34 / MAX: 514.07MIN: 403.65 / MAX: 462.74

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI110220330440550SE +/- 2.17, N = 2SE +/- 0.13, N = 2SE +/- 1.69, N = 3501.50459.94505.55MIN: 415.94 / MAX: 510.69MIN: 403.65 / MAX: 462.59MIN: 419.93 / MAX: 512.69

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50NVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI110220330440550SE +/- 4.43, N = 2SE +/- 0.43, N = 2SE +/- 0.83, N = 2504.27459.27504.66MIN: 418.22 / MAX: 512.44MIN: 405.48 / MAX: 461.88MIN: 424.27 / MAX: 509.08

Hashcat

Benchmark: TrueCrypt RIPEMD160 + XTS

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: TrueCrypt RIPEMD160 + XTSNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI200K400K600K800K1000KSE +/- 633.33, N = 3SE +/- 176.38, N = 3SE +/- 888.82, N = 3802967660967858600

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI70140210280350SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3331.8330.3333.31. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: ReadNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI100200300400500SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3446.2446.3446.31. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: WriteNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI90180270360450SE +/- 1.11, N = 3SE +/- 0.55, N = 3SE +/- 0.12, N = 3407.5406.7412.21. (CC) gcc options: -O2 -flto -lOpenCL

Rodinia

Test: OpenCL Particle Filter

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenCL Particle FilterNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.92211.84422.76633.68844.6105SE +/- 0.039, N = 4SE +/- 0.008, N = 3SE +/- 0.002, N = 33.4804.0983.2911. (CXX) g++ options: -O2 -lOpenCL

Hashcat

Benchmark: 7-Zip

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: 7-ZipNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI300K600K900K1200K1500KSE +/- 1991.93, N = 3SE +/- 2062.63, N = 3SE +/- 2339.04, N = 311764679769671262633

Waifu2x-NCNN Vulkan

Scale: 2x - Denoise: 3 - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818Scale: 2x - Denoise: 3 - TAA: YesNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI0.71281.42562.13842.85123.564SE +/- 0.014, N = 3SE +/- 0.028, N = 3SE +/- 0.009, N = 32.8553.1682.854

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS, More Is Betterclpeak 1.1.2OpenCL Test: Global Memory BandwidthNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI90180270360450SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3437.65437.21437.631. (CXX) g++ options: -O3

MandelGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec, More Is BetterMandelGPU 1.3pts1OpenCL Device: GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI130M260M390M520M650MSE +/- 467034.80, N = 3SE +/- 1783157.89, N = 3SE +/- 1202791.77, N = 3587219538.2516770131.2619106132.51. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL

FinanceBench

Benchmark: Black-Scholes OpenCL

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Black-Scholes OpenCLNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI246810SE +/- 0.114, N = 15SE +/- 0.003, N = 3SE +/- 0.003, N = 35.9126.9065.2261. (CXX) g++ options: -O3 -march=native -fopenmp

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS, More Is Betterclpeak 1.1.2OpenCL Test: Integer Compute INTNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI4K8K12K16K20KSE +/- 3.14, N = 3SE +/- 15.26, N = 3SE +/- 2.50, N = 318170.5414555.1919821.101. (CXX) g++ options: -O3

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Single-Precision FloatNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI8K16K24K32K40KSE +/- 0.99, N = 3SE +/- 5.46, N = 3SE +/- 11.67, N = 335492.6928479.3938691.731. (CXX) g++ options: -O3

NeatBench

Acceleration: GPU

OpenBenchmarking.orgFPS, More Is BetterNeatBench 5Acceleration: GPUNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TI9001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3407040704070


Phoronix Test Suite v10.8.5