RTX 4070 SUPER

Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1630 BIOS) and ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB on EndeavourOS rolling via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2402174-SADD-240211636
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 3 Tests
C++ Boost Tests 2 Tests
CPU Massive 5 Tests
Creator Workloads 4 Tests
HPC - High Performance Computing 8 Tests
Machine Learning 6 Tests
Multi-Core 6 Tests
NVIDIA GPU Compute 25 Tests
OpenCL 5 Tests
Python Tests 5 Tests
Renderers 3 Tests
Server CPU Tests 2 Tests
Vulkan Compute 7 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
NVIDIA RTX 4070 SUPER
January 25
  23 Hours, 51 Minutes
NVIDIA RTX 4070
January 28
  22 Hours, 26 Minutes
NVIDIA RTX 4070 TI
January 29
  1 Day, 7 Hours, 18 Minutes
NVIDIA RTX 3090
February 07
  1 Day, 10 Hours, 51 Minutes
NVIDIA RTX 4070 TI SUPER
February 15
  1 Day, 17 Hours, 21 Minutes
Invert Hiding All Results Option
  1 Day, 6 Hours, 46 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

RTX 4070 SUPER - Phoronix Test Suite

RTX 4070 SUPER

Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1630 BIOS) and ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB on EndeavourOS rolling via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2402174-SADD-240211636&grr&sro.

RTX 4070 SUPERProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLCompilerFile-SystemScreen ResolutionNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 3090NVIDIA RTX 4070 TI SUPERIntel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads)ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS)Intel Device 7a2732GB4001GB Seagate ZP4000GP304001ASUS NVIDIA GeForce RTX 4070 SUPER 12GBRealtek ALC1220ARZOPAIntel I226-V + Intel Device 7a70EndeavourOS rolling6.7.1-arch1-1 (x86_64)KDE Plasma 5.27.10X Server 1.21.1.11NVIDIA 550.40.074.6.0OpenCL 3.0 CUDA 12.4.74GCC 13.2.1 20230801ext41920x1080MSI NVIDIA GeForce RTX 4070 12GBGCC 13.2.1 20230801 + CUDA 12.3NVIDIA GeForce RTX 4070 Ti 12GBNVIDIA GeForce RTX 3090 24GBPI-KVM Video6.7.4-arch1-1 (x86_64)ASUS TUF GAMING Z790-PRO WIFI (1630 BIOS)Intel Raptor Lake-S PCH4001GB Seagate ZP4000GP304001 + 0GB CD-ROM DriveASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GBIntel I226-V + Intel Raptor Lake-S PCH CNVi WiFiOpenCL 2.1 AMD-APP (3602.0) + OpenCL 3.0 CUDA 12.4.74OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- NVIDIA RTX 4070 SUPER: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - NVIDIA RTX 4070: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - NVIDIA RTX 4070 TI: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - NVIDIA RTX 3090: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - NVIDIA RTX 4070 TI SUPER: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details- NVIDIA RTX 4070 SUPER: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11d- NVIDIA RTX 4070: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11d- NVIDIA RTX 4070 TI: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11d- NVIDIA RTX 3090: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11d- NVIDIA RTX 4070 TI SUPER: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11fGraphics Details- NVIDIA RTX 4070 SUPER: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1- NVIDIA RTX 4070: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2a- NVIDIA RTX 4070 TI: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.31.00.36- NVIDIA RTX 3090: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 94.02.26.08.ba- NVIDIA RTX 4070 TI SUPER: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 95.03.45.00.c5Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected Environment Details- NVIDIA RTX 4070, NVIDIA RTX 4070 TI, NVIDIA RTX 3090, NVIDIA RTX 4070 TI SUPER: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Python Details- NVIDIA RTX 4070: Python 3.11.6- NVIDIA RTX 4070 TI: Python 3.11.6- NVIDIA RTX 3090: Python 3.11.6- NVIDIA RTX 4070 TI SUPER: Python 3.11.7

RTX 4070 SUPERtensorflow: GPU - 256 - VGG-16tensorflow: GPU - 64 - VGG-16tensorflow: GPU - 32 - VGG-16tensorflow: GPU - 512 - AlexNettensorflow: GPU - 64 - ResNet-50tensorflow: GPU - 16 - VGG-16tensorflow: GPU - 256 - AlexNettensorflow: GPU - 32 - ResNet-50ncnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU - googlenetncnn: Vulkan GPU - blazefacencnn: Vulkan GPU-v3-v3 - mobilenet-v3tensorflow: GPU - 64 - GoogLeNettensorflow: GPU - 16 - ResNet-50vkpeak: int16-vec4vkpeak: int16-scalarvkpeak: int32-vec4vkpeak: int32-scalarvkpeak: fp64-vec4vkpeak: fp64-scalarvkpeak: fp16-vec4vkpeak: fp16-scalarvkpeak: fp32-vec4vkpeak: fp32-scalartensorflow: GPU - 32 - GoogLeNettensorflow: GPU - 64 - AlexNetgpuowl: 77936867gpuowl: 332220523octanebench: Total Scoregpuowl: 57885161tensorflow: GPU - 16 - GoogLeNetvkfft: FFT + iFFT C2C multidimensional in single precisionvkfft: FFT + iFFT C2C Bluestein benchmark in double precisionluxcorerender: DLSC - GPUtensorflow: GPU - 32 - AlexNetfahbench: vkresample: 2x - Doubleindigobench: OpenCL GPU - Bedroomvkfft: FFT + iFFT C2C 1D batched in double precisionindigobench: OpenCL GPU - Supercarluxcorerender: Orange Juice - GPUtensorflow: GPU - 1 - VGG-16luxcorerender: LuxCore Benchmark - GPUvkfft: FFT + iFFT C2C Bluestein in single precisionluxcorerender: Danish Mood - GPUvkfft: FFT + iFFT R2C / C2Rblender: Barbershop - NVIDIA OptiXvkfft: FFT + iFFT C2C 1D batched in single precisionvkfft: FFT + iFFT C2C 1D batched in single precision, no reshufflingtensorflow: GPU - 16 - AlexNetvkfft: FFT + iFFT C2C 1D batched in half precisionlibplacebo: av1_grain_laplibplacebo: hdr_lutlibplacebo: hdr_peakdetectlibplacebo: polar_nocomputelibplacebo: deband_heavyrealsr-ncnn: 4x - Yesblender: Fishy Cat - NVIDIA OptiXtensorflow: GPU - 1 - AlexNetpytorch: NVIDIA CUDA GPU - 32 - Efficientnet_v2_lnamd-cuda: ATPase Simulation - 327,506 Atomstensorflow: GPU - 1 - ResNet-50pytorch: NVIDIA CUDA GPU - 64 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 512 - Efficientnet_v2_lviennacl: CPU BLAS - dGEMM-TTviennacl: CPU BLAS - dGEMM-TNviennacl: CPU BLAS - dGEMM-NTviennacl: CPU BLAS - dGEMM-NNviennacl: CPU BLAS - dGEMV-Tviennacl: CPU BLAS - dGEMV-Nviennacl: CPU BLAS - dDOTviennacl: CPU BLAS - dAXPYviennacl: CPU BLAS - dCOPYviennacl: CPU BLAS - sDOTviennacl: CPU BLAS - sAXPYviennacl: CPU BLAS - sCOPYpytorch: NVIDIA CUDA GPU - 256 - Efficientnet_v2_lviennacl: OpenCL BLAS - dGEMM-TTviennacl: OpenCL BLAS - dGEMM-TNviennacl: OpenCL BLAS - dGEMM-NTviennacl: OpenCL BLAS - dGEMM-NNviennacl: OpenCL BLAS - dGEMV-Tviennacl: OpenCL BLAS - dGEMV-Nviennacl: OpenCL BLAS - dDOTviennacl: OpenCL BLAS - dAXPYviennacl: OpenCL BLAS - dCOPYviennacl: OpenCL BLAS - sDOTviennacl: OpenCL BLAS - sAXPYviennacl: OpenCL BLAS - sCOPYblender: BMW27 - NVIDIA OptiXpytorch: NVIDIA CUDA GPU - 16 - Efficientnet_v2_lblender: Pabellon Barcelona - NVIDIA OptiXblender: Classroom - NVIDIA OptiXopencl-benchmark: Memory Bandwidth Coalesced Writeopencl-benchmark: Memory Bandwidth Coalesced Readopencl-benchmark: INT8 Computeopencl-benchmark: INT16 Computeopencl-benchmark: INT32 Computeopencl-benchmark: INT64 Computeopencl-benchmark: FP32 Computeopencl-benchmark: FP64 Computepytorch: NVIDIA CUDA GPU - 512 - ResNet-152pytorch: NVIDIA CUDA GPU - 64 - ResNet-152pytorch: NVIDIA CUDA GPU - 256 - ResNet-152realsr-ncnn: 4x - Nopytorch: NVIDIA CUDA GPU - 32 - ResNet-152pytorch: NVIDIA CUDA GPU - 1 - Efficientnet_v2_ltensorflow: GPU - 1 - GoogLeNetpytorch: NVIDIA CUDA GPU - 16 - ResNet-152vkresample: 2x - Singleclpeak: Double-Precision Doubleluxcorerender: Rainbow Colors and Prism - GPUpytorch: NVIDIA CUDA GPU - 64 - ResNet-50pytorch: NVIDIA CUDA GPU - 1 - ResNet-50hashcat: MD5hashcat: SHA1hashcat: SHA-512pytorch: NVIDIA CUDA GPU - 1 - ResNet-152pytorch: NVIDIA CUDA GPU - 256 - ResNet-50rodinia: OpenCL Particle Filterpytorch: NVIDIA CUDA GPU - 16 - ResNet-50pytorch: NVIDIA CUDA GPU - 512 - ResNet-50pytorch: NVIDIA CUDA GPU - 32 - ResNet-50hashcat: TrueCrypt RIPEMD160 + XTScl-mem: Copycl-mem: Writecl-mem: Readhashcat: 7-Zipwaifu2x-ncnn: 2x - 3 - Yesclpeak: Global Memory Bandwidthmandelgpu: GPUfinancebench: Black-Scholes OpenCLneatbench: GPUclpeak: Integer Compute INTclpeak: Single-Precision Floatarrayfire: Conjugate Gradient OpenCLNVIDIA RTX 4070 SUPERNVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER1.5035.105.551.4834.165.512.86844.6111.116.8663.8246.2616.178.97117.815.073.852.313.038.6211.040.842.2515.525.4615.6133.97646.41137.44720.973789869.0715.6750299445113.5933.4366.0576339.59319.8012431752.81311.721.3512.821516610.565479451.30739297507831.591317054171.003905.983292.372327.552186.7034.8859.4513.92102.600.067914.35102.60103.5712211511711910910296.887.270.8165156132103.176135995845773892104584374233703923345.5714.2912.60455.01464.8614.30717.17019.8894.21438.5940.621195.30196.07194.586.323195.39106.3712.62195.4018.489630.1127.67507.45557.7367583033333221326000003232733333201.94504.673.480509.45504.27501.50802967331.8407.5446.211764672.855437.65587219538.25.912407018170.5435492.691.501.535.215.551.505.552.67382.826.215.1820.748.725.785.1145.523.592.242.082.487.206.060.842.1515.545.4915.6333.93530.32112.61647.997867714.8015.6647212388611.7433.32317.1952415.16018.2032239048.51710.401.3610.92137148.894709758.44777747905731.451377624152.413946.903329.261968.371843.2642.85211.0314.04102.900.074984.34101.55101.4311812112212210910396.786.871.0166153131101.245024944774733872094564554233623893306.21103.6816.5514.86459.43465.1812.11614.28416.3773.44331.7680.510187.51186.63187.277.092187.69107.5912.78187.2618.016515.1723.26458.36546.7656147866667182024666672673300000198.18459.934.098458.39459.27459.94660967330.3406.7446.39769673.168437.21516770131.26.906407014555.1928479.391.51.51.535.445.531.4934.615.503.04497.665.896.1316.3712.256.077.7434.493.464.142.012.547.457.370.822.0915.505.4615.8134.06676.59145.84735.940593919.1315.6951528464713.9533.29382.1637322.06420.2562543153.58911.891.3813.231512510.995544650.73739427514131.701362104143.963976.043475.062459.032306.5633.6269.0214.7996.500.067884.32103.20103.50124125118117102.710396.487.371.3168156132103.246486346126043912114574374243653933365.43103.4513.9712.30457.17465.0715.73118.28121.0474.42040.9140.660194.87197.02195.865.962198.82108.5912.79194.2918.456667.0527.71505.62535.3973312233333235324000003462500000201.193.291502.92504.66505.55858600333.3412.2446.312626332.854437.63619106132.55.226407019821.1038691.731.511.511.535.585.571.4934.465.572.65354.576.734.9011.2912.703.604.1217.883.342.162.042.347.276.140.872.2115.635.4916329.7213264.9120009.7320295.27638.74638.8439860.8020151.4426699.6620353.9515.6733.93645.99137.32674.250912866.3115.6850856419512.9933.53343.0199333.63920.9593091252.01412.141.3813.121420510.204841854.3014187614431131.982732214100.363369.885055.882116.792020.1630.31310.6414.4599.050.108224.3599.8499.2511312111911311010395.286.270.2132.115413299.435935945955923741876597246053764983636.3198.1117.3015.26887.31864.1113.72717.00120.0273.13539.3950.637164.35164.14161.015.556163.74105.5512.82164.1410.323642.2333.29419.03525.1267177300000213237333333081866667197.12416.893.844419.76416.20420.29797833360.8753.8825.810560003.202816.55484098913.85.741309017923.3334906.791.471.461.4635.025.331.4533.955.352.55312.106.595.1917.208.794.417.5824.853.482.262.132.707.486.460.882.1615.005.3221156.9915901.3223768.2723888.02750.68750.4947340.5223894.7031635.4723920.6715.1133.55761.61163.41876.4369941025.9915.2959790504716.2332.88394.7356285.98824.5702794761.33813.641.3214.611614112.425937844.4910400310554931.101439924044.723822.163913.342653.032495.9230.7248.3212.26102.830.077154.14103.49103.5311712011912282.678.570.864.352.7129120107102.837317146896814242185755855124104693735.04103.6612.5611.20608.94619.0317.61520.50323.6604.41445.9500.743198.01196.50198.705.633197.82105.8612.24198.5813.363750.3631.86527.82558.8282004966667263886000003887033333200.46529.142.973531.96529.49532.77961733370.7551.9595.214207002.660582.84656484783.70.5012084.122171.2543244.79OpenBenchmarking.org

TensorFlow

Device: GPU - Batch Size: 256 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 256 - Model: VGG-16NVIDIA RTX 3090NVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.33980.67961.01941.35921.699SE +/- 0.00, N = 3SE +/- 0.00, N = 31.511.501.47

TensorFlow

Device: GPU - Batch Size: 64 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: VGG-16NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.33980.67961.01941.35921.699SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.511.501.501.46

TensorFlow

Device: GPU - Batch Size: 32 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: VGG-16NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.33750.6751.01251.351.6875SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 2SE +/- 0.00, N = 31.501.501.501.501.46

TensorFlow

Device: GPU - Batch Size: 512 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 512 - Model: AlexNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER816243240SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 2SE +/- 0.09, N = 2SE +/- 0.01, N = 335.5835.2135.1035.4435.02

TensorFlow

Device: GPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1.25332.50663.75995.01326.2665SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 2SE +/- 0.01, N = 2SE +/- 0.02, N = 35.575.555.555.535.33

TensorFlow

Device: GPU - Batch Size: 16 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: VGG-16NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.33750.6751.01251.351.6875SE +/- 0.00, N = 3SE +/- 0.01, N = 2SE +/- 0.00, N = 2SE +/- 0.00, N = 31.491.501.481.491.45

TensorFlow

Device: GPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 256 - Model: AlexNetNVIDIA RTX 3090NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER816243240SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 2SE +/- 0.05, N = 334.4634.1634.6133.95

TensorFlow

Device: GPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1.25332.50663.75995.01326.2665SE +/- 0.01, N = 3SE +/- 0.01, N = 2SE +/- 0.01, N = 2SE +/- 0.02, N = 3SE +/- 0.00, N = 35.575.555.515.505.35

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER246810SE +/- 0.08, N = 8SE +/- 0.10, N = 9SE +/- 0.29, N = 9SE +/- 0.12, N = 8SE +/- 0.26, N = 32.502.342.862.842.54MIN: 2.1 / MAX: 32.36MIN: 2 / MAX: 3.86MIN: 2.17 / MAX: 577.17MIN: 2.4 / MAX: 5.07MIN: 2.14 / MAX: 4.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER2004006008001000SE +/- 52.80, N = 9SE +/- 61.31, N = 9SE +/- 87.53, N = 9SE +/- 25.65, N = 9SE +/- 57.46, N = 12327.82281.56844.61390.18312.10MIN: 46.48 / MAX: 1816.93MIN: 46.48 / MAX: 1913.33MIN: 46.34 / MAX: 1866.93MIN: 46.49 / MAX: 1816.77MIN: 47.85 / MAX: 1850.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER3691215SE +/- 0.32, N = 8SE +/- 0.24, N = 12SE +/- 3.28, N = 9SE +/- 0.18, N = 12SE +/- 0.26, N = 126.476.2111.115.896.59MIN: 5.44 / MAX: 9.3MIN: 5.53 / MAX: 8.99MIN: 5.49 / MAX: 4942.19MIN: 5.42 / MAX: 7.57MIN: 5.45 / MAX: 9.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER246810SE +/- 0.19, N = 3SE +/- 0.12, N = 12SE +/- 1.76, N = 9SE +/- 0.29, N = 9SE +/- 0.54, N = 34.905.186.865.365.11MIN: 4.47 / MAX: 5.27MIN: 4.67 / MAX: 6.88MIN: 4.34 / MAX: 1630.01MIN: 4.55 / MAX: 496.3MIN: 4.43 / MAX: 8.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1428425670SE +/- 0.21, N = 3SE +/- 5.37, N = 12SE +/- 10.56, N = 9SE +/- 3.10, N = 12SE +/- 3.14, N = 311.2920.7463.8216.3714.26MIN: 10.82 / MAX: 11.93MIN: 10.3 / MAX: 854.36MIN: 10.28 / MAX: 858.44MIN: 10.57 / MAX: 855.36MIN: 10.89 / MAX: 673.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1020304050SE +/- 0.12, N = 9SE +/- 0.10, N = 9SE +/- 14.70, N = 9SE +/- 4.00, N = 12SE +/- 0.22, N = 38.208.2446.2612.258.58MIN: 7.69 / MAX: 11.69MIN: 7.87 / MAX: 9.87MIN: 7.71 / MAX: 1829.99MIN: 8 / MAX: 1777.17MIN: 8.2 / MAX: 11.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.09, N = 3SE +/- 1.70, N = 12SE +/- 5.86, N = 9SE +/- 0.03, N = 9SE +/- 0.03, N = 33.605.7816.173.744.38MIN: 3.44 / MAX: 3.79MIN: 3.6 / MAX: 397.75MIN: 3.52 / MAX: 436.52MIN: 3.61 / MAX: 3.98MIN: 4.29 / MAX: 6.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.07, N = 3SE +/- 0.73, N = 12SE +/- 3.49, N = 9SE +/- 1.33, N = 9SE +/- 0.08, N = 34.125.118.975.474.64MIN: 3.97 / MAX: 4.51MIN: 3.99 / MAX: 916.69MIN: 3.94 / MAX: 922.04MIN: 3.95 / MAX: 726.67MIN: 4.46 / MAX: 7.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER306090120150SE +/- 0.25, N = 3SE +/- 13.24, N = 12SE +/- 29.60, N = 9SE +/- 11.81, N = 9SE +/- 0.19, N = 317.8845.52117.8132.0521.76MIN: 17.3 / MAX: 18.57MIN: 17.49 / MAX: 643.35MIN: 17.16 / MAX: 647.67MIN: 17.34 / MAX: 644.35MIN: 21.34 / MAX: 23.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.17, N = 3SE +/- 0.09, N = 9SE +/- 0.97, N = 9SE +/- 0.07, N = 12SE +/- 0.07, N = 33.343.465.073.463.36MIN: 3.14 / MAX: 4MIN: 2.91 / MAX: 3.79MIN: 3.22 / MAX: 1124.2MIN: 3.13 / MAX: 7.03MIN: 3.21 / MAX: 3.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.93151.8632.79453.7264.6575SE +/- 0.14, N = 3SE +/- 0.08, N = 8SE +/- 1.31, N = 9SE +/- 0.05, N = 9SE +/- 0.13, N = 32.162.223.852.302.21MIN: 2.01 / MAX: 2.55MIN: 1.83 / MAX: 2.54MIN: 1.89 / MAX: 1093.29MIN: 2.15 / MAX: 2.58MIN: 2.01 / MAX: 3.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.93831.87662.81493.75324.6915SE +/- 0.21, N = 3SE +/- 0.09, N = 11SE +/- 0.34, N = 8SE +/- 0.08, N = 12SE +/- 0.19, N = 32.042.082.312.012.05MIN: 1.8 / MAX: 5.8MIN: 1.82 / MAX: 2.59MIN: 1.76 / MAX: 421.42MIN: 1.73 / MAX: 3.86MIN: 1.83 / MAX: 6.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1.05532.11063.16594.22125.2765SE +/- 0.15, N = 3SE +/- 0.07, N = 12SE +/- 0.44, N = 9SE +/- 0.07, N = 9SE +/- 0.09, N = 32.342.483.032.432.42MIN: 2.04 / MAX: 2.63MIN: 2.02 / MAX: 5.82MIN: 2.38 / MAX: 970.87MIN: 2.09 / MAX: 5.8MIN: 2.24 / MAX: 9.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER3691215SE +/- 0.22, N = 9SE +/- 0.21, N = 12SE +/- 0.47, N = 9SE +/- 0.25, N = 12SE +/- 0.05, N = 36.927.208.627.456.28MIN: 6.06 / MAX: 8.65MIN: 6.2 / MAX: 11.13MIN: 6.42 / MAX: 1101.3MIN: 6.87 / MAX: 734.65MIN: 6.16 / MAX: 8.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER3691215SE +/- 0.18, N = 9SE +/- 0.14, N = 9SE +/- 1.21, N = 9SE +/- 0.14, N = 9SE +/- 0.24, N = 36.116.0611.045.876.25MIN: 5.25 / MAX: 9.16MIN: 5.33 / MAX: 8.36MIN: 5.28 / MAX: 1769.19MIN: 5.2 / MAX: 6.88MIN: 5.84 / MAX: 6.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.1980.3960.5940.7920.99SE +/- 0.03, N = 9SE +/- 0.03, N = 9SE +/- 0.04, N = 9SE +/- 0.03, N = 9SE +/- 0.05, N = 30.840.840.840.810.86MIN: 0.63 / MAX: 1.13MIN: 0.64 / MAX: 0.96MIN: 0.65 / MAX: 4.63MIN: 0.61 / MAX: 1.19MIN: 0.75 / MAX: 2.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER246810SE +/- 0.09, N = 9SE +/- 0.08, N = 12SE +/- 0.16, N = 9SE +/- 0.09, N = 9SE +/- 0.02, N = 32.202.152.252.091.87MIN: 1.91 / MAX: 2.71MIN: 1.81 / MAX: 2.58MIN: 1.75 / MAX: 343.7MIN: 1.78 / MAX: 2.85MIN: 1.81 / MAX: 5.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TensorFlow

Device: GPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: GoogLeNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 2SE +/- 0.09, N = 315.6315.5415.5215.5015.00

TensorFlow

Device: GPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1.23532.47063.70594.94126.1765SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 2SE +/- 0.01, N = 3SE +/- 0.02, N = 35.495.495.465.465.32

vkpeak

int16-vec4

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int16-vec4NVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER5K10K15K20K25KSE +/- 28.77, N = 3SE +/- 3.02, N = 316302.5821124.09

vkpeak

int16-scalar

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int16-scalarNVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER3K6K9K12K15KSE +/- 23.55, N = 3SE +/- 22.68, N = 313225.1715859.37

vkpeak

int32-vec4

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int32-vec4NVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER5K10K15K20K25KSE +/- 2.34, N = 3SE +/- 34.76, N = 319996.9223733.30

vkpeak

int32-scalar

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int32-scalarNVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER5K10K15K20K25KSE +/- 3.21, N = 3SE +/- 0.36, N = 320280.3323874.85

vkpeak

fp64-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp64-vec4NVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER160320480640800SE +/- 0.02, N = 3SE +/- 0.00, N = 3638.72749.76

vkpeak

fp64-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp64-scalarNVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER160320480640800SE +/- 0.03, N = 3SE +/- 0.01, N = 3638.70750.47

vkpeak

fp16-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp16-vec4NVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER10K20K30K40K50KSE +/- 75.11, N = 3SE +/- 76.15, N = 339746.9147192.56

vkpeak

fp16-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp16-scalarNVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER5K10K15K20K25KSE +/- 34.71, N = 3SE +/- 34.93, N = 320080.4723825.05

vkpeak

fp32-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp32-vec4NVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER7K14K21K28K35KSE +/- 1.51, N = 3SE +/- 43.84, N = 326563.7231591.71

vkpeak

fp32-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp32-scalarNVIDIA RTX 3090NVIDIA RTX 4070 TI SUPER5K10K15K20K25KSE +/- 36.15, N = 3SE +/- 38.13, N = 320263.1323883.53

TensorFlow

Device: GPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: GoogLeNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 2SE +/- 0.03, N = 3SE +/- 0.06, N = 315.6715.6315.6115.8115.11

TensorFlow

Device: GPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 64 - Model: AlexNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER816243240SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 333.9333.9333.9734.0633.55

GpuOwl

Exponent: 77936867

OpenBenchmarking.orgIterations / Second, More Is BetterGpuOwl 7.2.1Exponent: 77936867NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER160320480640800SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3645.99530.32646.41676.59761.61

GpuOwl

Exponent: 332220523

OpenBenchmarking.orgIterations / Second, More Is BetterGpuOwl 7.2.1Exponent: 332220523NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3137.32112.61137.44145.84163.41

OctaneBench

Total Score

OpenBenchmarking.orgScore, More Is BetterOctaneBench 2020.1Total ScoreNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER2004006008001000674.25648.00720.97735.94876.44

GpuOwl

Exponent: 57885161

OpenBenchmarking.orgIterations / Second, More Is BetterGpuOwl 7.2.1Exponent: 57885161NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER2004006008001000SE +/- 2.01, N = 3SE +/- 0.00, N = 3SE +/- 1.26, N = 3SE +/- 2.53, N = 3SE +/- 0.35, N = 3866.31714.80869.07919.131025.99

TensorFlow

Device: GPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: GoogLeNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 315.6815.6615.6715.6915.29

VkFFT

Test: FFT + iFFT C2C multidimensional in single precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C multidimensional in single precisionNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER13K26K39K52K65KSE +/- 407.28, N = 15SE +/- 476.57, N = 5SE +/- 407.19, N = 15SE +/- 417.77, N = 15SE +/- 251.10, N = 350856472125029951528597901. (CXX) g++ options: -O3 -lrt

VkFFT

Test: FFT + iFFT C2C Bluestein benchmark in double precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C Bluestein benchmark in double precisionNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER11002200330044005500SE +/- 9.84, N = 3SE +/- 4.51, N = 3SE +/- 12.55, N = 3SE +/- 11.35, N = 3SE +/- 11.37, N = 3419538864451464750471. (CXX) g++ options: -O3 -lrt

LuxCoreRender

Scene: DLSC - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: GPUNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 1.13, N = 12SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 312.9911.7413.5913.9516.23MIN: 0.52 / MAX: 14.69MIN: 11.35 / MAX: 11.83MIN: 12.52 / MAX: 13.84MIN: 13.67 / MAX: 14.14MIN: 15.91 / MAX: 16.36

TensorFlow

Device: GPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 32 - Model: AlexNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER816243240SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 2SE +/- 0.04, N = 3SE +/- 0.19, N = 333.5333.3233.4033.2932.88

FAHBench

OpenBenchmarking.orgNs Per Day, More Is BetterFAHBench 2.3.2NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER90180270360450SE +/- 0.26, N = 3SE +/- 0.12, N = 3SE +/- 0.39, N = 3SE +/- 0.26, N = 3SE +/- 0.22, N = 3343.02317.20366.06382.16394.74

VkResample

Upscale: 2x - Precision: Double

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: DoubleNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER90180270360450SE +/- 0.30, N = 3SE +/- 0.77, N = 3SE +/- 0.30, N = 3SE +/- 0.35, N = 3SE +/- 0.02, N = 3333.64415.16339.59322.06285.991. (CXX) g++ options: -O3

IndigoBench

Acceleration: OpenCL GPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: BedroomNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 320.9618.2019.8020.2624.57

VkFFT

Test: FFT + iFFT C2C 1D batched in double precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in double precisionNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER7K14K21K28K35KSE +/- 50.66, N = 3SE +/- 125.94, N = 3SE +/- 146.69, N = 3SE +/- 302.46, N = 3SE +/- 325.03, N = 330912223902431725431279471. (CXX) g++ options: -O3 -lrt

IndigoBench

Acceleration: OpenCL GPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: SupercarNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1428425670SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 352.0148.5252.8153.5961.34

LuxCoreRender

Scene: Orange Juice - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: GPUNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.15, N = 412.1410.4011.7211.8913.64MIN: 10.24 / MAX: 16.71MIN: 8.31 / MAX: 13.9MIN: 9.6 / MAX: 15.44MIN: 9.85 / MAX: 15.88MIN: 11.16 / MAX: 18.46

TensorFlow

Device: GPU - Batch Size: 1 - Model: VGG-16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: VGG-16NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.31050.6210.93151.2421.5525SE +/- 0.01, N = 3SE +/- 0.01, N = 2SE +/- 0.01, N = 3SE +/- 0.00, N = 31.381.361.351.381.32

LuxCoreRender

Scene: LuxCore Benchmark - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: GPUNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.03, N = 2SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 313.1210.9212.8213.2314.61MIN: 4.85 / MAX: 15.21MIN: 4.45 / MAX: 12.42MIN: 4.84 / MAX: 14.62MIN: 5.41 / MAX: 15.13MIN: 5.91 / MAX: 16.88

VkFFT

Test: FFT + iFFT C2C Bluestein in single precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C Bluestein in single precisionNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER3K6K9K12K15KSE +/- 115.62, N = 3SE +/- 52.09, N = 3SE +/- 102.52, N = 3SE +/- 118.41, N = 3SE +/- 73.00, N = 314205137141516615125161411. (CXX) g++ options: -O3 -lrt

LuxCoreRender

Scene: Danish Mood - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Danish Mood - Acceleration: GPUNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER3691215SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 310.208.8910.5610.9912.42MIN: 4.07 / MAX: 11.93MIN: 3.32 / MAX: 10.26MIN: 3.7 / MAX: 12.17MIN: 4.17 / MAX: 12.71MIN: 4.35 / MAX: 14.32

VkFFT

Test: FFT + iFFT R2C / C2R

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT R2C / C2RNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER13K26K39K52K65KSE +/- 320.62, N = 3SE +/- 745.02, N = 13SE +/- 702.53, N = 15SE +/- 520.37, N = 3SE +/- 772.47, N = 1548418470975479455446593781. (CXX) g++ options: -O3 -lrt

Blender

Blend File: Barbershop - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: NVIDIA OptiXNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1326395265SE +/- 0.02, N = 2SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 354.3058.4451.3050.7344.49

VkFFT

Test: FFT + iFFT C2C 1D batched in single precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in single precisionNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER30K60K90K120K150KSE +/- 9.64, N = 3SE +/- 13.72, N = 3SE +/- 7.94, N = 3SE +/- 0.88, N = 3SE +/- 33.60, N = 31418767777473929739421040031. (CXX) g++ options: -O3 -lrt

VkFFT

Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in single precision, no reshufflingNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER30K60K90K120K150KSE +/- 37.44, N = 3SE +/- 5.84, N = 3SE +/- 37.77, N = 3SE +/- 28.54, N = 3SE +/- 20.80, N = 31443117905775078751411055491. (CXX) g++ options: -O3 -lrt

TensorFlow

Device: GPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 16 - Model: AlexNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER714212835SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 331.9831.4531.5931.7031.10

VkFFT

Test: FFT + iFFT C2C 1D batched in half precision

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.2.31Test: FFT + iFFT C2C 1D batched in half precisionNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER60K120K180K240K300KSE +/- 160.60, N = 3SE +/- 1301.92, N = 3SE +/- 159.17, N = 3SE +/- 1708.38, N = 3SE +/- 3524.05, N = 122732211377621317051362101439921. (CXX) g++ options: -O3 -lrt

Libplacebo

Test: av1_grain_lap

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: av1_grain_lapNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER9001800270036004500SE +/- 42.82, N = 3SE +/- 66.69, N = 3SE +/- 5.52, N = 3SE +/- 21.66, N = 3SE +/- 48.74, N = 34096.484103.404171.004140.874044.721. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: hdr_lut

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: hdr_lutNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER9001800270036004500SE +/- 13.62, N = 3SE +/- 10.06, N = 3SE +/- 12.09, N = 3SE +/- 5.47, N = 3SE +/- 16.37, N = 33313.263927.113905.983971.613822.161. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: hdr_peakdetect

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: hdr_peakdetectNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER11002200330044005500SE +/- 75.68, N = 3SE +/- 11.75, N = 3SE +/- 3.65, N = 3SE +/- 165.74, N = 3SE +/- 13.83, N = 34969.743310.023292.373475.063913.341. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: polar_nocompute

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: polar_nocomputeNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER6001200180024003000SE +/- 3.16, N = 3SE +/- 0.01, N = 3SE +/- 0.24, N = 3SE +/- 1.70, N = 3SE +/- 0.38, N = 32116.501968.372327.552459.032646.701. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

Libplacebo

Test: deband_heavy

OpenBenchmarking.orgFPS, More Is BetterLibplacebo 5.229.1Test: deband_heavyNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER5001000150020002500SE +/- 2.90, N = 3SE +/- 0.12, N = 3SE +/- 2.26, N = 3SE +/- 0.40, N = 3SE +/- 2.22, N = 32015.931843.262186.702306.562493.291. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF

RealSR-NCNN

Scale: 4x - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: YesNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1020304050SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 330.3142.8534.8933.6330.72

Blender

Blend File: Fishy Cat - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: NVIDIA OptiXNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER3691215SE +/- 0.08, N = 9SE +/- 0.03, N = 3SE +/- 0.06, N = 13SE +/- 0.01, N = 3SE +/- 0.06, N = 1310.6411.039.459.028.32

TensorFlow

Device: GPU - Batch Size: 1 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: AlexNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.20, N = 15SE +/- 0.16, N = 3SE +/- 0.22, N = 2SE +/- 0.06, N = 2SE +/- 0.13, N = 1514.4514.0413.9214.7912.26

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_lNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.13, N = 3SE +/- 6.65, N = 5SE +/- 0.62, N = 399.05102.90102.6096.50102.83MIN: 91.8 / MAX: 100.69MIN: 95.98 / MAX: 104.54MIN: 94.84 / MAX: 104.25MIN: 64.35 / MAX: 104.79MIN: 92.44 / MAX: 105.47

NAMD CUDA

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD CUDA 2.14ATPase Simulation - 327,506 AtomsNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.02430.04860.07290.09720.1215SE +/- 0.00042, N = 3SE +/- 0.00021, N = 3SE +/- 0.00031, N = 3SE +/- 0.00061, N = 3SE +/- 0.00018, N = 30.108220.074980.067910.067880.07715

TensorFlow

Device: GPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.97881.95762.93643.91524.894SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 34.354.344.354.324.14

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_lNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.14, N = 3SE +/- 0.45, N = 3SE +/- 1.49, N = 2SE +/- 0.39, N = 2SE +/- 0.13, N = 399.84101.55102.60103.20103.49MIN: 92.73 / MAX: 101.46MIN: 93.44 / MAX: 103.08MIN: 79.69 / MAX: 105.28MIN: 95.31 / MAX: 105.27MIN: 93.23 / MAX: 105.43

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_lNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.19, N = 3SE +/- 0.39, N = 3SE +/- 0.36, N = 299.25101.43103.57103.50103.53MIN: 91.16 / MAX: 101.18MIN: 93.27 / MAX: 103.58MIN: 95.95 / MAX: 105.54MIN: 94.95 / MAX: 105.61MIN: 88.81 / MAX: 104.8

ViennaCL

Test: CPU BLAS - dGEMM-TT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER306090120150SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 2.08, N = 3SE +/- 2.91, N = 31131181221241171. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-TN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TNNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER306090120150SE +/- 2.08, N = 3SE +/- 2.31, N = 3SE +/- 1.00, N = 2SE +/- 2.08, N = 3SE +/- 3.00, N = 21211211151251201. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-NT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER306090120150SE +/- 3.28, N = 3SE +/- 1.76, N = 3SE +/- 2.08, N = 3SE +/- 1.20, N = 3SE +/- 3.50, N = 21191221171181191. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-NN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NNNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER306090120150SE +/- 1.86, N = 3SE +/- 1.86, N = 3SE +/- 4.04, N = 3SE +/- 1.15, N = 3SE +/- 1.50, N = 21131221191171221. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMV-T

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-TNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 6.30, N = 3SE +/- 0.47, N = 3110.0109.0109.0102.782.61. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMV-N

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-NNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.46, N = 3103.0103.0102.0103.078.51. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dDOTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.84, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.58, N = 3SE +/- 0.19, N = 395.296.796.896.470.81. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dAXPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.94, N = 3SE +/- 0.44, N = 3SE +/- 0.12, N = 3SE +/- 0.57, N = 3SE +/- 0.12, N = 386.286.887.287.364.31. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dCOPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1632486480SE +/- 0.72, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.74, N = 3SE +/- 0.18, N = 370.271.070.871.352.71. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sDOTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 35.40, N = 3SE +/- 3.76, N = 3SE +/- 2.73, N = 3SE +/- 2.40, N = 3SE +/- 0.58, N = 3132.1166.0165.0168.0129.01. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sAXPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER306090120150SE +/- 0.33, N = 3SE +/- 4.81, N = 3SE +/- 2.19, N = 3SE +/- 2.00, N = 3SE +/- 0.33, N = 31541531561561201. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - sCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sCOPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER306090120150SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 31321311321321071. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_lNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.57, N = 3SE +/- 0.05, N = 2SE +/- 0.18, N = 399.43101.24103.17103.24102.83MIN: 90.49 / MAX: 101.97MIN: 93.33 / MAX: 102.92MIN: 95.79 / MAX: 105.15MIN: 95.41 / MAX: 104.9MIN: 93.16 / MAX: 105.07

ViennaCL

Test: OpenCL BLAS - dGEMM-TT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER160320480640800SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 1.33, N = 35935026136487311. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMM-TN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-TNNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER150300450600750SE +/- 2.03, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 1.00, N = 35944945996347141. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMM-NT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER150300450600750SE +/- 2.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 35954775846126891. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMM-NN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMM-NNNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER150300450600750SE +/- 2.31, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 1.33, N = 35924735776046811. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMV-T

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-TNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER90180270360450SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 33743873893914241. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dGEMV-N

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dGEMV-NNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER50100150200250SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 31872092102112181. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dDOTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER140280420560700SE +/- 0.88, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.33, N = 36594564584575751. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dAXPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER160320480640800SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 37244554374375851. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - dCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - dCOPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER130260390520650SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 4.00, N = 36054234234245121. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - sDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sDOTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER90180270360450SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.00, N = 33763623703654101. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - sAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sAXPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER110220330440550SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 34983893923934691. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

ViennaCL

Test: OpenCL BLAS - sCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: OpenCL BLAS - sCOPYNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER80160240320400SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 33633303343363731. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL

Blender

Blend File: BMW27 - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: NVIDIA OptiXNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER246810SE +/- 0.06, N = 14SE +/- 0.01, N = 3SE +/- 0.06, N = 13SE +/- 0.02, N = 3SE +/- 0.06, N = 146.316.215.575.435.04

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_lNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.53, N = 2SE +/- 0.52, N = 2SE +/- 0.33, N = 398.11103.68103.45103.66MIN: 89.88 / MAX: 100.25MIN: 96.86 / MAX: 105.56MIN: 95.22 / MAX: 105.88MIN: 93.46 / MAX: 105.95

Blender

Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: NVIDIA OptiXNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 317.3016.5514.2913.9712.56

Blender

Blend File: Classroom - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: NVIDIA OptiXNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 315.2614.8612.6012.3011.20

ProjectPhysX OpenCL-Benchmark

Operation: Memory Bandwidth Coalesced Write

OpenBenchmarking.orgGB/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: Memory Bandwidth Coalesced WriteNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER2004006008001000SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.57, N = 3887.31459.43455.01457.17608.941. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: Memory Bandwidth Coalesced Read

OpenBenchmarking.orgGB/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: Memory Bandwidth Coalesced ReadNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER2004006008001000SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3864.11465.18464.86465.07619.031. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT8 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT8 ComputeNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER48121620SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 313.7312.1214.3115.7317.621. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT16 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT16 ComputeNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 317.0014.2817.1718.2820.501. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT32 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT32 ComputeNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER612182430SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 320.0316.3819.8921.0523.661. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: INT64 Compute

OpenBenchmarking.orgTIOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: INT64 ComputeNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.99451.9892.98353.9784.9725SE +/- 0.003, N = 3SE +/- 0.004, N = 3SE +/- 0.015, N = 3SE +/- 0.016, N = 3SE +/- 0.009, N = 33.1353.4434.2144.4204.4141. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: FP32 Compute

OpenBenchmarking.orgTFLOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: FP32 ComputeNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER1020304050SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 339.4031.7738.5940.9145.951. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

ProjectPhysX OpenCL-Benchmark

Operation: FP64 Compute

OpenBenchmarking.orgTFLOPs/s, More Is BetterProjectPhysX OpenCL-Benchmark 1.2Operation: FP64 ComputeNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.16720.33440.50160.66880.836SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.6370.5100.6210.6600.7431. (CXX) g++ options: -std=c++17 -pthread -lOpenCL

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 0.33, N = 2SE +/- 0.05, N = 3SE +/- 1.38, N = 2SE +/- 0.81, N = 3164.35187.51195.30194.87198.01MIN: 149.91 / MAX: 166.09MIN: 181.57 / MAX: 188.05MIN: 182 / MAX: 199.43MIN: 180.8 / MAX: 198MIN: 185.3 / MAX: 202.59

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 0.34, N = 3SE +/- 0.51, N = 3SE +/- 0.78, N = 2SE +/- 0.20, N = 3164.14186.63196.07197.02196.50MIN: 149 / MAX: 165MIN: 180.51 / MAX: 187.79MIN: 171.95 / MAX: 199.96MIN: 183.92 / MAX: 200.54MIN: 179.34 / MAX: 200

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 0.17, N = 3SE +/- 1.14, N = 2SE +/- 0.19, N = 2SE +/- 0.95, N = 3161.01187.27194.58195.86198.70MIN: 138.12 / MAX: 165.16MIN: 179.9 / MAX: 188.08MIN: 183.74 / MAX: 198.52MIN: 181.64 / MAX: 199.2MIN: 185.21 / MAX: 203.36

RealSR-NCNN

Scale: 4x - TAA: No

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: NoNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER246810SE +/- 0.016, N = 3SE +/- 0.006, N = 3SE +/- 0.150, N = 15SE +/- 0.039, N = 3SE +/- 0.003, N = 35.5567.0926.3235.9625.633

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 0.29, N = 3SE +/- 0.28, N = 3163.74187.69195.39198.82197.82MIN: 144.93 / MAX: 165.03MIN: 182.03 / MAX: 188.31MIN: 183.94 / MAX: 198.7MIN: 188.33 / MAX: 201.47MIN: 176.19 / MAX: 201.63

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_lNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20406080100SE +/- 0.33, N = 3SE +/- 0.55, N = 3SE +/- 0.24, N = 2105.55107.59106.37108.59105.86MIN: 91.76 / MAX: 107.42MIN: 98.77 / MAX: 109.43MIN: 97.91 / MAX: 108.16MIN: 99.04 / MAX: 110.68MIN: 95.05 / MAX: 107.6

TensorFlow

Device: GPU - Batch Size: 1 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: GPU - Batch Size: 1 - Model: GoogLeNetNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER3691215SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 2SE +/- 0.30, N = 2SE +/- 0.05, N = 312.8212.7812.6212.7912.24

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 0.29, N = 3SE +/- 0.33, N = 3164.14187.26195.40194.29198.58MIN: 145.67 / MAX: 165.38MIN: 179.81 / MAX: 188.21MIN: 186.09 / MAX: 197.7MIN: 182.25 / MAX: 197.39MIN: 183.91 / MAX: 201.98

VkResample

Upscale: 2x - Precision: Single

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: SingleNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 310.3218.0218.4918.4613.361. (CXX) g++ options: -O3

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Double-Precision DoubleNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER160320480640800SE +/- 1.63, N = 3SE +/- 0.21, N = 3SE +/- 0.98, N = 3SE +/- 1.33, N = 3SE +/- 1.26, N = 3642.23515.17630.11667.05750.361. (CXX) g++ options: -O3

LuxCoreRender

Scene: Rainbow Colors and Prism - Acceleration: GPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Rainbow Colors and Prism - Acceleration: GPUNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER816243240SE +/- 0.36, N = 5SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 333.2923.2627.6727.7131.86MIN: 30.4 / MAX: 36.21MIN: 20.92 / MAX: 24.3MIN: 24.87 / MAX: 29.03MIN: 25.01 / MAX: 29.15MIN: 28.57 / MAX: 33.29

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER110220330440550SE +/- 0.24, N = 3SE +/- 0.27, N = 3SE +/- 0.92, N = 3SE +/- 1.92, N = 3SE +/- 1.58, N = 3419.03458.36507.45505.62527.82MIN: 376 / MAX: 422MIN: 404.89 / MAX: 461.01MIN: 423.41 / MAX: 512.88MIN: 426.6 / MAX: 513.25MIN: 419.39 / MAX: 534.44

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER120240360480600SE +/- 3.09, N = 3SE +/- 11.16, N = 12SE +/- 3.07, N = 3525.12546.76557.73535.39558.82MIN: 458.54 / MAX: 542.46MIN: 195.25 / MAX: 556.94MIN: 513.63 / MAX: 563.37MIN: 428.43 / MAX: 572.99MIN: 473.77 / MAX: 573.46

Hashcat

Benchmark: MD5

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: MD5NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER20000M40000M60000M80000M100000MSE +/- 53667246.37, N = 3SE +/- 33772046.30, N = 3SE +/- 22430807.19, N = 3SE +/- 11283665.68, N = 3SE +/- 97655010.68, N = 36717730000056147866667675830333337331223333382004966667

Hashcat

Benchmark: SHA1

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA1NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER6000M12000M18000M24000M30000MSE +/- 26244639.66, N = 3SE +/- 6318315.53, N = 3SE +/- 5140363.15, N = 3SE +/- 15926811.78, N = 3SE +/- 29067564.97, N = 32132373333318202466667221326000002353240000026388600000

Hashcat

Benchmark: SHA-512

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: SHA-512NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER800M1600M2400M3200M4000MSE +/- 3288532.26, N = 3SE +/- 1059874.21, N = 3SE +/- 1530068.99, N = 3SE +/- 721110.26, N = 3SE +/- 1098989.43, N = 330818666672673300000323273333334625000003887033333

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER4080120160200SE +/- 0.09, N = 2SE +/- 0.36, N = 3SE +/- 0.73, N = 3SE +/- 0.38, N = 3197.12198.18201.94201.19200.46MIN: 137.37 / MAX: 198.9MIN: 181.27 / MAX: 200.06MIN: 183.53 / MAX: 206.5MIN: 180.79 / MAX: 203.92MIN: 177.25 / MAX: 203.31

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TI SUPER110220330440550SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 1.39, N = 3SE +/- 0.54, N = 3416.89459.93504.67529.14MIN: 329.77 / MAX: 420.82MIN: 403.65 / MAX: 462.74MIN: 412.34 / MAX: 514.07MIN: 414.54 / MAX: 534.65

Rodinia

Test: OpenCL Particle Filter

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenCL Particle FilterNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.92211.84422.76633.68844.6105SE +/- 0.030, N = 15SE +/- 0.008, N = 3SE +/- 0.039, N = 4SE +/- 0.002, N = 3SE +/- 0.004, N = 33.8444.0983.4803.2912.9731. (CXX) g++ options: -O2 -lOpenCL

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER120240360480600SE +/- 0.89, N = 2SE +/- 0.26, N = 3SE +/- 2.23, N = 3SE +/- 1.33, N = 3419.76458.39509.45502.92531.96MIN: 376.2 / MAX: 422.17MIN: 404.5 / MAX: 461.01MIN: 430.1 / MAX: 516.48MIN: 415.65 / MAX: 520.39MIN: 422.98 / MAX: 539.81

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER110220330440550SE +/- 0.40, N = 3SE +/- 0.43, N = 2SE +/- 4.43, N = 2SE +/- 0.83, N = 2SE +/- 1.16, N = 3416.20459.27504.27504.66529.49MIN: 355.45 / MAX: 419.05MIN: 405.48 / MAX: 461.88MIN: 418.22 / MAX: 512.44MIN: 424.27 / MAX: 509.08MIN: 410.12 / MAX: 537.25

PyTorch

Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50NVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER120240360480600SE +/- 0.13, N = 2SE +/- 2.17, N = 2SE +/- 1.69, N = 3SE +/- 0.70, N = 3420.29459.94501.50505.55532.77MIN: 376.81 / MAX: 421.58MIN: 403.65 / MAX: 462.59MIN: 415.94 / MAX: 510.69MIN: 419.93 / MAX: 512.69MIN: 420.31 / MAX: 538.98

Hashcat

Benchmark: TrueCrypt RIPEMD160 + XTS

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: TrueCrypt RIPEMD160 + XTSNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER200K400K600K800K1000KSE +/- 1757.21, N = 3SE +/- 176.38, N = 3SE +/- 633.33, N = 3SE +/- 888.82, N = 3SE +/- 392.99, N = 3797833660967802967858600961733

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER80160240320400SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3360.8330.3331.8333.3370.71. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: WriteNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER160320480640800SE +/- 0.83, N = 3SE +/- 0.55, N = 3SE +/- 1.11, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3753.8406.7407.5412.2551.91. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: ReadNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER2004006008001000SE +/- 0.32, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3825.8446.3446.2446.3595.21. (CC) gcc options: -O2 -flto -lOpenCL

Hashcat

Benchmark: 7-Zip

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.2.4Benchmark: 7-ZipNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER300K600K900K1200K1500KSE +/- 1587.45, N = 3SE +/- 2062.63, N = 3SE +/- 1991.93, N = 3SE +/- 2339.04, N = 3SE +/- 1628.91, N = 31056000976967117646712626331420700

Waifu2x-NCNN Vulkan

Scale: 2x - Denoise: 3 - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818Scale: 2x - Denoise: 3 - TAA: YesNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER0.72051.4412.16152.8823.6025SE +/- 0.011, N = 3SE +/- 0.028, N = 3SE +/- 0.014, N = 3SE +/- 0.009, N = 3SE +/- 0.028, N = 33.2023.1682.8552.8542.660

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS, More Is Betterclpeak 1.1.2OpenCL Test: Global Memory BandwidthNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER2004006008001000SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3816.55437.21437.65437.63582.841. (CXX) g++ options: -O3

MandelGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec, More Is BetterMandelGPU 1.3pts1OpenCL Device: GPUNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER140M280M420M560M700MSE +/- 794770.01, N = 3SE +/- 1783157.89, N = 3SE +/- 467034.80, N = 3SE +/- 1202791.77, N = 3SE +/- 1096202.13, N = 3484098913.8516770131.2587219538.2619106132.5656484783.71. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL

FinanceBench

Benchmark: Black-Scholes OpenCL

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Black-Scholes OpenCLNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER246810SE +/- 0.006, N = 3SE +/- 0.003, N = 3SE +/- 0.114, N = 15SE +/- 0.003, N = 3SE +/- 0.000, N = 35.7416.9065.9125.2260.5011. (CXX) g++ options: -O3 -march=native -fopenmp

NeatBench

Acceleration: GPU

OpenBenchmarking.orgFPS, More Is BetterNeatBench 5Acceleration: GPUNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER9001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 512.75, N = 163090.04070.04070.04070.02084.1

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS, More Is Betterclpeak 1.1.2OpenCL Test: Integer Compute INTNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER5K10K15K20K25KSE +/- 16.49, N = 3SE +/- 15.26, N = 3SE +/- 3.14, N = 3SE +/- 2.50, N = 3SE +/- 28.14, N = 317923.3314555.1918170.5419821.1022171.251. (CXX) g++ options: -O3

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS, More Is Betterclpeak 1.1.2OpenCL Test: Single-Precision FloatNVIDIA RTX 3090NVIDIA RTX 4070NVIDIA RTX 4070 SUPERNVIDIA RTX 4070 TINVIDIA RTX 4070 TI SUPER9K18K27K36K45KSE +/- 113.39, N = 3SE +/- 5.46, N = 3SE +/- 0.99, N = 3SE +/- 11.67, N = 3SE +/- 50.25, N = 334906.7928479.3935492.6938691.7343244.791. (CXX) g++ options: -O3

Phoronix Test Suite v10.8.4