Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1630 BIOS) and ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB on EndeavourOS rolling via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2402174-SADD-240211636
RTX 4070 SUPER,
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: FP64 Compute",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",0.622,0.621,0.621
"NVIDIA RTX 4070",0.507,0.512,0.51
"NVIDIA RTX 4070 TI",0.661,0.66,0.658
"NVIDIA RTX 3090",0.64,0.636,0.636
"NVIDIA RTX 4070 TI SUPER",0.745,0.742,0.742
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: FP32 Compute",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",38.532,38.624,38.625
"NVIDIA RTX 4070",31.731,31.825,31.747
"NVIDIA RTX 4070 TI",40.917,40.911,40.915
"NVIDIA RTX 3090",39.599,39.277,39.309
"NVIDIA RTX 4070 TI SUPER",45.922,45.97,45.959
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: INT64 Compute",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",4.192,4.207,4.243
"NVIDIA RTX 4070",3.45,3.437,3.443
"NVIDIA RTX 4070 TI",4.416,4.394,4.45
"NVIDIA RTX 3090",3.135,3.141,3.13
"NVIDIA RTX 4070 TI SUPER",4.433,4.405,4.405
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: INT32 Compute",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",19.892,19.886,19.89
"NVIDIA RTX 4070",16.417,16.379,16.335
"NVIDIA RTX 4070 TI",21.01,21.008,21.124
"NVIDIA RTX 3090",20.082,20.084,19.915
"NVIDIA RTX 4070 TI SUPER",23.674,23.655,23.65
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: INT16 Compute",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",17.166,17.17,17.175
"NVIDIA RTX 4070",14.313,14.299,14.241
"NVIDIA RTX 4070 TI",18.264,18.262,18.318
"NVIDIA RTX 3090",17.002,17.002,16.998
"NVIDIA RTX 4070 TI SUPER",20.533,20.514,20.461
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: INT8 Compute",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",14.304,14.388,14.229
"NVIDIA RTX 4070",12.159,12.094,12.094
"NVIDIA RTX 4070 TI",15.674,15.76,15.758
"NVIDIA RTX 3090",13.727,13.845,13.61
"NVIDIA RTX 4070 TI SUPER",17.611,17.616,17.619
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: Memory Bandwidth Coalesced Read",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",464.87,464.84,464.86
"NVIDIA RTX 4070",465.12,465.19,465.23
"NVIDIA RTX 4070 TI",465.07,465.04,465.09
"NVIDIA RTX 3090",864.03,864.25,864.05
"NVIDIA RTX 4070 TI SUPER",618.92,619.06,619.11
"ProjectPhysX OpenCL-Benchmark 1.2 - Operation: Memory Bandwidth Coalesced Write",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",455.09,454.74,455.2
"NVIDIA RTX 4070",459.76,459.24,459.3
"NVIDIA RTX 4070 TI",457,457.37,457.13
"NVIDIA RTX 3090",887.23,887.42,887.27
"NVIDIA RTX 4070 TI SUPER",608.48,610.07,608.28
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",557.73119730268
"NVIDIA RTX 4070",541.37874283146,552.06956552035,546.83109363804
"NVIDIA RTX 4070 TI",534.22055858825,568.14444346572,538.26931568774,561.89403254055,563.03950197722,470.90244732447,474.96777137747,475.21389511527,562.05382601592,551.82591553156,557.61476062957,566.55828752704
"NVIDIA RTX 3090",525.12093920558
"NVIDIA RTX 4070 TI SUPER",563.92523399271,559.23991975013,553.30635565123
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",201.93643942088
"NVIDIA RTX 4070",198.53774569876,198.53783007737,197.45317569041
"NVIDIA RTX 4070 TI",201.26123564929,202.4162778778,199.88710398357
"NVIDIA RTX 3090",197.20725868995,197.03352114183
"NVIDIA RTX 4070 TI SUPER",199.72723400534,200.64544915304,201.00969232617
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",509.44719996986
"NVIDIA RTX 4070",458.32468862772,458.87277278989,457.96302265799
"NVIDIA RTX 4070 TI",503.75995829327,498.69991902718,506.30305778568
"NVIDIA RTX 3090",420.64949875629,418.87297500591
"NVIDIA RTX 4070 TI SUPER",531.93255127089,529.67424611102,534.28532706797
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",503.67387611119,499.32428816662
"NVIDIA RTX 4070",460.07232141042,459.8169216431
"NVIDIA RTX 4070 TI",504.55837733019,508.84045459408,503.24213093057
"NVIDIA RTX 3090",420.28796783042
"NVIDIA RTX 4070 TI SUPER",533.93955871098,531.52053554508,532.86043800697
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",505.65741375953,508.71811992404,507.97130629644
"NVIDIA RTX 4070",458.91137588933,458.10938296191,458.07048283503
"NVIDIA RTX 4070 TI",503.47566367327,503.91901978505,509.4529035896
"NVIDIA RTX 3090",419.42909156537,418.6116928513,419.04300593625
"NVIDIA RTX 4070 TI SUPER",529.13989183727,529.64100499168,524.67976009134
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",195.40494219765
"NVIDIA RTX 4070",186.74404855084,187.73048835301,187.31587595692
"NVIDIA RTX 4070 TI",194.29478854372
"NVIDIA RTX 3090",164.14101277049
"NVIDIA RTX 4070 TI SUPER",198.14948044435,199.2205610807,198.38191535122
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",502.26632452285,507.08910726183,504.64483797961
"NVIDIA RTX 4070",459.62507649562,459.573266796,460.60342063729
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",416.6189991611,417.04055566067,417.02016354833
"NVIDIA RTX 4070 TI SUPER",529.70582776713,529.64608740353,528.05860008759
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",195.38787181133
"NVIDIA RTX 4070",187.69142126668
"NVIDIA RTX 4070 TI",198.81681733432
"NVIDIA RTX 3090",164.22837400781,163.76339028051,163.2287408943
"NVIDIA RTX 4070 TI SUPER",197.78671934973,197.3576951663,198.31946276977
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",499.83942473782,508.69919302359
"NVIDIA RTX 4070",459.69097595538,458.83962518906
"NVIDIA RTX 4070 TI",503.8327841864,505.49631932199
"NVIDIA RTX 3090",415.48161408661,416.85733918405,416.27028598544
"NVIDIA RTX 4070 TI SUPER",531.68270217227,527.70933549944,529.08825880799
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",195.27906525749,197.00912425407,195.90759544098
"NVIDIA RTX 4070",186.21482861105,186.37858179324,187.31005226817
"NVIDIA RTX 4070 TI",197.80384048275,196.23549198141
"NVIDIA RTX 3090",164.14307018957
"NVIDIA RTX 4070 TI SUPER",196.85306737235,196.1742351653,196.47638113899
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",195.72387968301,193.44408664711
"NVIDIA RTX 4070",186.92013244731,187.41271884108,187.47196545786
"NVIDIA RTX 4070 TI",195.66962984303,196.05159098328
"NVIDIA RTX 3090",161.01378055587
"NVIDIA RTX 4070 TI SUPER",200.27781827187,198.82097811878,196.98984173824
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",196.68417885831,193.91821108267
"NVIDIA RTX 4070",187.48323404101,187.60760437648,187.43055045991
"NVIDIA RTX 4070 TI",194.86837216432
"NVIDIA RTX 3090",164.68062841969,164.01646682802
"NVIDIA RTX 4070 TI SUPER",197.35841236122,197.04509995347,199.61801516882
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",106.3705051719
"NVIDIA RTX 4070",107.12098223823,106.95102781909,108.68648512822
"NVIDIA RTX 4070 TI",108.58614214964
"NVIDIA RTX 3090",104.98840134061,105.53262633077,106.12582885225
"NVIDIA RTX 4070 TI SUPER",105.61361233489,106.09655184875
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",103.68408223011
"NVIDIA RTX 4070 TI",103.97086376659,102.92989122663
"NVIDIA RTX 3090",97.577443741268,98.640765677542
"NVIDIA RTX 4070 TI SUPER",103.18004412883,103.5135890738,104.28822143044
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",102.59918087262
"NVIDIA RTX 4070",102.89530989414
"NVIDIA RTX 4070 TI",69.94423032894,103.19095503383,102.88882410911,104.17990727373,102.31540267826
"NVIDIA RTX 3090",98.863741229968,98.993433066005,99.295798707419
"NVIDIA RTX 4070 TI SUPER",102.92560571739,103.85503742596,101.70079827207
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",101.11071569714,104.09043620652
"NVIDIA RTX 4070",102.43823006281,101.22379504672,100.99022902464
"NVIDIA RTX 4070 TI",102.81065879449,103.58128475346
"NVIDIA RTX 3090",99.939925741279,99.552723634119,100.02124425236
"NVIDIA RTX 4070 TI SUPER",103.67686100996,103.56717998346,103.2391822734
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",103.17086360604
"NVIDIA RTX 4070",101.18118430777,101.28942928642
"NVIDIA RTX 4070 TI",103.24453989502
"NVIDIA RTX 3090",99.821276448284,100.17459186512,98.306695936666
"NVIDIA RTX 4070 TI SUPER",102.93025851703,103.07296247573,102.48032918854
"PyTorch 2.1 - Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",103.57095408734
"NVIDIA RTX 4070",100.64589067414,101.80756694903,101.83819954532
"NVIDIA RTX 4070 TI",103.86550670954,103.14155578991
"NVIDIA RTX 3090",99.215997372517,98.939732932542,99.579881047891
"NVIDIA RTX 4070 TI SUPER",103.53139125943
"GpuOwl 7.2.1 - Exponent: 57885161",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",866.55112651647,870.32201914709,870.32201914709
"NVIDIA RTX 4070",714.79628305933,714.79628305933,714.79628305933
"NVIDIA RTX 4070 TI",914.07678244973,921.65898617512,921.65898617512
"NVIDIA RTX 3090",870.32201914709,864.30423509075,864.30423509075
"NVIDIA RTX 4070 TI SUPER",1025.641025641,1026.6940451745,1025.641025641
"GpuOwl 7.2.1 - Exponent: 77936867",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",646.41241111829,646.41241111829,646.41241111829
"NVIDIA RTX 4070",530.22269353128,530.50397877984,530.22269353128
"NVIDIA RTX 4070 TI",676.5899864682,676.5899864682,676.5899864682
"NVIDIA RTX 3090",645.99483204134,645.99483204134,645.99483204134
"NVIDIA RTX 4070 TI SUPER",761.61462300076,761.61462300076,761.61462300076
"GpuOwl 7.2.1 - Exponent: 332220523",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",137.43815283123,137.43815283123,137.43815283123
"NVIDIA RTX 4070",112.61261261261,112.61261261261,112.59993244004
"NVIDIA RTX 4070 TI",145.83637159108,145.83637159108,145.83637159108
"NVIDIA RTX 3090",137.32491073881,137.32491073881,137.32491073881
"NVIDIA RTX 4070 TI SUPER",163.42539630659,163.39869281046,163.39869281046
"vkpeak 20230730 - ",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"RealSR-NCNN 20200818 - Scale: 4x - TAA: No",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",6.13,6.097,8.298,6.122,6.892,6.143,6.114,6.149,6.103,6.117,6.187,6.109,6.124,6.135,6.124
"NVIDIA RTX 4070",7.09,7.104,7.083
"NVIDIA RTX 4070 TI",5.914,5.933,6.039
"NVIDIA RTX 3090",5.554,5.53,5.584
"NVIDIA RTX 4070 TI SUPER",5.636,5.627,5.635
"RealSR-NCNN 20200818 - Scale: 4x - TAA: Yes",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",34.849,34.913,34.893
"NVIDIA RTX 4070",42.563,42.694,43.299
"NVIDIA RTX 4070 TI",33.635,33.564,33.68
"NVIDIA RTX 3090",30.201,30.396,30.341
"NVIDIA RTX 4070 TI SUPER",30.759,30.706,30.707
"Waifu2x-NCNN Vulkan 20200818 - Scale: 2x - Denoise: 3 - TAA: No",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Waifu2x-NCNN Vulkan 20200818 - Scale: 2x - Denoise: 3 - TAA: Yes",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",2.842,2.841,2.882
"NVIDIA RTX 4070",3.145,3.223,3.135
"NVIDIA RTX 4070 TI",2.87,2.854,2.838
"NVIDIA RTX 3090",3.201,3.222,3.183
"NVIDIA RTX 4070 TI SUPER",2.623,2.714,2.643
"VkFFT 1.2.31 - Test: FFT + iFFT R2C / C2R",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",56335,49306,49411,55157,55588,54331,55307,54435,57098,54161,57091,56645,59558,54600,52880
"NVIDIA RTX 4070",47874,47941,44921,44207,46141,43963,45546,48229,45817,45058,48367,51657,52534
"NVIDIA RTX 4070 TI",55869,56058,54411
"NVIDIA RTX 3090",48668,48805,47782
"NVIDIA RTX 4070 TI SUPER",60439,54261,63270,62179,59523,57535,61874,58872,59169,54194,57919,59782,61594,56149,63912
"VkFFT 1.2.31 - Test: FFT + iFFT C2C 1D batched in half precision",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",131782,131399,131934
"NVIDIA RTX 4070",139006,139121,135159
"NVIDIA RTX 4070 TI",138101,137729,132800
"NVIDIA RTX 3090",272929,273483,273250
"NVIDIA RTX 4070 TI SUPER",153863,141014,143040,157719,163634,137287,137641,124725,124754,146141,155191,142896
"VkFFT 1.2.31 - Test: FFT + iFFT C2C Bluestein in single precision",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",14962,15247,15288
"NVIDIA RTX 4070",13808,13707,13628
"NVIDIA RTX 4070 TI",15132,14916,15326
"NVIDIA RTX 3090",14306,13974,14334
"NVIDIA RTX 4070 TI SUPER",16060,16077,16287
"VkFFT 1.2.31 - Test: FFT + iFFT C2C 1D batched in double precision",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",24561,24054,24337
"NVIDIA RTX 4070",22559,22144,22468
"NVIDIA RTX 4070 TI",26005,25308,24979
"NVIDIA RTX 3090",30817,30990,30929
"NVIDIA RTX 4070 TI SUPER",27678,27569,28594
"VkFFT 1.2.31 - Test: FFT + iFFT C2C 1D batched in single precision",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",73926,73917,73944
"NVIDIA RTX 4070",77790,77786,77747
"NVIDIA RTX 4070 TI",73942,73941,73944
"NVIDIA RTX 3090",141873,141894,141861
"NVIDIA RTX 4070 TI SUPER",104032,104041,103936
"VkFFT 1.2.31 - Test: FFT + iFFT C2C multidimensional in single precision",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",50605,52752,49037,48309,48884,51294,51330,47187,51059,50524,49155,50418,52233,52098,49601
"NVIDIA RTX 4070",45998,47966,48637,46691,46767
"NVIDIA RTX 4070 TI",49515,51978,48982,52746,50637,50627,49055,52829,53879,52118,53061,51875,52880,49820,52916
"NVIDIA RTX 3090",51343,52431,48548,51174,48785,52795,49570,48347,49651,50363,51718,50940,52900,51516,52762
"NVIDIA RTX 4070 TI SUPER",59664,60274,59432
"VkFFT 1.2.31 - Test: FFT + iFFT C2C Bluestein benchmark in double precision",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",4426,4467,4459
"NVIDIA RTX 4070",3881,3882,3895
"NVIDIA RTX 4070 TI",4670,4637,4635
"NVIDIA RTX 3090",4215,4186,4185
"NVIDIA RTX 4070 TI SUPER",5063,5053,5025
"VkFFT 1.2.31 - Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",75100,75129,75004
"NVIDIA RTX 4070",79052,79051,79069
"NVIDIA RTX 4070 TI",75098,75195,75130
"NVIDIA RTX 3090",144243,144372,144319
"NVIDIA RTX 4070 TI SUPER",105590,105532,105524
"Hashcat 6.2.4 - Benchmark: MD5",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",67616000000,67592900000,67540200000
"NVIDIA RTX 4070",56080400000,56184400000,56178800000
"NVIDIA RTX 4070 TI",73300800000,73301100000,73334800000
"NVIDIA RTX 3090",67281500000,67102900000,67147500000
"NVIDIA RTX 4070 TI SUPER",82166600000,81829200000,82019100000
"Hashcat 6.2.4 - Benchmark: SHA1",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",22124800000,22130700000,22142300000
"NVIDIA RTX 4070",18196400000,18215100000,18195900000
"NVIDIA RTX 4070 TI",23500600000,23546700000,23549900000
"NVIDIA RTX 3090",21373500000,21313300000,21284400000
"NVIDIA RTX 4070 TI SUPER",26429300000,26332300000,26404200000
"Hashcat 6.2.4 - Benchmark: 7-Zip",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",1173000,1179900,1176500
"NVIDIA RTX 4070",972900,979600,978400
"NVIDIA RTX 4070 TI",1263900,1258100,1265900
"NVIDIA RTX 3090",1058400,1056600,1053000
"NVIDIA RTX 4070 TI SUPER",1423300,1421100,1417700
"Hashcat 6.2.4 - Benchmark: SHA-512",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",3235400000,3230100000,3232700000
"NVIDIA RTX 4070",2674600000,2674100000,2671200000
"NVIDIA RTX 4070 TI",3463900000,3461500000,3462100000
"NVIDIA RTX 3090",3087100000,3082700000,3075800000
"NVIDIA RTX 4070 TI SUPER",3885200000,3889000000,3886900000
"Hashcat 6.2.4 - Benchmark: TrueCrypt RIPEMD160 + XTS",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",802600,804200,802100
"NVIDIA RTX 4070",661300,660700,660900
"NVIDIA RTX 4070 TI",857300,858200,860300
"NVIDIA RTX 3090",800200,798900,794400
"NVIDIA RTX 4070 TI SUPER",961500,962500,961200
"Libplacebo 5.229.1 - ",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"cl-mem 2017-01-13 - Benchmark: Copy",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",331.8,331.8,331.7
"NVIDIA RTX 4070",330.5,330.3,330.2
"NVIDIA RTX 4070 TI",333.3,333.3,333.3
"NVIDIA RTX 3090",360.5,360.6,361.2
"NVIDIA RTX 4070 TI SUPER",370.7,370.7,370.7
"cl-mem 2017-01-13 - Benchmark: Read",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",446.3,446.4,446
"NVIDIA RTX 4070",446.3,446.3,446.3
"NVIDIA RTX 4070 TI",446.3,446.3,446.3
"NVIDIA RTX 3090",825.3,826.4,825.8
"NVIDIA RTX 4070 TI SUPER",595.2,595.2,595.2
"cl-mem 2017-01-13 - Benchmark: Write",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",409.6,406.9,405.9
"NVIDIA RTX 4070",407,405.6,407.4
"NVIDIA RTX 4070 TI",412.4,412.1,412
"NVIDIA RTX 3090",754.2,755,752.2
"NVIDIA RTX 4070 TI SUPER",552.2,551.4,552.1
"NAMD CUDA 2.14 - ATPase Simulation - 327,506 Atoms",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",0.0685238,0.0674888,0.0677212
"NVIDIA RTX 4070",0.0753903,0.0747209,0.0748287
"NVIDIA RTX 4070 TI",0.0674191,0.0671287,0.069094
"NVIDIA RTX 3090",0.108711,0.108565,0.107395
"NVIDIA RTX 4070 TI SUPER",0.0772468,0.0767922,0.0774041
"VkResample 1.0 - Upscale: 2x - Precision: Double",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",340.084,339.657,339.039
"NVIDIA RTX 4070",416.678,414.645,414.157
"NVIDIA RTX 4070 TI",321.358,322.371,322.462
"NVIDIA RTX 3090",333.11,333.643,334.164
"NVIDIA RTX 4070 TI SUPER",286.027,285.961,285.975
"VkResample 1.0 - Upscale: 2x - Precision: Single",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",18.492,18.486,18.489
"NVIDIA RTX 4070",18.015,18.012,18.02
"NVIDIA RTX 4070 TI",18.456,18.454,18.458
"NVIDIA RTX 3090",10.329,10.321,10.318
"NVIDIA RTX 4070 TI SUPER",13.359,13.372,13.357
"OctaneBench 2020.1 - Total Score",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"FAHBench 2.3.2 - ",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",366.813,365.5072,365.8527
"NVIDIA RTX 4070",317.0826,317.4399,317.063
"NVIDIA RTX 4070 TI",382.389,382.4534,381.6488
"NVIDIA RTX 3090",342.7203,343.5412,342.7983
"NVIDIA RTX 4070 TI SUPER",395.1616,394.4036,394.6417
"clpeak 1.1.2 - OpenCL Test: Integer Compute INT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",18167.49,18167.31,18176.82
"NVIDIA RTX 4070",14524.67,14570.09,14570.81
"NVIDIA RTX 4070 TI",19824.96,19821.91,19816.42
"NVIDIA RTX 3090",17928.13,17892.67,17949.2
"NVIDIA RTX 4070 TI SUPER",22176.42,22120.12,22217.2
"clpeak 1.1.2 - OpenCL Test: Single-Precision Float",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",35493.5,35490.71,35493.85
"NVIDIA RTX 4070",28490.25,28473.01,28474.92
"NVIDIA RTX 4070 TI",38686.82,38674.43,38713.94
"NVIDIA RTX 3090",34682.54,35048.16,34989.66
"NVIDIA RTX 4070 TI SUPER",43343.71,43179.97,43210.68
"clpeak 1.1.2 - OpenCL Test: Double-Precision Double",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",631.78,630.17,628.38
"NVIDIA RTX 4070",515.59,514.99,514.92
"NVIDIA RTX 4070 TI",667.87,668.83,664.46
"NVIDIA RTX 3090",640.19,641.05,645.45
"NVIDIA RTX 4070 TI SUPER",748.56,752.78,749.74
"clpeak 1.1.2 - OpenCL Test: Global Memory Bandwidth",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",437.64,437.69,437.63
"NVIDIA RTX 4070",437.17,437.23,437.24
"NVIDIA RTX 4070 TI",437.64,437.65,437.6
"NVIDIA RTX 3090",816.58,816.55,816.52
"NVIDIA RTX 4070 TI SUPER",582.86,582.84,582.82
"LeelaChessZero 0.30 - Backend: OpenCL",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Rodinia 3.1 - Test: OpenCL Particle Filter",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",3.594,3.425,3.434,3.465
"NVIDIA RTX 4070",4.112,4.083,4.098
"NVIDIA RTX 4070 TI",3.292,3.293,3.287
"NVIDIA RTX 3090",3.904,4.147,3.718,3.679,3.698,3.8,3.813,3.933,3.815,3.853,3.838,3.847,3.844,3.798,3.968
"NVIDIA RTX 4070 TI SUPER",2.974,2.98,2.965
"LuxCoreRender 2.6 - Scene: DLSC - Acceleration: GPU",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",13.58,13.61,13.58
"NVIDIA RTX 4070",11.75,11.73,11.73
"NVIDIA RTX 4070 TI",13.95,13.95,13.96
"NVIDIA RTX 3090",0.58,14.22,14.14,14.13,14.06,14.11,14.1,14.08,14.11,14.11,14.13,14.13
"NVIDIA RTX 4070 TI SUPER",16.22,16.23,16.24
"LuxCoreRender 2.6 - Scene: Danish Mood - Acceleration: GPU",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",10.71,10.43,10.54
"NVIDIA RTX 4070",8.91,8.79,8.98
"NVIDIA RTX 4070 TI",10.86,10.9,11.22
"NVIDIA RTX 3090",10.18,10.27,10.15
"NVIDIA RTX 4070 TI SUPER",12.37,12.44,12.45
"LuxCoreRender 2.6 - Scene: Orange Juice - Acceleration: GPU",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",11.59,11.79,11.79
"NVIDIA RTX 4070",10.43,10.35,10.43
"NVIDIA RTX 4070 TI",11.89,11.89,11.88
"NVIDIA RTX 3090",12.13,12.14,12.15
"NVIDIA RTX 4070 TI SUPER",13.77,13.19,13.79,13.81
"LuxCoreRender 2.6 - Scene: LuxCore Benchmark - Acceleration: GPU",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",12.85,12.78,12.84
"NVIDIA RTX 4070",10.92,10.9,10.95
"NVIDIA RTX 4070 TI",13.24,13.21,13.23
"NVIDIA RTX 3090",13.15,13.09
"NVIDIA RTX 4070 TI SUPER",14.61,14.6,14.61
"LuxCoreRender 2.6 - Scene: Rainbow Colors and Prism - Acceleration: GPU",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",27.7,27.71,27.61
"NVIDIA RTX 4070",23.27,23.25,23.25
"NVIDIA RTX 4070 TI",27.72,27.83,27.58
"NVIDIA RTX 3090",31.87,33.69,33.53,33.64,33.7
"NVIDIA RTX 4070 TI SUPER",31.77,31.77,32.04
"ArrayFire 3.9 - Test: Conjugate Gradient OpenCL",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"FinanceBench 2016-07-25 - Benchmark: Black-Scholes OpenCL",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",5.67,5.651,6.397,6.4,6.487,5.651,5.654,5.649,5.65,7.04,5.713,5.655,5.737,5.662,5.665
"NVIDIA RTX 4070",6.902,6.905,6.912
"NVIDIA RTX 4070 TI",5.222,5.224,5.232
"NVIDIA RTX 3090",5.752,5.734,5.736
"NVIDIA RTX 4070 TI SUPER",0.501,0.501,0.501
"ViennaCL 1.7.1 - Test: CPU BLAS - sCOPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",133,130,134
"NVIDIA RTX 4070",132,129,133
"NVIDIA RTX 4070 TI",131,134,132
"NVIDIA RTX 3090",131,130,134
"NVIDIA RTX 4070 TI SUPER",108,106,108
"ViennaCL 1.7.1 - Test: CPU BLAS - sAXPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",154,153,160
"NVIDIA RTX 4070",156,144,160
"NVIDIA RTX 4070 TI",158,152,158
"NVIDIA RTX 3090",155,154,154
"NVIDIA RTX 4070 TI SUPER",120,120,121
"ViennaCL 1.7.1 - Test: CPU BLAS - sDOT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",163,161,170
"NVIDIA RTX 4070",166,159,172
"NVIDIA RTX 4070 TI",169,163,171
"NVIDIA RTX 3090",167,168,61.3
"NVIDIA RTX 4070 TI SUPER",129,128,130
"ViennaCL 1.7.1 - Test: CPU BLAS - dCOPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",71.1,70.2,71.2
"NVIDIA RTX 4070",70.8,70.7,71.5
"NVIDIA RTX 4070 TI",69.8,72.2,71.8
"NVIDIA RTX 3090",69.6,69.3,71.6
"NVIDIA RTX 4070 TI SUPER",53,52.4,52.8
"ViennaCL 1.7.1 - Test: CPU BLAS - dAXPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",87.4,87,87.2
"NVIDIA RTX 4070",87.1,85.9,87.3
"NVIDIA RTX 4070 TI",86.2,88,87.8
"NVIDIA RTX 3090",84.8,85.9,88
"NVIDIA RTX 4070 TI SUPER",64.5,64.1,64.4
"ViennaCL 1.7.1 - Test: CPU BLAS - dDOT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",96.8,96.7,97
"NVIDIA RTX 4070",96.4,97.1,96.5
"NVIDIA RTX 4070 TI",95.2,97,96.9
"NVIDIA RTX 3090",94.6,94.2,96.9
"NVIDIA RTX 4070 TI SUPER",71.2,70.6,70.7
"ViennaCL 1.7.1 - Test: CPU BLAS - dGEMV-N",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",102,103,102
"NVIDIA RTX 4070",103,102,103
"NVIDIA RTX 4070 TI",103,103,102
"NVIDIA RTX 3090",101,104,103
"NVIDIA RTX 4070 TI SUPER",79.3,78.4,77.7
"ViennaCL 1.7.1 - Test: CPU BLAS - dGEMV-T",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",109,110,109
"NVIDIA RTX 4070",110,109,109
"NVIDIA RTX 4070 TI",109,90.1,109
"NVIDIA RTX 3090",110,110,111
"NVIDIA RTX 4070 TI SUPER",83.5,82.4,81.9
"ViennaCL 1.7.1 - Test: CPU BLAS - dGEMM-NN",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",124,122,111
"NVIDIA RTX 4070",120,121,126
"NVIDIA RTX 4070 TI",117,119,115
"NVIDIA RTX 3090",111,112,117
"NVIDIA RTX 4070 TI SUPER",123,120
"ViennaCL 1.7.1 - Test: CPU BLAS - dGEMM-NT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",120,118,113
"NVIDIA RTX 4070",125,119,123
"NVIDIA RTX 4070 TI",116,117,120
"NVIDIA RTX 3090",124,113,121
"NVIDIA RTX 4070 TI SUPER",115,122
"ViennaCL 1.7.1 - Test: CPU BLAS - dGEMM-TN",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",114,116
"NVIDIA RTX 4070",121,125,117
"NVIDIA RTX 4070 TI",128,121,126
"NVIDIA RTX 3090",120,118,125
"NVIDIA RTX 4070 TI SUPER",117,123
"ViennaCL 1.7.1 - Test: CPU BLAS - dGEMM-TT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",125,123,118
"NVIDIA RTX 4070",116,117,120
"NVIDIA RTX 4070 TI",120,127,125
"NVIDIA RTX 3090",113,115,112
"NVIDIA RTX 4070 TI SUPER",118,122,112
"ViennaCL 1.7.1 - Test: OpenCL BLAS - sCOPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",334,334,335
"NVIDIA RTX 4070",330,330,329
"NVIDIA RTX 4070 TI",336,336,336
"NVIDIA RTX 3090",365,362,362
"NVIDIA RTX 4070 TI SUPER",373,374,373
"ViennaCL 1.7.1 - Test: OpenCL BLAS - sAXPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",392,392,392
"NVIDIA RTX 4070",389,389,389
"NVIDIA RTX 4070 TI",393,393,393
"NVIDIA RTX 3090",498,497,499
"NVIDIA RTX 4070 TI SUPER",467,471,470
"ViennaCL 1.7.1 - Test: OpenCL BLAS - sDOT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",370,370,370
"NVIDIA RTX 4070",362,362,362
"NVIDIA RTX 4070 TI",365,365,365
"NVIDIA RTX 3090",376,375,377
"NVIDIA RTX 4070 TI SUPER",408,411,411
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dCOPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",424,423,423
"NVIDIA RTX 4070",423,423,423
"NVIDIA RTX 4070 TI",424,424,424
"NVIDIA RTX 3090",606,605,604
"NVIDIA RTX 4070 TI SUPER",520,508,508
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dAXPY",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",437,437,437
"NVIDIA RTX 4070",455,455,455
"NVIDIA RTX 4070 TI",436,437,437
"NVIDIA RTX 3090",725,724,723
"NVIDIA RTX 4070 TI SUPER",585,585,585
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dDOT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",458,458,458
"NVIDIA RTX 4070",456,456,456
"NVIDIA RTX 4070 TI",457,457,457
"NVIDIA RTX 3090",660,659,657
"NVIDIA RTX 4070 TI SUPER",578,574,574
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dGEMV-N",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",209,210,210
"NVIDIA RTX 4070",209,208,209
"NVIDIA RTX 4070 TI",211,212,211
"NVIDIA RTX 3090",187,187,186
"NVIDIA RTX 4070 TI SUPER",218,218,218
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dGEMV-T",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",389,389,389
"NVIDIA RTX 4070",387,387,387
"NVIDIA RTX 4070 TI",391,391,392
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",425,424,424
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dGEMM-NN",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",577,577,577
"NVIDIA RTX 4070",473,472,473
"NVIDIA RTX 4070 TI",605,604,604
"NVIDIA RTX 3090",596,592,588
"NVIDIA RTX 4070 TI SUPER",684,680,680
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dGEMM-NT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",584,584,584
"NVIDIA RTX 4070",477,476,477
"NVIDIA RTX 4070 TI",613,612,612
"NVIDIA RTX 3090",599,596,591
"NVIDIA RTX 4070 TI SUPER",691,688,688
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dGEMM-TN",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",599,599,599
"NVIDIA RTX 4070",494,493,494
"NVIDIA RTX 4070 TI",635,633,633
"NVIDIA RTX 3090",597,594,590
"NVIDIA RTX 4070 TI SUPER",716,713,713
"ViennaCL 1.7.1 - Test: OpenCL BLAS - dGEMM-TT",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",613,613,613
"NVIDIA RTX 4070",502,501,502
"NVIDIA RTX 4070 TI",649,648,648
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",734,730,730
"Caffe 2020-02-13 - Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 100",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Caffe 2020-02-13 - Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 200",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Caffe 2020-02-13 - Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 1000",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Caffe 2020-02-13 - Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 100",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Caffe 2020-02-13 - Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 200",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Caffe 2020-02-13 - Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 1000",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"NCNN 20230517 - Target: Vulkan GPU",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",
"PlaidML - FP16: No - Mode: Training - Network: Mobilenet - Device: OpenCL",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"PlaidML - FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"PlaidML - FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"PlaidML - FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"PlaidML - FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"Blender 4.0 - Blend File: BMW27 - Compute: NVIDIA OptiX",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",6.25,5.48,5.51,5.51,5.52,5.52,5.49,5.54,5.52,5.5,5.51,5.51,5.49
"NVIDIA RTX 4070",6.22,6.2,6.21
"NVIDIA RTX 4070 TI",5.44,5.45,5.4
"NVIDIA RTX 3090",7.04,6.25,6.26,6.22,6.23,6.28,6.25,6.27,6.26,6.24,6.22,6.24,6.26,6.28
"NVIDIA RTX 4070 TI SUPER",5.82,5.01,4.97,4.97,4.96,4.97,4.99,4.97,4.98,4.99,5.01,4.97,4.98,4.97
"Blender 4.0 - Blend File: Classroom - Compute: NVIDIA OptiX",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",12.59,12.6,12.6
"NVIDIA RTX 4070",14.92,14.83,14.84
"NVIDIA RTX 4070 TI",12.36,12.28,12.25
"NVIDIA RTX 3090",15.27,15.28,15.23
"NVIDIA RTX 4070 TI SUPER",11.27,11.15,11.19
"Blender 4.0 - Blend File: Fishy Cat - Compute: NVIDIA OptiX",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",10.2,9.37,9.4,9.37,9.39,9.36,9.37,9.37,9.43,9.38,9.41,9.34,9.42
"NVIDIA RTX 4070",11.05,10.97,11.06
"NVIDIA RTX 4070 TI",9,9.02,9.05
"NVIDIA RTX 3090",11.3,10.56,10.57,10.51,10.54,10.55,10.56,10.55,10.59
"NVIDIA RTX 4070 TI SUPER",9.05,8.28,8.21,8.22,8.29,8.25,8.29,8.29,8.29,8.27,8.22,8.25,8.28
"Blender 4.0 - Blend File: Barbershop - Compute: NVIDIA OptiX",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",51.3,51.47,51.12
"NVIDIA RTX 4070",58.51,58.39,58.42
"NVIDIA RTX 4070 TI",50.7,50.82,50.66
"NVIDIA RTX 3090",54.32,54.27
"NVIDIA RTX 4070 TI SUPER",44.39,44.42,44.65
"Blender 4.0 - Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",14.29,14.35,14.24
"NVIDIA RTX 4070",16.55,16.53,16.56
"NVIDIA RTX 4070 TI",13.95,13.99,13.98
"NVIDIA RTX 3090",17.26,17.33,17.3
"NVIDIA RTX 4070 TI SUPER",12.56,12.59,12.52
"IndigoBench 4.4 - Acceleration: OpenCL GPU - Scene: Bedroom",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",19.812,19.809,19.783
"NVIDIA RTX 4070",18.197,18.222,18.19
"NVIDIA RTX 4070 TI",20.199,20.287,20.282
"NVIDIA RTX 3090",20.952,20.969,20.955
"NVIDIA RTX 4070 TI SUPER",24.561,24.569,24.581
"IndigoBench 4.4 - Acceleration: OpenCL GPU - Scene: Supercar",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",52.78,52.791,52.869
"NVIDIA RTX 4070",48.557,48.458,48.536
"NVIDIA RTX 4070 TI",53.586,53.556,53.624
"NVIDIA RTX 3090",51.979,51.993,52.071
"NVIDIA RTX 4070 TI SUPER",61.425,61.366,61.222
"MandelGPU 1.3pts1 - OpenCL Device: GPU",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",586762677,586742403.2,588153534.5
"NVIDIA RTX 4070",516215753.8,513996343.7,520098296
"NVIDIA RTX 4070 TI",621085692.5,619300046.1,616932658.8
"NVIDIA RTX 3090",483065130.4,483570125.4,485661485.7
"NVIDIA RTX 4070 TI SUPER",657978540.4,654348122.8,657127687.9
"NeatBench 5 - Acceleration: GPU",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",4070,4070,4070
"NVIDIA RTX 4070",4070,4070,4070
"NVIDIA RTX 4070 TI",4070,4070,4070
"NVIDIA RTX 3090",3090,3090,3090
"NVIDIA RTX 4070 TI SUPER",4070,98,4070,98.5,4070,98.3,4070,98.7,4070,98.2,4070,98.1,4070,97.3,4070,98.8
"TensorFlow 2.12 - Device: GPU - Batch Size: 1 - Model: VGG-16",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",1.35,1.37
"NVIDIA RTX 4070 TI",1.36,1.39,1.39
"NVIDIA RTX 3090",1.39,1.37,1.38
"NVIDIA RTX 4070 TI SUPER",1.32,1.32,1.31
"TensorFlow 2.12 - Device: GPU - Batch Size: 1 - Model: AlexNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",13.7,14.13
"NVIDIA RTX 4070",13.91,14.36,13.84
"NVIDIA RTX 4070 TI",14.85,14.72
"NVIDIA RTX 3090",13.87,14.63,13.86,14.92,13.5,15.38,14.6,14.92,13.56,14.57,15.99,13.95,15.5,13.98,13.53
"NVIDIA RTX 4070 TI SUPER",11.96,13.02,12.39,12.85,12.08,12.05,13.13,11.92,12.88,11.88,12.25,12.53,11.46,11.6,11.97
"TensorFlow 2.12 - Device: GPU - Batch Size: 16 - Model: VGG-16",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",1.48,1.48
"NVIDIA RTX 4070",1.49,1.5
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",1.49,1.5,1.49
"NVIDIA RTX 4070 TI SUPER",1.44,1.45,1.45
"TensorFlow 2.12 - Device: GPU - Batch Size: 32 - Model: VGG-16",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",1.5,1.5,1.49
"NVIDIA RTX 4070",1.5,1.5,1.5
"NVIDIA RTX 4070 TI",1.5,1.5
"NVIDIA RTX 3090",1.5,1.5,1.5
"NVIDIA RTX 4070 TI SUPER",1.46,1.46,1.46
"TensorFlow 2.12 - Device: GPU - Batch Size: 64 - Model: VGG-16",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",1.5,1.51,1.5
"NVIDIA RTX 4070 TI",1.5,1.5,1.5
"NVIDIA RTX 3090",1.51,1.51,1.51
"NVIDIA RTX 4070 TI SUPER",1.46,1.46,1.46
"TensorFlow 2.12 - Device: GPU - Batch Size: 16 - Model: AlexNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",31.38,31.47,31.93
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",31.67,31.86,31.58
"NVIDIA RTX 3090",31.98,31.86,32.09
"NVIDIA RTX 4070 TI SUPER",30.98,31.23,31.09
"TensorFlow 2.12 - Device: GPU - Batch Size: 256 - Model: VGG-16",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",1.51,1.51,1.51
"NVIDIA RTX 4070 TI SUPER",1.47,1.47,1.47
"TensorFlow 2.12 - Device: GPU - Batch Size: 32 - Model: AlexNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",33.2,33.5
"NVIDIA RTX 4070",33.64,33.03,33.28
"NVIDIA RTX 4070 TI",33.36,33.3,33.21
"NVIDIA RTX 3090",33.44,33.56,33.6
"NVIDIA RTX 4070 TI SUPER",32.74,32.63,33.26
"TensorFlow 2.12 - Device: GPU - Batch Size: 512 - Model: VGG-16",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",
"NVIDIA RTX 3090",
"NVIDIA RTX 4070 TI SUPER",
"TensorFlow 2.12 - Device: GPU - Batch Size: 64 - Model: AlexNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",34.21,33.82,33.76
"NVIDIA RTX 4070 TI",34.06,34.16,33.95
"NVIDIA RTX 3090",34.08,33.84,33.87
"NVIDIA RTX 4070 TI SUPER",33.64,33.59,33.43
"TensorFlow 2.12 - Device: GPU - Batch Size: 1 - Model: GoogLeNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",12.45,12.78
"NVIDIA RTX 4070",12.73,12.64,12.96
"NVIDIA RTX 4070 TI",12.49,13.09
"NVIDIA RTX 3090",12.71,12.95,12.8
"NVIDIA RTX 4070 TI SUPER",12.28,12.15,12.29
"TensorFlow 2.12 - Device: GPU - Batch Size: 1 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",4.35,4.33,4.33
"NVIDIA RTX 4070 TI",4.3,4.33
"NVIDIA RTX 3090",4.4,4.32,4.32
"NVIDIA RTX 4070 TI SUPER",4.1,4.17,4.15
"TensorFlow 2.12 - Device: GPU - Batch Size: 256 - Model: AlexNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",34.17,34.14,34.16
"NVIDIA RTX 4070",
"NVIDIA RTX 4070 TI",34.68,34.54
"NVIDIA RTX 3090",34.38,34.59,34.41
"NVIDIA RTX 4070 TI SUPER",33.86,33.98,34.02
"TensorFlow 2.12 - Device: GPU - Batch Size: 512 - Model: AlexNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",35.08,35.11
"NVIDIA RTX 4070",35.15,35.21,35.26
"NVIDIA RTX 4070 TI",35.53,35.34
"NVIDIA RTX 3090",35.56,35.58,35.59
"NVIDIA RTX 4070 TI SUPER",35.03,35.04,35
"TensorFlow 2.12 - Device: GPU - Batch Size: 16 - Model: GoogLeNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",15.69,15.61,15.7
"NVIDIA RTX 4070",15.64,15.71,15.63
"NVIDIA RTX 4070 TI",15.61,15.64,15.83
"NVIDIA RTX 3090",15.77,15.65,15.61
"NVIDIA RTX 4070 TI SUPER",15.25,15.31,15.3
"TensorFlow 2.12 - Device: GPU - Batch Size: 16 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",5.45,5.46
"NVIDIA RTX 4070",5.45,5.53,5.48
"NVIDIA RTX 4070 TI",5.45,5.47,5.46
"NVIDIA RTX 3090",5.5,5.49,5.49
"NVIDIA RTX 4070 TI SUPER",5.32,5.36,5.28
"TensorFlow 2.12 - Device: GPU - Batch Size: 32 - Model: GoogLeNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",15.62,15.59
"NVIDIA RTX 4070",15.67,15.58,15.64
"NVIDIA RTX 4070 TI",15.87,15.79,15.78
"NVIDIA RTX 3090",15.61,15.79,15.61
"NVIDIA RTX 4070 TI SUPER",14.99,15.14,15.2
"TensorFlow 2.12 - Device: GPU - Batch Size: 32 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",5.52,5.49
"NVIDIA RTX 4070",5.54,5.56
"NVIDIA RTX 4070 TI",5.47,5.49,5.54
"NVIDIA RTX 3090",5.57,5.54,5.59
"NVIDIA RTX 4070 TI SUPER",5.35,5.35,5.36
"TensorFlow 2.12 - Device: GPU - Batch Size: 64 - Model: GoogLeNet",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",
"NVIDIA RTX 4070",15.63,15.41,15.57
"NVIDIA RTX 4070 TI",15.44,15.56
"NVIDIA RTX 3090",15.66,15.48,15.76
"NVIDIA RTX 4070 TI SUPER",15.17,14.97,14.86
"TensorFlow 2.12 - Device: GPU - Batch Size: 64 - Model: ResNet-50",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",5.56,5.53
"NVIDIA RTX 4070",5.54,5.55,5.55
"NVIDIA RTX 4070 TI",5.52,5.53
"NVIDIA RTX 3090",5.55,5.58,5.58
"NVIDIA RTX 4070 TI SUPER",5.29,5.35,5.34
"Libplacebo 5.229.1 - Test: deband_heavy",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",2190.14,2187.52,2182.45
"NVIDIA RTX 4070",1847.82,1848.08,1848.03
"NVIDIA RTX 4070",1843.85,1844.03,1844.36
"NVIDIA RTX 4070",1843.25,1843.06,1843.46
"NVIDIA RTX 4070 TI",2307.02,2305.58,2307.42
"NVIDIA RTX 4070 TI",2307.03,2305.76,2306.88
"NVIDIA RTX 3090",2027.1,2010.37,2015.77
"NVIDIA RTX 3090",2021.71,2012.57,2013.52
"NVIDIA RTX 3090",2030.27,2020.56,2023.01
"NVIDIA RTX 3090",2026.23,2018.09,2016.16
"NVIDIA RTX 4070 TI SUPER",2497.71,2490.78,2491.38
"NVIDIA RTX 4070 TI SUPER",2495.86,2494.65,2497.25
"Libplacebo 5.229.1 - Test: polar_nocompute",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",2327.68,2327.09,2327.88
"NVIDIA RTX 4070",1973.09,1972.55,1972.7
"NVIDIA RTX 4070",1969.15,1968.7,1969.71
"NVIDIA RTX 4070",1968.38,1968.38,1968.36
"NVIDIA RTX 4070 TI",2461.41,2460.71,2461.57
"NVIDIA RTX 4070 TI",2455.75,2459.86,2461.47
"NVIDIA RTX 3090",2133.38,2117.6,2108.69
"NVIDIA RTX 3090",2122.7,2112.37,2114.44
"NVIDIA RTX 3090",2125.46,2132.67,2120.8
"NVIDIA RTX 3090",2125.34,2110.26,2114.77
"NVIDIA RTX 4070 TI SUPER",2645.99,2647.3,2646.82
"NVIDIA RTX 4070 TI SUPER",2652.35,2656.67,2650.06
"Libplacebo 5.229.1 - Test: hdr_peakdetect",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",3293.52,3285.55,3298.05
"NVIDIA RTX 4070",3300.65,3333.37,3296.05
"NVIDIA RTX 4070",3315.33,3301.47,3740.5
"NVIDIA RTX 4070",3306.52,3307.94,3373.31
"NVIDIA RTX 4070 TI",3344.69,3647.85,3641.26
"NVIDIA RTX 4070 TI",3806.33,3319.59,3299.26
"NVIDIA RTX 3090",4911.8,5051,5028.44
"NVIDIA RTX 3090",5122.53,5113.06,5076.71
"NVIDIA RTX 3090",4861.53,5115.49,4932.21
"NVIDIA RTX 3090",5102.22,5062.79,5002.62
"NVIDIA RTX 4070 TI SUPER",3890.66,3918.44,3985.61
"NVIDIA RTX 4070 TI SUPER",3907.16,3939.77,3893.09
"Libplacebo 5.229.1 - Test: hdr_lut",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",3912.81,3882.47,3922.66
"NVIDIA RTX 4070",3907.01,3936.18,3938.13
"NVIDIA RTX 4070",3940.12,3940.88,3940.19
"NVIDIA RTX 4070",3943.88,3937.52,3959.3
"NVIDIA RTX 4070 TI",3961.41,3980.12,3973.29
"NVIDIA RTX 4070 TI",4002.73,3908.61,4016.79
"NVIDIA RTX 3090",3286.36,3322.96,3330.46
"NVIDIA RTX 3090",3351.87,3357.49,3421.2
"NVIDIA RTX 3090",3292.52,3360.68,3348.12
"NVIDIA RTX 3090",3318.8,3360.54,3430.29
"NVIDIA RTX 4070 TI SUPER",3820.36,3836.08,3880.09
"NVIDIA RTX 4070 TI SUPER",3851.95,3819.01,3795.51
"Libplacebo 5.229.1 - Test: av1_grain_lap",
Higher Results Are Better
"NVIDIA RTX 4070 SUPER",4167.38,4181.85,4163.77
"NVIDIA RTX 4070",3970.65,4158.56,4180.98
"NVIDIA RTX 4070",4221.43,4173.29,3984.47
"NVIDIA RTX 4070",4120.53,4163.36,4173.34
"NVIDIA RTX 4070 TI",4127.52,4111.86,4183.24
"NVIDIA RTX 4070 TI",4073.41,4182.75,4175.72
"NVIDIA RTX 3090",4130.65,4147.26,4102.75
"NVIDIA RTX 3090",4128.24,4011.73,4149.48
"NVIDIA RTX 3090",4106.12,4099.96,4154.73
"NVIDIA RTX 3090",4161.17,4116.9,4023.01
"NVIDIA RTX 4070 TI SUPER",4079.42,4111.22,3981.58
"NVIDIA RTX 4070 TI SUPER",4092.3,4094.6,3947.25
"NCNN 20230517 - Target: Vulkan GPU - Model: mobilenet",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",6.71,8.67,8.04,8.83,11.71,8.74,8.78,7.23,8.84
"NVIDIA RTX 4070",6.58,7.11,7.24,7.09,8.21,30.07,8.68,8.26,8.03
"NVIDIA RTX 4070",8.25,7.44,6.59,6.83,6.8,6.58,6.65,6.75,7.75,6.27,8.15,8.3
"NVIDIA RTX 4070 TI",7.68,6.57,8.16,6.83,8.83,8.03,6.66,15.96,7.15
"NVIDIA RTX 4070 TI",9.95,6.98,7.09,7.1,6.94,7.48,7.38,8.1,6.95,7.54,6.91,6.96
"NVIDIA RTX 3090",6.51,7.64,7.23,6.79,36.91,7.32
"NVIDIA RTX 3090",6.48,6.68,7.16,8.29,6.11,7.35,6.17,7.14,6.87
"NVIDIA RTX 3090",7.16,7.2,7.45
"NVIDIA RTX 4070 TI SUPER",6.37,6.24,6.22
"NVIDIA RTX 4070 TI SUPER",8.43,8.41,7.17,6.54,6.69,6.97,7.55,7.4,6.5,7.24,8.53,8.33
"NCNN 20230517 - Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",2.58,2.6,2.46,2.5,2.57,2.49,2.82,6.5,2.72
"NVIDIA RTX 4070",2.5,2.44,23.52,2.41,2.23,2.76,1.93,2.45,1.99
"NVIDIA RTX 4070",2.04,2.36,2.8,2.29,2.41,2.68,2.55,2.4,2.77,2.25,2.49,2.69
"NVIDIA RTX 4070 TI",2.44,2.12,2.24,2.74,2.48,2.39,2.76,2.3,2.44
"NVIDIA RTX 4070 TI",2.51,2.72,2.81,2.46,2.24,2.47,2.5,2.79,2.47,2.69,2.67,2.09
"NVIDIA RTX 3090",2.51,2.72,2.47,2.26,2.76,3.19
"NVIDIA RTX 3090",2.47,2.76,2.8,2.48,2.78,2.82,2.47,2.69,2.74
"NVIDIA RTX 3090",2.46,2.05,2.51
"NVIDIA RTX 4070 TI SUPER",2.58,2.27,2.41
"NVIDIA RTX 4070 TI SUPER",2.77,2.78,2.48,2.71,2.73,2.8,2.68,2.77,2.44,2.76,2.73,2.73
"NCNN 20230517 - Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",2.06,2.02,1.98,2.38,3.35,2.61,1.98,1.78,2.09
"NVIDIA RTX 4070",1.85,56.11,1.96,1.8,2.44,1.8,1.99,1.74
"NVIDIA RTX 4070",2.44,1.93,2.5,1.82,1.95,2.06,2.45,1.96,2.45,1.84,2,2.39
"NVIDIA RTX 4070 TI",1.79,1.97,1.81,2.47,2,1.97,2.45,1.93,2.4
"NVIDIA RTX 3090",2.52,1.98,1.84,1.99,1.95,8.86
"NVIDIA RTX 3090",2,1.93,2.5,2.03,2.49,2.43,2,2.46,1.96
"NVIDIA RTX 3090",1.8,2.4,2.42
"NVIDIA RTX 4070 TI SUPER",1.88,1.84,1.9
"NVIDIA RTX 4070 TI SUPER",1.95,1.86,1.84,2.42,2.51,2.43,2.37,2.43,2.03,1.85,2.42,1.8
"NCNN 20230517 - Target: Vulkan GPU - Model: shufflenet-v2",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",1.82,1.92,2,2.41,1.81,1.89,1.95,4.66
"NVIDIA RTX 4070",2.42,1.88,1.84,2.46,2.47,1.89,1.79
"NVIDIA RTX 4070",1.89,1.85,2.47,1.84,1.86,1.9,2.44,1.86,2.49,1.9,2.42
"NVIDIA RTX 4070 TI",1.89,1.87,1.87,1.91,1.86,2.53,1.87,2.41
"NVIDIA RTX 4070 TI",2.48,2.42,2.46,1.89,1.92,1.92,1.9,1.8,1.85,1.84,1.86,1.75
"NVIDIA RTX 3090",2.43,1.9,1.86,1.88,1.88,15.06
"NVIDIA RTX 3090",1.91,1.88,1.85,1.93,2.51,2.47,1.9,2.48,1.86
"NVIDIA RTX 3090",1.82,1.83,2.46
"NVIDIA RTX 4070 TI SUPER",2.42,1.86,1.87
"NVIDIA RTX 4070 TI SUPER",1.88,1.87,2.45,2.49,2.45,2.4,2.42,1.87,1.87,1.87,1.85
"NCNN 20230517 - Target: Vulkan GPU - Model: mnasnet",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",2.39,2.27,2.19,4.92,14.02,2.53,2.2,1.91,2.21
"NVIDIA RTX 4070",2.07,2.49,2.17,2.01,2.47,2.45,2.22,1.85
"NVIDIA RTX 4070",2.23,2.15,2.54,2.01,2.18,2.27,2.19,2.48,2.09,2.24
"NVIDIA RTX 4070 TI",2.3,2.18,2.17,2.51,2.25,2.21,2.48,2.16,2.43
"NVIDIA RTX 4070 TI",2.46,2.46,2.51,2.17,2.23,25.45,2.18,1.96,2.14,2.05,2.02,2.01
"NVIDIA RTX 3090",2.19,2.21,2.09,2.22,2.48
"NVIDIA RTX 3090",2.24,2.15,2.02,2.32,2.55,2.46,2.24,2.56,2.2
"NVIDIA RTX 3090",2.02,2.02,2.45
"NVIDIA RTX 4070 TI SUPER",2.46,2.03,2.13
"NVIDIA RTX 4070 TI SUPER",2.17,2.03,2.02,2.48,2.6,2.44,2.42,2.5,2.2,2.04,2.16,2
"NCNN 20230517 - Target: Vulkan GPU - Model: efficientnet-b0",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",3.71,3.47,3.53,7.12,4.88,12.17,3.47,3.78,3.47
"NVIDIA RTX 4070",3.46,3.71,3.6,3.42,3.18,3.67,3.67,3.46,2.93
"NVIDIA RTX 4070",3.04,3.38,3.38,3.24,3.4,3.49,3.74,3.41,5.71,3.26,3.44,3.62
"NVIDIA RTX 4070 TI",3.19,3.43,3.41,3.71,3.52,3.45,3.69,3.39,3.64
"NVIDIA RTX 4070 TI",3.85,3.68,3.77,3.4,3.49,3.72,3.46,3.15,3.38,3.24,3.23,3.2
"NVIDIA RTX 3090",3.44,3.32,10,3.49,3.43,59.54
"NVIDIA RTX 3090",3.45,3.41,3.21,3.5,3.85,3.72,3.44,3.83,3.42
"NVIDIA RTX 3090",3.16,3.18,3.68
"NVIDIA RTX 4070 TI SUPER",3.46,3.23,3.39
"NVIDIA RTX 4070 TI SUPER",3.48,3.21,3.2,3.73,3.82,3.69,3.62,3.71,3.42,3.26,3.41,3.2
"NCNN 20230517 - Target: Vulkan GPU - Model: blazeface",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",0.97,0.66,0.98,0.82,0.77,0.73,0.81,0.94,0.91
"NVIDIA RTX 4070",0.79,0.95,0.91,0.81,0.76,0.93,0.91,0.81,0.65
"NVIDIA RTX 4070 TI",0.8,0.63,0.8,0.8,0.93,0.8,0.81,0.8,0.89
"NVIDIA RTX 4070 TI",0.95,0.93,0.93,0.81,0.84,0.65,0.81,0.75,0.91,0.76,0.75,0.79
"NVIDIA RTX 3090",0.82,0.92,0.73,0.81,0.93,0.93
"NVIDIA RTX 3090",0.82,0.81,0.75,0.93,0.64,0.91,0.82,0.93,0.92
"NVIDIA RTX 3090",0.75,0.94,0.91
"NVIDIA RTX 4070 TI SUPER",0.89,0.76,0.94
"NVIDIA RTX 4070 TI SUPER",0.92,0.76,0.75,0.89,0.96,0.91,0.9,0.8,0.81,0.93,0.93,0.94
"NCNN 20230517 - Target: Vulkan GPU - Model: googlenet",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",9.16,12.56,6.73,14.25,9.34,11.73,5.98,12.18,17.43
"NVIDIA RTX 4070",6.02,6.52,6.43,5.78,5.54,6.41,6.45,6.01,5.35
"NVIDIA RTX 4070 TI",5.23,5.26,5.83,5.91,6.48,5.91,5.95,5.84,6.4
"NVIDIA RTX 4070 TI",17.54,6.44,6.56,5.81,6.02,5.38,5.83,5.51,6.3,5.61,11.51,5.87
"NVIDIA RTX 3090",5.57,6.49,5.85,12.42,8.07,6.51
"NVIDIA RTX 3090",5.94,5.78,5.49,6.89,5.29,6.43,5.96,6.69,6.53
"NVIDIA RTX 3090",5.51,6.57,6.35
"NVIDIA RTX 4070 TI SUPER",6.17,5.88,6.7
"NVIDIA RTX 4070 TI SUPER",6.18,5.88,5.73,6.62,7.06,6.75,6.68,6.2,6.39,6.72,6.92,6.38
"NCNN 20230517 - Target: Vulkan GPU - Model: vgg16",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",30.54,18.57,167.34,20.22,133.86,237.14,65.45,144.07,243.12
"NVIDIA RTX 4070",18.34,18.34,117.07,170.66,18.61,18.2,17.83,93.46,18.37
"NVIDIA RTX 4070",107.46,161.98,18.26,18.93,46.26,18.56,67.37,33.63,17.78,18.44,19.31,18.31
"NVIDIA RTX 4070 TI",19,31.56,18.87,18.95,18.76,125.8,18.96,19.12,17.43
"NVIDIA RTX 4070 TI",19.05,18.89,27.7,100.84,19.24,18.34,17.69,50.48,17.8,17.43,18.72,87.67
"NVIDIA RTX 3090",133.04,206.69,213.11,74.03,112.03,135.44
"NVIDIA RTX 3090",18.48,18.57,19.6,18.71,18.57,19.05,18.88,69.95,18.2
"NVIDIA RTX 3090",18.17,18.08,17.39
"NVIDIA RTX 4070 TI SUPER",21.41,21.8,22.08
"NVIDIA RTX 4070 TI SUPER",51.31,22.48,22.64,22.09,22.96,22.81,22.37,21.76,22.15,21.78,23.06,22.73
"NCNN 20230517 - Target: Vulkan GPU - Model: resnet18",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",4.16,4.26,4.24,4.1,34.39,4.12,4.15,4.07,17.24
"NVIDIA RTX 4070",4.34,16.07,4,31.91,4.12,4.2,4.22,4.29,4.04
"NVIDIA RTX 4070",4.16,4.1,7.59,4.08,4.01,4.2,4.21,4.15,4.06,4.04,12.48,4.24
"NVIDIA RTX 4070 TI",4.04,3.96,4.14,4.2,4.24,16.12,4.22,4.13,4.2
"NVIDIA RTX 4070 TI",4.32,15.68,4.26,4.2,11.33,4.28,22.67,4.26,4.4,9.38,3.98,4.12
"NVIDIA RTX 3090",38.03,27.98,4.32,4.24,25.51,4.4
"NVIDIA RTX 3090",4.45,4.14,4.46,18.76,4.07,4.16,4.42,4.17,31.83
"NVIDIA RTX 3090",4.16,3.98,4.22
"NVIDIA RTX 4070 TI SUPER",4.77,4.49,4.65
"NVIDIA RTX 4070 TI SUPER",4.49,4.55,4.49,4.57,12.31,4.63,17.28,4.38,4.76,4.59,20.47,4.47
"NCNN 20230517 - Target: Vulkan GPU - Model: alexnet",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",3.75,21.55,3.67,3.91,16.35,3.77,50.42,38.49,3.62
"NVIDIA RTX 4070",3.71,29.43,28.51,3.53,3.64,3.85,3.7,3.79,3.83
"NVIDIA RTX 4070",3.67,3.7,24.02,3.71,3.72,3.74,3.62,8.3,3.68,3.68,3.85,3.65
"NVIDIA RTX 4070 TI",3.63,3.74,3.8,3.65,3.8,3.7,3.88,3.74,3.71
"NVIDIA RTX 4070 TI",3.75,3.85,3.81,3.85,3.69,3.65,31.75,3.76,3.66,3.7,3.75,3.65
"NVIDIA RTX 3090",3.69,3.64,3.76,3.74,3.61,3.69
"NVIDIA RTX 3090",3.76,3.61,3.83,3.7,3.61,3.69,11.53,3.79,18.29
"NVIDIA RTX 3090",3.76,3.46,3.58
"NVIDIA RTX 4070 TI SUPER",4.41,4.33,4.4
"NVIDIA RTX 4070 TI SUPER",4.37,4.42,4.47,4.48,4.35,4.43,4.31,4.35,4.42,4.44,4.36,4.52
"NCNN 20230517 - Target: Vulkan GPU - Model: resnet50",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",91.23,8.39,7.93,43.8,136.18,36.64,63.96,19.6,8.65
"NVIDIA RTX 4070",8.18,8,8,8.49,8.62,8.19,8.09,8.69,7.91
"NVIDIA RTX 4070",8.12,8.66,8,14.02,8.04,8.62,8.06,8.01,8.19,7.99,8.41,8.57
"NVIDIA RTX 4070 TI",8.33,8.56,27.53,8.07,8.05,8.09,8.35,8.3,43.56
"NVIDIA RTX 4070 TI",8.1,8.41,8.13,56.23,8.33,8.16,8.03,8.71,8.23,8.04,8.21,8.39
"NVIDIA RTX 3090",8.46,7.91,29.4,31.51,8.61,80.73
"NVIDIA RTX 3090",8.25,8.02,8.87,8.16,7.81,8.5,7.73,8.07,8.37
"NVIDIA RTX 3090",21.91,8.2,7.99
"NVIDIA RTX 4070 TI SUPER",8.44,9,8.29
"NVIDIA RTX 4070 TI SUPER",8.66,8.89,9.34,8.58,8.49,8.75,8.74,8.72,8.78,8.66,8.91,8.91
"NCNN 20230517 - Target: Vulkan GPU - Model: yolov4-tiny",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",46.11,54.03,67.21,115.11,32.73,90.4,11.24,85.56,71.99
"NVIDIA RTX 4070",10.77,10.9,11.25,29.56,11.04,10.92,20.08,45.34,76.11
"NVIDIA RTX 4070",41.45,11.53,10.83,10.95,10.9,10.82,10.8,11.2,12.01,10.4,41.39,66.61
"NVIDIA RTX 4070 TI",11.72,10.79,25.3,10.72,31.99,19.39,10.83,16.6,10.91
"NVIDIA RTX 4070 TI",45.25,10.97,10.82,11.04,10.86,11.82,11.46,28.79,10.98,11.62,21.98,10.87
"NVIDIA RTX 3090",42.67,30.8,11.38,30.27,11,34.95
"NVIDIA RTX 3090",10.75,11.08,10.92,33.43,10.37,11.23,10.24,10.89,10.89
"NVIDIA RTX 3090",10.9,11.34,11.64
"NVIDIA RTX 4070 TI SUPER",11.24,20.54,11.01
"NVIDIA RTX 4070 TI SUPER",11.69,22.82,11.68,11.34,11.64,11.78,12.34,11.67,11.39,11.8,66.48,11.77
"NCNN 20230517 - Target: Vulkan GPU - Model: squeezenet_ssd",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",4.65,4.98,4.58,5.86,20.85,5.23,5.36,4.52,5.73
"NVIDIA RTX 4070",5.26,4.99,4.76,5.81,5.97,5.25,4.95,5.87,4.6
"NVIDIA RTX 4070",5.7,6.09,5.05,4.74,5.1,5.21,4.82,4.74,4.94,5.08,5,5.63
"NVIDIA RTX 4070 TI",5.26,5.77,4.58,5.08,4.84,4.82,7.52,5.27,5.07
"NVIDIA RTX 4070 TI",5.33,5.48,5.17,4.79,16.3,5.14,5.08,5.34,5.27,4.78,5.22,5.6
"NVIDIA RTX 3090",5.14,4.49,14.41,4.88,5.9,4.98
"NVIDIA RTX 3090",5.32,5.04,6.08,5.17,4.46,5.85,4.4,4.79,5.71
"NVIDIA RTX 3090",4.53,5.17,5.01
"NVIDIA RTX 4070 TI SUPER",4.67,6.18,4.47
"NVIDIA RTX 4070 TI SUPER",4.76,5.29,6.36,4.8,4.69,5.43,4.98,5.41,5.17,4.9,5.23,5.26
"NCNN 20230517 - Target: Vulkan GPU - Model: regnety_400m",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",7.03,6.49,35.18,8.05,5.79,5.79,5.9,18.27,7.48
"NVIDIA RTX 4070",5.68,7.26,5.7,7.41,7.28,7.38,5.7,5.62
"NVIDIA RTX 4070",5.72,5.62,5.56,7.36,7.41,5.71,7.31,5.58,5.64,5.58,5.71,7.26
"NVIDIA RTX 4070 TI",5.63,5.53,5.57,5.62,7.26,5.67,5.64,5.59,7.2
"NVIDIA RTX 4070 TI",5.63,7.24,7.21,5.68,5.79,5.47,5.76,5.53,5.59,5.59,5.54,5.65
"NVIDIA RTX 3090",5.74,8.89,5.61,13.36,7.33,7.42
"NVIDIA RTX 3090",5.69,5.66,7.34,5.47,7.34,5.64,7.29,7.34
"NVIDIA RTX 3090",5.48,7.36,7.35
"NVIDIA RTX 4070 TI SUPER",7.39,5.58,7.35
"NVIDIA RTX 4070 TI SUPER",5.64,5.48,5.58,7.24,7.47,7.25,7.26,5.6,5.66,7.43,7.27,7.25
"NCNN 20230517 - Target: Vulkan GPU - Model: vision_transformer",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",1086.31,978.79,718.1,837.75,1299.4,780.17,525.9,908.09,466.99
"NVIDIA RTX 4070",70.39,133.95,604.29,256.07,361.64,338.49,128.91,498.4,141.9
"NVIDIA RTX 4070",516.71,390.67,436.58,78.41,499.17,732.17,352.41,690.35,177.17,235.53,271.6,213.09
"NVIDIA RTX 4070 TI",374.03,277.63,363.13,494.07,344.48,490.34,457.75,311.6,398.59
"NVIDIA RTX 4070 TI",523.53,610.14,606.83,273.33,533.63,547.74,871.17,453.42,724.41,196.49,404.59,226.58
"NVIDIA RTX 3090",700.6,656.62,848.59,875.16,402.39,496.09
"NVIDIA RTX 3090",329.44,167.29,360.25,329.36,204.8,411.23,439.39,616.93,91.68
"NVIDIA RTX 3090",430.2,275.63,357.88
"NVIDIA RTX 4070 TI SUPER",457.7,413.56,843.32
"NVIDIA RTX 4070 TI SUPER",542.26,422.49,74.35,416.45,580.71,106.74,580.19,383.78,122.15,264.36,79.92,171.74
"NCNN 20230517 - Target: Vulkan GPU - Model: FastestDet",
Lower Results Are Better
"NVIDIA RTX 4070 SUPER",2.45,2.44,5.08,2.8,3.19,2.46,2.52,2.44,2.32
"NVIDIA RTX 4070",2.02,2.31,2.36,2.12,3.03,2.42,2.33,2.42,2.05
"NVIDIA RTX 4070",3,3.02,2.08,2.06,3.08,2.39,3,3.07,2.12,2.12,3.04,3.01
"NVIDIA RTX 4070 TI",3.16,3.17,2.46,3.07,2.43,3.06,2.99,2.41
"NVIDIA RTX 4070 TI",2.47,2.6,2.16,3.05,5.8,3.11,2.42,2.75,3.1,2.97
"NVIDIA RTX 3090",2.32,2.16,4.6,12.75,13.34,3.12
"NVIDIA RTX 3090",2.97,2.45,2.39,2.6,2.44,2.11,2.51,2.49
"NVIDIA RTX 3090",2.44,2.45,3.06
"NVIDIA RTX 4070 TI SUPER",2.43,3.04,2.16
"NVIDIA RTX 4070 TI SUPER",2.42,2.44,3.02,2.49,2.14,2.13,3.02,2.1,2.96,3.08,2.44,2.32
"vkpeak 20230730 - fp32-scalar",
Higher Results Are Better
"NVIDIA RTX 3090",20335.03,20233.75,20220.6
"NVIDIA RTX 3090",20489.96,20236.07,20233.36
"NVIDIA RTX 3090",20495.02,20246.33,20211.53
"NVIDIA RTX 3090",20601.25,20226.23,20234.38
"NVIDIA RTX 4070 TI SUPER",23924.81,23807.36,23918.42
"NVIDIA RTX 4070 TI SUPER",23931.77,23914.09,23916.16
"vkpeak 20230730 - fp32-vec4",
Higher Results Are Better
"NVIDIA RTX 3090",26565.89,26564.45,26560.82
"NVIDIA RTX 3090",26771.89,26558.49,26561.38
"NVIDIA RTX 3090",27179.89,26563.83,26557.91
"NVIDIA RTX 3090",26973.32,26561.86,26563.79
"NVIDIA RTX 4070 TI SUPER",31634.05,31504.04,31637.04
"NVIDIA RTX 4070 TI SUPER",31634.02,31636.1,31636.3
"vkpeak 20230730 - fp16-scalar",
Higher Results Are Better
"NVIDIA RTX 3090",20011.05,20114.45,20115.91
"NVIDIA RTX 3090",20169.69,20052.25,20117.1
"NVIDIA RTX 3090",20220.61,20130.49,20051.09
"NVIDIA RTX 3090",20220.01,20118.4,20115.9
"NVIDIA RTX 4070 TI SUPER",23789.86,23790.39,23894.9
"NVIDIA RTX 4070 TI SUPER",23894.94,23894.87,23894.28
"vkpeak 20230730 - fp16-vec4",
Higher Results Are Better
"NVIDIA RTX 3090",39632.57,39843.34,39840
"NVIDIA RTX 3090",39939.49,39727.63,39838.5
"NVIDIA RTX 3090",39885.84,39627.98,39726.91
"NVIDIA RTX 3090",39885.84,39844.19,39852.36
"NVIDIA RTX 4070 TI SUPER",47147.73,47088.91,47341.03
"NVIDIA RTX 4070 TI SUPER",47340.19,47340.64,47340.72
"vkpeak 20230730 - fp64-scalar",
Higher Results Are Better
"NVIDIA RTX 3090",638.72,638.64,638.74
"NVIDIA RTX 3090",638.74,638.8,638.72
"NVIDIA RTX 3090",638.75,638.81,638.74
"NVIDIA RTX 3090",638.73,638.87,638.92
"NVIDIA RTX 4070 TI SUPER",750.48,750.44,750.48
"NVIDIA RTX 4070 TI SUPER",750.48,750.5,750.48
"vkpeak 20230730 - fp64-vec4",
Higher Results Are Better
"NVIDIA RTX 3090",638.74,638.69,638.73
"NVIDIA RTX 3090",
"NVIDIA RTX 3090",638.78,640.97,638.82
"NVIDIA RTX 3090",638.74,638.73,638.74
"NVIDIA RTX 4070 TI SUPER",749.76,749.76,749.75
"NVIDIA RTX 4070 TI SUPER",749.78,751.12,751.14
"vkpeak 20230730 - int32-scalar",
Higher Results Are Better
"NVIDIA RTX 3090",20283.61,20283.47,20273.92
"NVIDIA RTX 3090",20315.62,20296.29,20259
"NVIDIA RTX 3090",20348.61,20298.02,20298.66
"NVIDIA RTX 3090",20298.81,20290.8,20296.19
"NVIDIA RTX 4070 TI SUPER",23875.5,23874.24,23874.82
"NVIDIA RTX 4070 TI SUPER",23888.15,23888.01,23887.89
"vkpeak 20230730 - int32-vec4",
Higher Results Are Better
"NVIDIA RTX 3090",19992.26,19998.88,19999.62
"NVIDIA RTX 3090",20048.99,20001.29,20000.91
"NVIDIA RTX 3090",20024.3,20048.82,19943.43
"NVIDIA RTX 3090",20022.87,20006.2,20000.12
"NVIDIA RTX 4070 TI SUPER",23766.58,23663.81,23769.52
"NVIDIA RTX 4070 TI SUPER",23769.59,23768.89,23766.34
"vkpeak 20230730 - int16-scalar",
Higher Results Are Better
"NVIDIA RTX 3090",13259.55,13260.22,13260.13
"NVIDIA RTX 3090",13294.2,13263.63,13262.75
"NVIDIA RTX 3090",13270.57,13191.62,13213.32
"NVIDIA RTX 3090",13270.57,13261.83,13262.33
"NVIDIA RTX 4070 TI SUPER",15836.2,15837.17,15904.73
"NVIDIA RTX 4070 TI SUPER",15901.71,15899.87,15902.39
"vkpeak 20230730 - int16-vec4",
Higher Results Are Better
"NVIDIA RTX 3090",16328.62,16333.89,16330.98
"NVIDIA RTX 3090",16357.28,16330.4,16327
"NVIDIA RTX 3090",16335.89,16326.55,16245.29
"NVIDIA RTX 3090",16330.85,16327.19,16331.12
"NVIDIA RTX 4070 TI SUPER",21126.69,21127.5,21118.07
"NVIDIA RTX 4070 TI SUPER",21155.83,21160.15,21155