AMD EPYC Genoa Memory Scaling

Benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2212240-NE-AMDEPYCGE62
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
BLAS (Basic Linear Algebra Sub-Routine) Tests 3 Tests
C++ Boost Tests 2 Tests
Timed Code Compilation 11 Tests
C/C++ Compiler Tests 10 Tests
CPU Massive 15 Tests
Creator Workloads 14 Tests
Database Test Suite 2 Tests
Encoding 4 Tests
Fortran Tests 5 Tests
Game Development 5 Tests
HPC - High Performance Computing 21 Tests
Java Tests 2 Tests
LAPACK (Linear Algebra Pack) Tests 2 Tests
Machine Learning 5 Tests
Molecular Dynamics 5 Tests
MPI Benchmarks 5 Tests
Multi-Core 30 Tests
NVIDIA GPU Compute 4 Tests
Intel oneAPI 6 Tests
OpenMPI Tests 13 Tests
Programmer / Developer System Benchmarks 13 Tests
Python Tests 11 Tests
Renderers 3 Tests
Scientific Computing 7 Tests
Server 4 Tests
Server CPU Tests 11 Tests
Video Encoding 3 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
12c
December 21 2022
  11 Hours, 55 Minutes
10c
December 21 2022
  12 Hours, 59 Minutes
8c
December 22 2022
  13 Hours, 22 Minutes
6c
December 23 2022
  15 Hours, 14 Minutes
Invert Hiding All Results Option
  13 Hours, 22 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

AMD EPYC Genoa Memory Scaling, "Xcompact3d Incompact3d 2021-03-11 - Input: X3D-benchmarking input.i3d", Lower Results Are Better "12c",125.364716,125.815216,125.398811 "10c",146.506241,146.159225,146.204025 "8c",289.631989,275.565094,264.7435,266.645569,264.740479,265.961212,268.369049,265.424347,269.740204 "6c",386.346436,344.343323,343.544403,339.781708,341.533264,343.363892,343.149963,348.633667,349.223572 "OpenFOAM 10 - Input: drivaerFastback, Medium Mesh Size - Execution Time", Lower Results Are Better "12c", "10c", "8c", "6c", "RELION 3.1.1 - Test: Basic - Device: CPU", Lower Results Are Better "12c",133.625,126.81,126.587,126.669,126.816 "10c",156.987,149.685,149.343,149.578 "8c",227.084,218.655,218.268 "6c",270.994,257.226,258.005,256.815,254.179,253.782 "WRF 4.2.2 - Input: conus 2.5km", Lower Results Are Better "12c", "10c", "8c", "6c", "NAS Parallel Benchmarks 3.4 - Test / Class: MG.C", Higher Results Are Better "12c",213836.16,210144.63,205559.5 "10c",191483.92,170082.76,159878.34,169828.79,188858.09,168437.33,191708.82,183051.04,189622.26,167613.69,178850.53,179801.31,170646.58,167897.69,178700.09 "8c",149901.65,170657.02,157013.67,155533.51,159823.08,145908.32,154170.61,161533.96,156483.13,153237.15,158451.24,141122.67,145062.77,152606.87,140375.98 "6c",110138,115549.74,106678.44,126886.35,114642.1,113385.16,117570.12,123337.79,122877.75,109312.7,116296.62,124159.77,124840.55,123653.69,116674.76 "NAS Parallel Benchmarks 3.4 - Test / Class: SP.C", Higher Results Are Better "12c",259149.43,263636.68,258628.4 "10c",238190.76,240700.95,239596.31 "8c",207568.79,211715.33,206321.57 "6c",163964.08,168283.3,170176.73 "Graph500 3.0 - Scale: 26", Higher Results Are Better "12c", "10c", "8c", "6c", "Neural Magic DeepSparse 1.1 - Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "12c",112.0327,111.8127,111.8273 "10c",113.4287,113.2566,113.5385 "8c",124.1817,123.853,123.538 "6c",137.9888,146.6166,151.1724,145.1177,144.8395,150.5013,156.4446,149.5914,145.3931,156.7924,156.5488,155.0869,153.4155,160.4153,153.8255 "Neural Magic DeepSparse 1.1 - Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "12c",854.8901,856.6703,856.4954 "10c",844.4231,845.347,843.5104 "8c",770.9065,773.1707,775.1287 "6c",693.7884,652.7564,632.9394,659.0345,660.6301,635.9965,611.8541,639.3689,658.4619,610.3628,611.2395,616.9618,623.5255,596.387,622.0616 "Neural Magic DeepSparse 1.1 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "12c",125.7135,125.9192,125.526 "10c",128.6034,128.3922,129.7791 "8c",135.6925,134.9241,136.247 "6c",149.8309,154.5227,170.3707,171.479,168.3077,170.6165,171.3424,173.5039,164.9259,167.7077,165.6472,166.3935,170.8411,164.4483,166.5454 "Neural Magic DeepSparse 1.1 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "12c",761.6599,760.1594,762.6367 "10c",744.626,745.733,738.0279 "8c",705.3491,709.5396,702.246 "6c",638.9572,619.0708,561.5807,558.2167,568.688,560.9155,558.1649,551.5122,579.9896,570.318,577.5724,574.9192,560.1433,581.8311,574.3973 "nekRS 22.0 - Input: TurboPipe Periodic", Higher Results Are Better "12c",803114000000,835244000000,826028000000 "10c",771416000000,797983000000,789375000000 "8c",736030000000,732825000000,751886000000 "6c",659093000000,656459000000,663111000000 "OpenVINO 2022.3 - Model: Machine Translation EN To DE FP16 - Device: CPU", Lower Results Are Better "12c",49.74,50.11,50.1 "10c",51.41,51.14,51.32 "8c",54.05,55.07,57.49,53.85,53.99,54.32 "6c",58.6,58.06,59.35 "OpenVINO 2022.3 - Model: Machine Translation EN To DE FP16 - Device: CPU", Higher Results Are Better "12c",963.81,956.85,956.83 "10c",932.42,937.49,934.23 "8c",887.05,870.47,833.86,890.35,888.02,882.59 "6c",818.19,825.68,807.93 "TensorFlow 2.10 - Device: CPU - Batch Size: 256 - Model: ResNet-50", Higher Results Are Better "12c",108.84,108.47,110.07 "10c",105.78,105.37,106.58 "8c",105.44,104.05,105.53 "6c",95.87,95.16,95.99 "GPAW 22.1 - Input: Carbon Nanotube", Lower Results Are Better "12c",22.914,24.064,23.093,22.782,22.901 "10c",23.257,23.228,23.635 "8c",24.371,24.957,24.465 "6c",26.664,26.27,25.99 "NAS Parallel Benchmarks 3.4 - Test / Class: CG.C", Higher Results Are Better "12c",78106.18,85148.78,83422.33,79293.25,80626.51,75877.66,81968.89,76909.82,83063.47,82327.42,79181.84,77773.67,80396.24,74881.92,84397.23 "10c",81409.12,75035.84,81811.44,77539.53,83694.9,82470.65,84927.74,82732.05,85505.4,82256.08,74809.56,84414.69,83082.72,81241.07,76754.14 "8c",81546.74,73259.11,77387.39,84716.26,86607.69,76123.95,76443.01,80767.05,80714.84,77111.12,80446.1,82451.74,77210.41,81214.34,80762.45 "6c",72648.63,71608.84,70729.36 "7-Zip Compression 22.01 - Test: Compression Rating", Higher Results Are Better "12c",933740,924853,910936 "10c",895949,888273,896078 "8c",886833,874258,877198 "6c",834055,810511,830212 "OpenVKL 1.3.1 - Benchmark: vklBenchmark ISPC", Higher Results Are Better "12c",1337,1325,1313 "10c",1269,1290,1341,1358,1356,1345,1292,1297,1305 "8c",1342,1312,1322 "6c",1239,1185,1211 "oneDNN 3.0 - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU", Lower Results Are Better "12c",2236.84,2320.22,2270.53 "10c",2300.52,2266,2446.27,2388.9,2273.56,2507.39,2277.98,2369.24,2266.25,2187.66,2233.3,2257.38,2240.62,2466.85,2403.76 "8c",2440.08,2399.66,2277.89,2287.41,2481.73,2324.02,2521.8,2283.61,2361.97,2431.88,2251.46,2314.98,2567.52,2335.91,2296.72 "6c",2533.9,2439.87,2440.95 "NAS Parallel Benchmarks 3.4 - Test / Class: LU.C", Higher Results Are Better "12c",486629.4,505131.78,480215.4,484682.02 "10c",485308.15,490614.71,494062.74 "8c",486631.13,460519.31,459069.84,461699.41,465928.01 "6c",437653.51,464593.48,454721.2,461634.82,453200.11 "Intel Open Image Denoise 1.4.0 - Run: RTLightmap.hdr.4096x4096", Higher Results Are Better "12c",1.6542761383901,1.6541694167233,1.6463805147573 "10c",1.64014551371,1.6312947586499,1.6263044994967 "8c",1.6268257051476,1.6427644440064,1.6406917812827 "6c",1.5392477388451,1.5437935639246,1.5248063114783 "Intel Open Image Denoise 1.4.0 - Run: RT.hdr_alb_nrm.3840x2160", Higher Results Are Better "12c",3.5355178119387,3.4893418054552,3.5350553766425 "10c",3.4078284635465,3.4771240011961,3.4262533234657 "8c",3.441712871662,3.4518943996465,3.5088211764376 "6c",3.3240813070288,3.2681340588591,3.2784412978693 "Rodinia 3.1 - Test: OpenMP Streamcluster", Lower Results Are Better "12c",6.529,5.781,5.709,5.8,6.439,5.784,5.77,5.72,5.792,6.466,5.768,5.764,6.455,5.789,6.448 "10c",6.408,6.37,5.73,6.273,6.451,6.406,6.426,6.47,6.148,6.532,6.493,6.386,6.435,5.425,6.327 "8c",5.73,6.203,5.65,5.703,5.751,6.321,5.716,5.98,6.342,5.74,6.319,6.361,6.383,6.318,5.757 "6c",6.415,6.492,6.319 "oneDNN 3.0 - Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "12c",2322.08,2324.5,2386.29 "10c",2376.59,2465.39,2472.01 "8c",2338.1,2412.27,2375.98 "6c",2565.74,2441.08,2324.16,2409.22,2418.47,2471.54,2499.59,2446.95,2645.61,2543.41,2456.47,2617.51,2604.38,2314.82,2435.36 "Kvazaar 2.1 - Video Input: Bosphorus 4K - Video Preset: Very Fast", Higher Results Are Better "12c",73.29,76.81,73.35,71.39,72.2,72.41,71.55,76.26,73.69,73.41 "10c",76.19,73.87,76 "8c",70.97,73.82,74.32 "6c",72.93,70.41,70.89 "Apache Cassandra 4.0 - Test: Writes", Higher Results Are Better "12c",285173,252020,252319,244836,244403,247541,240168,264574,246545,259098,247800,237035 "10c",244179,239136,247494 "8c",240006,238071,244484 "6c",241042,248994,250610 "GROMACS 2022.1 - Implementation: MPI CPU - Input: water_GMX50_bare", Higher Results Are Better "12c",18.666,18.754,18.699 "10c",18.653,18.688,18.69 "8c",18.705,18.665,18.665 "6c",17.959,17.89,17.972 "oneDNN 3.0 - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "12c",0.437247,0.454208,0.449334 "10c",0.473624,0.470184,0.450637,0.459371 "8c",0.477996,0.456496,0.462896 "6c",0.475457,0.464371,0.45535 "OpenVINO 2022.3 - Model: Person Detection FP32 - Device: CPU", Higher Results Are Better "12c",42.36,43,43.48 "10c",43.48,43.26,42.8 "8c",42.21,42.22,42.24 "6c",41.58,41.42,41.33 "OpenVINO 2022.3 - Model: Person Detection FP32 - Device: CPU", Lower Results Are Better "12c",1126.04,1110.17,1095.82 "10c",1095.9,1103.48,1114.38 "8c",1129.8,1129.27,1127.97 "6c",1147.03,1151.17,1153.42 "Xmrig 6.18.1 - Variant: Monero - Hash Count: 1M", Higher Results Are Better "12c",104373.2,104188.4,105252.1 "10c",102480,102901.8,102417 "8c",102427.5,102239,101194.1 "6c",100694.8,100623.9,100020 "OpenVINO 2022.3 - Model: Person Detection FP16 - Device: CPU", Higher Results Are Better "12c",42.8,43.24,42.91 "10c",43.14,42.95,42.74 "8c",42.79,42.7,42.29 "6c",41.18,41.14,41.67 "OpenVINO 2022.3 - Model: Person Detection FP16 - Device: CPU", Lower Results Are Better "12c",1114.4,1103.18,1110.76 "10c",1105.12,1112.19,1114.01 "8c",1115.79,1116.61,1126.98 "6c",1157.22,1158.96,1144.92 "Timed GDB GNU Debugger Compilation 10.2 - Time To Compile", Lower Results Are Better "12c",41.539,42.049,41.538 "10c",42.295,42.555,42.387 "8c",42.411,42.466,42.35 "6c",43.337,43.003,43.394 "Timed Gem5 Compilation 21.2 - Time To Compile", Lower Results Are Better "12c",139.019,139.139,139.555 "10c",134.357,133.764,134.997 "8c",136.259,135.812,138.309 "6c",135.681,134.695,133.708 "CockroachDB 22.2 - Workload: KV, 50% Reads - Concurrency: 512", Higher Results Are Better "12c",48577.6,44801.2,48380.3,44452.5,45258.2,48070,49067.3,47985.8,44849.7,47985.1,49286.9,48391.6,49438.5,48810.2,48973.1 "10c",48076.4,49681.4,49550.3 "8c",49127.1,49259.3,45099.1,48399,44903.2,48413.2,45396.7,44964,48876.3,46242.9,47730.2,48215.8,48746.8,48633.9,49940.8 "6c",47372.5,47486.3,47425.2 "Embree 3.13 - Binary: Pathtracer ISPC - Model: Asian Dragon", Higher Results Are Better "12c",213.9934,213.6867,213.5721 "10c",214.957,214.5849,213.3861 "8c",218.1246,216.7767,217.3166 "6c",221.8575,221.6328,220.3791 "CockroachDB 22.2 - Workload: KV, 10% Reads - Concurrency: 512", Higher Results Are Better "12c",32039.5,34406.2,36350.3,35416.8,36954.7,36258.9,36230.5,36548.4,37352.5,35311.4,35808.6,37115,36273.2,36874.1,36610.4 "10c",33663.2,35242.2,37251.8,36199.1,37472.8,35302.7,37183.3,35722.2,35529.3,36667.7,36041.6,35424.7,36994.9,34804.6,36396.4 "8c",33272.6,35633.8,34829,35401.2,35313.1,34547.4 "6c",31126.4,33645.1,34418.4,36329.8,37348.8,36724.5,35617.2,36398.1,35681.7,37986.8,35031.6,35635.3,36850.2,36528.2,36812.7 "OpenVINO 2022.3 - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU", Higher Results Are Better "12c",117350.75,121515.19,119952.68 "10c",123866.63,123635.2,121312.87 "8c",121270.78,124959.42,124484.85 "6c",121169.35,119781.72,122130.69 "Timed Linux Kernel Compilation 6.1 - Build: defconfig", Lower Results Are Better "12c",27.182,25.293,25.221,25.163,26.152,25.155,25.27,25.165,25.29,25.271,25.352 "10c",27.995,25.073,25.177,25.107,25.935,25.152,25.572,25.104,25.047,25.082,25.126,25.154,25.155,25.025 "8c",26.913,25.286,25.128,26.09,25.445,25.009,24.998,25.684,25.202 "6c",26.055,24.493,24.512,24.817,24.499,24.436,24.418 "OpenVINO 2022.3 - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU", Higher Results Are Better "12c",149060.18,146478.44,147769.17 "10c",151956.66,147610.74,142768.29,151580.29,145269.3,151122.16,144286.04,151634.27,144102.22,146843.2 "8c",153962.11,152393.89,150521.17 "6c",151460.98,150493.82,151684.72 "Rodinia 3.1 - Test: OpenMP CFD Solver", Lower Results Are Better "12c",6.035,6.005,6.11 "10c",6.048,6.096,6.077 "8c",5.955,6.001,5.954 "6c",6.18,6.105,6.172 "Blender 3.4 - Blend File: BMW27 - Compute: CPU-Only", Lower Results Are Better "12c",8.7,8.52,8.51 "10c",8.36,8.5,8.4 "8c",8.38,8.31,8.34 "6c",8.31,8.44,8.24 "CockroachDB 22.2 - Workload: KV, 10% Reads - Concurrency: 1024", Higher Results Are Better "12c",36657.8,37154.3,36728.5 "10c",35431.9,35429.2,36469.3 "8c",36252.5,37316.6,36488.1 "6c",36542.8,35917,36529.1 "Embree 3.13 - Binary: Pathtracer ISPC - Model: Crown", Higher Results Are Better "12c",180.9243,184.3509,182.0742 "10c",185.2098,183.8036,185.1905 "8c",185.9218,185.7822,184.7682 "6c",187.1262,187.4682,188.2376 "Kvazaar 2.1 - Video Input: Bosphorus 4K - Video Preset: Ultra Fast", Higher Results Are Better "12c",76.52,78.57,78.4 "10c",75.38,78.86,77.67 "8c",75.43,77.34,77.75 "6c",76.32,74.62,76.64 "OSPRay 2.10 - Benchmark: particle_volume/scivis/real_time", Higher Results Are Better "12c",42.7999,42.8907,42.7005 "10c",43.0005,43.0134,42.9858 "8c",43.8982,43.7939,43.8405 "6c",43.1201,43.277,43.3218 "Neural Magic DeepSparse 1.1 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "12c",83.9937,84.6541,84.0932 "10c",84.3085,84.2908,84.1979 "8c",84.0345,84.4724,83.957 "6c",81.8824,82.1721,82.7295 "Neural Magic DeepSparse 1.1 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "12c",84.2723,84.0881,84.6914 "10c",84.4688,84.5635,84.4143 "8c",84.2242,84.2756,84.1348 "6c",82.795,81.8577,82.8079 "CockroachDB 22.2 - Workload: KV, 60% Reads - Concurrency: 512", Higher Results Are Better "12c",52237.9,52834.5,51917.8 "10c",48941.9,48317.3,53213.8,53109,54015.7,47947.6,52873.6,53666.4,48536.8,52461.5,48872.7,53671.2,54017.9,53480,53107.3 "8c",47856.1,53230.2,52504.4,52494.2,52186.3,52344.9,53429.6,53495.7,52680.9,52786.7,52569,53511.2,53608.4 "6c",46679.7,50420.2,52310.5,52440.9,53678.6,53052,52264.4,48221.4,52297.7,52257.8,52222.2,52416.8,48569.1,48941.9,53353.4 "libavif avifenc 0.11 - Encoder Speed: 10, Lossless", Lower Results Are Better "12c",4.254,4.195,4.275 "10c",4.407,4.229,4.375 "8c",4.252,4.237,4.267 "6c",4.327,4.242,4.18 "OSPRay 2.10 - Benchmark: particle_volume/ao/real_time", Higher Results Are Better "12c",43.7491,43.7349,43.6344 "10c",43.0462,43.0953,42.9533 "8c",43.991,43.9439,43.9752 "6c",43.3987,43.4001,43.2738 "nginx 1.23.2 - Connections: 500", Higher Results Are Better "12c",200771.86,201614.22,200710.1 "10c",199424.8,198263.21,198887.96 "8c",196870.1,197951.64,196424.19 "6c",196928.02,196577.79,196910.09 "DaCapo Benchmark 9.12-MR1 - Java Test: H2", Lower Results Are Better "12c",4382,5230,4892,4664,4979,4444,4801,4901,4898,4997,5082,4932,4917,5020,4843,4700,4612,4870,4420,4461 "10c",4973,4753,4740,5219,4741,4846,4784,4944,4366,4827,4793,4899,4953,4975,4772,4517,4778,4844,4939,4967 "8c",4926,4981,4736,4201,4659,4728,4848,4960,4695,4668,4661,4779,4898,4861,4730,4547,4892,4692,4522,4640 "6c",4880,4541,4968,4813,4814,4914,4890,4614,4759,5021,4486,4875,4984,4853,4622,4989,4794,5012,5022,4741 "CockroachDB 22.2 - Workload: KV, 50% Reads - Concurrency: 1024", Higher Results Are Better "12c",45247.7,45274.6,48082.8,49624.5,48393.5,48208.7,45810.3,46196.5,45967.9,47387.8,47514.5,48826.5,48272.8,48112.3,49061.9 "10c",47752.9,49061.9,48532.3 "8c",48195.3,45299.6,49289.5,48219.6,49337.7,44691.2,45209.4,48194.9,48470.2,45260.4,45595.6,50079.9,49451.9,47490.9,47685.5 "6c",47270.2,48880.5,45751.5,47871,45594.7,48022.5,48276,48454.5,48224.1 "libavif avifenc 0.11 - Encoder Speed: 6", Lower Results Are Better "12c",2.474,2.477,2.427 "10c",2.408,2.416,2.408 "8c",2.389,2.424,2.446 "6c",2.428,2.442,2.436 "Kvazaar 2.1 - Video Input: Bosphorus 4K - Video Preset: Medium", Higher Results Are Better "12c",62.44,63.8,61.45 "10c",62.39,62.28,62.03 "8c",62.56,60.34,62.52 "6c",61.73,60.35,62.11 "7-Zip Compression 22.01 - Test: Decompression Rating", Higher Results Are Better "12c",1185869,1183465,1174971 "10c",1177798,1175660,1161424 "8c",1178107,1148093,1153504 "6c",1178199,1180572,1173682 "OpenVINO 2022.3 - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU", Lower Results Are Better "12c",0.55,0.55,0.55 "10c",0.55,0.55,0.54,0.55,0.55,0.55,0.55,0.55,0.54,0.55 "8c",0.55,0.55,0.55 "6c",0.54,0.54,0.55 "Neural Magic DeepSparse 1.1 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "12c",1972.0621,1965.6716,1955.0852 "10c",1966.695,1967.6066,1962.3802 "8c",1956.3119,1954.9473,1951.109 "6c",1929.6119,1916.158,1945.2131 "Neural Magic DeepSparse 1.1 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "12c",48.5967,48.7156,48.9896 "10c",48.7173,48.6965,48.8155 "8c",48.928,48.997,49.0697 "6c",49.6393,49.9848,49.2594 "Timed LLVM Compilation 13.0 - Build System: Ninja", Lower Results Are Better "12c",76.045,75.674,75.247 "10c",75.848,75.325,75.148 "8c",75.64,75.638,75.896 "6c",76.873,76.668,76.7 "OpenVINO 2022.3 - Model: Vehicle Detection FP16 - Device: CPU", Lower Results Are Better "12c",6.48,6.48,6.49 "10c",6.44,6.48,6.44 "8c",6.48,6.48,6.5 "6c",6.55,6.56,6.56 "OpenVINO 2022.3 - Model: Vehicle Detection FP16 - Device: CPU", Higher Results Are Better "12c",7398.8,7394.3,7390.85 "10c",7439.89,7398.51,7436.91 "8c",7394.5,7396.01,7376.48 "6c",7315.63,7301.36,7302.42 "Timed Node.js Compilation 18.8 - Time To Compile", Lower Results Are Better "12c",100.958,101.793,101.645 "10c",102.382,102.05,101.391 "8c",100.786,101.11,101.55 "6c",102.897,102.735,102.697 "ONNX Runtime 1.11 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", Higher Results Are Better "12c",254.5,267,247.5,253,251.5,251.5,252.5 "10c",260.5,250,253.5 "8c",254,252,268,254.5,257.5 "6c",260,262.5,245,262,248,247,249,249,262.5,258.5,243.5,247 "OSPRay 2.10 - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time", Higher Results Are Better "12c",54.313,54.2382,52.7733 "10c",54.6183,54.4138,54.1928 "8c",54.6388,54.3648,54.5224 "6c",54.6885,54.5461,54.5815 "simdjson 2.0 - Throughput Test: TopTweet", Higher Results Are Better "12c",6.59,6.58,6.6 "10c",6.59,6.18,6.49,6.56,6.49,6.62 "8c",6.58,6.56,6.56 "6c",6.55,6.56,6.55 "DaCapo Benchmark 9.12-MR1 - Java Test: Jython", Lower Results Are Better "12c",3303,3436,3413,3369 "10c",3294,3308,3335,3378 "8c",3307,3402,3315,3453 "6c",3297,3331,3399,3352 "Blender 3.4 - Blend File: Barbershop - Compute: CPU-Only", Lower Results Are Better "12c",81.27,80.61,81.21 "10c",80.61,80.08,80.41 "8c",79.74,80.26,80.55 "6c",79.37,79.98,80.43 "Timed Linux Kernel Compilation 6.1 - Build: allmodconfig", Lower Results Are Better "12c",147.136,145.602,148.703 "10c",146.847,144.547,144.836 "8c",148.972,147.697,145.462 "6c",146.037,145.607,145.655 "Neural Magic DeepSparse 1.1 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "12c",1134.8311,1133.0006,1132.0152 "10c",1133.1954,1132.8278,1133.523 "8c",1137.8555,1135.1026,1137.6051 "6c",1148.1218,1149.8052,1147.5621 "libavif avifenc 0.11 - Encoder Speed: 0", Lower Results Are Better "12c",63.608,63.046,63.088 "10c",62.967,62.992,63.78 "8c",62.901,63.014,62.968 "6c",63.819,64.605,62.986 "Neural Magic DeepSparse 1.1 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "12c",1135.2062,1131.0434,1134.1827 "10c",1133.6894,1134.7874,1137.0768 "8c",1139.095,1134.1793,1139.2613 "6c",1150.2194,1148.1718,1146.5923 "CockroachDB 22.2 - Workload: KV, 60% Reads - Concurrency: 1024", Higher Results Are Better "12c",52999.5,52170.8,52549.6 "10c",52432.9,48601.2,51686.1,51920.5,52757,52124.3,53084.6,51898.3,52896.3,52194.1 "8c",51799.2,52528.1,53349.8 "6c",51958.8,52441.8,53478.6 "Timed Apache Compilation 2.4.41 - Time To Compile", Lower Results Are Better "12c",20.467,20.472,20.444 "10c",20.463,20.477,20.501 "8c",20.602,20.572,20.594 "6c",20.737,20.717,20.707 "NWChem 7.0.2 - Input: C240 Buckyball", Lower Results Are Better "12c", "10c", "8c", "6c", "CockroachDB 22.2 - Workload: MoVR - Concurrency: 512", Higher Results Are Better "12c",952,951.7,941.7 "10c",951.9,954.4,942.4 "8c",942.7,965.8,972.5 "6c",964.4,949.4,950.2 "Timed Godot Game Engine Compilation 3.2.3 - Time To Compile", Lower Results Are Better "12c",33.342,34.842,33.351,34.592 "10c",33.564,33.7,33.584 "8c",33.806,33.642,34.267 "6c",33.824,33.732,33.458 "OpenVINO 2022.3 - Model: Vehicle Detection FP16-INT8 - Device: CPU", Higher Results Are Better "12c",11019.9,11015.53,11019.69 "10c",11067.93,11070.79,11059.77 "8c",11106.79,11105.99,11111.71 "6c",11146.75,11152.38,11151.83 "OpenRadioss 2022.10.13 - Model: Bird Strike on Windshield", Lower Results Are Better "12c",217.5,216.2,216.95 "10c",219.2,218.12,217.33 "8c",219.76,219.48,219.11 "6c",218.83,219.22,219.26 "OpenVINO 2022.3 - Model: Vehicle Detection FP16-INT8 - Device: CPU", Lower Results Are Better "12c",4.35,4.35,4.35 "10c",4.33,4.33,4.33 "8c",4.31,4.31,4.31 "6c",4.3,4.29,4.3 "Blender 3.4 - Blend File: Classroom - Compute: CPU-Only", Lower Results Are Better "12c",20.92,20.93,20.92 "10c",20.93,20.71,20.64 "8c",20.79,20.59,20.65 "6c",20.64,20.77,20.73 "libavif avifenc 0.11 - Encoder Speed: 6, Lossless", Lower Results Are Better "12c",5.247,5.434,5.181 "10c",5.204,5.353,5.3 "8c",5.223,5.251,5.335 "6c",5.231,5.34,5.42 "Neural Magic DeepSparse 1.1 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "12c",618.0827,612.2171,616.0424 "10c",613.0103,606.4128,614.4548 "8c",615.9213,611.97,615.9403 "6c",609.445,611.8809,604.275 "Neural Magic DeepSparse 1.1 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "12c",154.7909,156.3559,155.2923 "10c",156.0718,157.6253,155.915 "8c",155.6328,156.3441,155.4805 "6c",157.0366,156.3207,158.2918 "OpenVINO 2022.3 - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU", Lower Results Are Better "12c",0.96,0.97,0.97 "10c",0.98,0.98,0.97 "8c",0.97,0.98,0.98 "6c",0.97,0.97,0.97 "Neural Magic DeepSparse 1.1 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "12c",1197.7734,1201.7963,1188.161 "10c",1201.2202,1199.9006,1202.2966 "8c",1208.3913,1199.38,1198.1804 "6c",1192.2505,1191.1383,1188.1971 "Neural Magic DeepSparse 1.1 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "12c",79.9731,79.6655,80.5983 "10c",79.7272,79.7539,79.6607 "8c",79.3101,79.7723,79.9771 "6c",80.39,80.3433,80.5865 "OpenRadioss 2022.10.13 - Model: INIVOL and Fluid Structure Interaction Drop Container", Lower Results Are Better "12c",81.3,81.74,81.67 "10c",81.06,81.09,81.31 "8c",81.32,81.05,80.9 "6c",80.74,80.72,80.97 "OpenVINO 2022.3 - Model: Weld Porosity Detection FP16 - Device: CPU", Higher Results Are Better "12c",9864.63,9872.54,9865.07 "10c",9897.27,9904.37,9899.76 "8c",9923.37,9924.62,9946.48 "6c",9963.1,9952.55,9962.49 "Xmrig 6.18.1 - Variant: Wownero - Hash Count: 1M", Higher Results Are Better "12c",125125.1,126230.7,128041 "10c",127242.7,127339.9,127097.1 "8c",126935.8,126984.1,127323.7 "6c",125360.4,126454.2,126358.4 "OpenVINO 2022.3 - Model: Face Detection FP16 - Device: CPU", Higher Results Are Better "12c",101.64,101.89,101.68 "10c",101.99,102.06,101.98 "8c",101.33,101.2,101.26 "6c",100.97,101.09,101.18 "OpenVINO 2022.3 - Model: Face Detection FP16 - Device: CPU", Lower Results Are Better "12c",471.28,470.57,471.08 "10c",469.56,469.24,469.49 "8c",473.14,473.07,472.31 "6c",473.85,473.81,473.4 "ACES DGEMM 1.0 - Sustained Floating-Point Rate", Higher Results Are Better "12c",70.623937,69.760936,70.838326 "10c",70.574028,70.643979,70.623317 "8c",70.934295,71.115263,70.981412 "6c",71.046705,71.001263,70.646969 "OpenRadioss 2022.10.13 - Model: Bumper Beam", Lower Results Are Better "12c",79.63,81.34,78.62 "10c",80.67,78.22,80.22 "8c",78.63,80.58,78.38 "6c",79.56,78.41,80.88 "OpenVINO 2022.3 - Model: Weld Porosity Detection FP16 - Device: CPU", Lower Results Are Better "12c",4.85,4.85,4.85 "10c",4.84,4.83,4.83 "8c",4.82,4.82,4.81 "6c",4.81,4.81,4.81 "OpenVINO 2022.3 - Model: Person Vehicle Bike Detection FP16 - Device: CPU", Higher Results Are Better "12c",9019.49,9053.18,9042.75 "10c",9069.6,9068.44,9053.47 "8c",9117.13,9114.6,9107.61 "6c",9074.25,9073.88,9097.06 "ASTC Encoder 4.0 - Preset: Exhaustive", Higher Results Are Better "12c",11.7786,11.6956,11.7009 "10c",11.7646,11.7623,11.7643 "8c",11.7974,11.8129,11.8167 "6c",11.8179,11.8201,11.8242 "Stargate Digital Audio Workstation 22.11.5 - Sample Rate: 192000 - Buffer Size: 1024", Higher Results Are Better "12c",2.825912,2.832535,2.828737 "10c",2.773599,2.832499,2.812471 "8c",2.834949,2.772869,2.826848 "6c",2.817552,2.831581,2.82531 "OSPRay 2.10 - Benchmark: particle_volume/pathtracer/real_time", Higher Results Are Better "12c",230.503,226.21,231.094 "10c",226.417,231.907,232.523 "8c",226.695,226.994,232.055 "6c",230.278,231.532,229.51 "simdjson 2.0 - Throughput Test: LargeRandom", Higher Results Are Better "12c",1.25,1.25,1.25 "10c",1.25,1.25,1.25 "8c",1.25,1.25,1.25 "6c",1.24,1.24,1.24 "OpenVINO 2022.3 - Model: Person Vehicle Bike Detection FP16 - Device: CPU", Lower Results Are Better "12c",5.31,5.29,5.3 "10c",5.28,5.28,5.29 "8c",5.26,5.26,5.26 "6c",5.28,5.28,5.27 "OpenVINO 2022.3 - Model: Weld Porosity Detection FP16-INT8 - Device: CPU", Higher Results Are Better "12c",19146.66,19183.37,19184.51 "10c",19289.88,19279.76,19192.6 "8c",19249.32,19245.98,19341.5 "6c",19342.99,19246.37,19352.75 "CockroachDB 22.2 - Workload: MoVR - Concurrency: 1024", Higher Results Are Better "12c",955.7,954.6,951 "10c",948.5,950.5,949.5 "8c",947.8,941,951.9 "6c",954.7,953.7,949.6 "simdjson 2.0 - Throughput Test: PartialTweets", Higher Results Are Better "12c",5.65,5.63,5.67 "10c",5.65,5.7,5.66 "8c",5.65,5.68,5.66 "6c",5.69,5.71,5.67 "OSPRay 2.10 - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time", Higher Results Are Better "12c",43.4205,42.9768,42.9813 "10c",43.2422,43.1832,43.5606 "8c",43.2875,43.3056,43.6999 "6c",43.3107,43.5308,43.0281 "Timed MPlayer Compilation 1.5 - Time To Compile", Lower Results Are Better "12c",7.747,7.742,7.842 "10c",7.788,7.791,7.687 "8c",7.846,7.812,7.766 "6c",7.754,7.776,7.788 "OSPRay 2.10 - Benchmark: gravity_spheres_volume/dim_512/ao/real_time", Higher Results Are Better "12c",43.7541,43.9714,44.2071 "10c",44.0762,43.9378,43.9767 "8c",44.3732,44.2911,44.0263 "6c",44.3163,44.1291,44.3693 "libavif avifenc 0.11 - Encoder Speed: 2", Lower Results Are Better "12c",35.122,34.641,34.782 "10c",34.852,34.799,35.075 "8c",34.653,34.879,34.53 "6c",34.996,35.034,34.593 "OpenVINO 2022.3 - Model: Weld Porosity Detection FP16-INT8 - Device: CPU", Lower Results Are Better "12c",9.96,9.95,9.95 "10c",9.89,9.9,9.94 "8c",9.91,9.92,9.87 "6c",9.87,9.92,9.87 "miniBUDE 20210901 - Implementation: OpenMP - Input Deck: BM2", Higher Results Are Better "12c",8614.13,8612.209,8694.591 "10c",8648.351,8624.201,8728.387 "8c",8682.172,8489.757,8675.972 "6c",8493.332,8635.042,8827.399 "miniBUDE 20210901 - Implementation: OpenMP - Input Deck: BM2", Higher Results Are Better "12c",344.565,344.488,347.784 "10c",345.934,344.968,349.135 "8c",347.287,339.59,347.039 "6c",339.733,345.402,353.096 "Build2 0.13 - Time To Compile", Lower Results Are Better "12c",49.998,49.888,49.864 "10c",49.776,49.849,49.774 "8c",50.122,50.018,49.474 "6c",49.695,50.616,49.941 "ASTC Encoder 4.0 - Preset: Thorough", Higher Results Are Better "12c",106.4736,106.5638,106.6614 "10c",106.8771,106.9262,106.7592 "8c",107.0993,107.1783,107.0549 "6c",106.4557,106.3725,106.7003 "OpenVINO 2022.3 - Model: Face Detection FP16-INT8 - Device: CPU", Lower Results Are Better "12c",250.02,250.98,250.03 "10c",249.08,249.17,249.12 "8c",250.59,248.91,248.28 "6c",250.24,250.66,250.58 "OpenVINO 2022.3 - Model: Face Detection FP16-INT8 - Device: CPU", Higher Results Are Better "12c",191.67,191.02,191.6 "10c",192.34,192.31,192.24 "8c",191.34,192.44,192.97 "6c",191.46,191.15,191.25 "Timed Mesa Compilation 21.0 - Time To Compile", Lower Results Are Better "12c",20.012,20.094,20.244 "10c",20.279,20.093,20.244 "8c",20.019,20.256,20.046 "6c",20.23,20.167,20.074 "NAMD 2.14 - ATPase Simulation - 327,506 Atoms", Lower Results Are Better "12c",0.127805,0.127675,0.128001 "10c",0.127598,0.127465,0.127721 "8c",0.128573,0.127391,0.127067 "6c",0.128138,0.128373,0.128081 "simdjson 2.0 - Throughput Test: DistinctUserID", Higher Results Are Better "12c",6.87,6.88,6.82 "10c",6.82,6.83,6.87 "8c",6.87,6.83,6.87 "6c",6.8,6.84,6.85 "Stargate Digital Audio Workstation 22.11.5 - Sample Rate: 96000 - Buffer Size: 1024", Higher Results Are Better "12c",4.37353,4.365395,4.298746 "10c",4.374213,4.338674,4.35078 "8c",4.366728,4.338965,4.348514 "6c",4.360509,4.367103,4.36669 "Timed PHP Compilation 8.1.9 - Time To Compile", Lower Results Are Better "12c",44.603,44.54,44.415 "10c",44.586,44.475,44.762 "8c",44.525,44.647,44.577 "6c",44.564,44.733,44.797 "Liquid-DSP 2021.01.31 - Threads: 256 - Buffer Length: 256 - Filter Length: 57", Higher Results Are Better "12c",10339000000,10347000000,10355000000 "10c",10340000000,10331000000,10349000000 "8c",10329000000,10342000000,10342000000 "6c",10342000000,10346000000,10333000000 "Liquid-DSP 2021.01.31 - Threads: 384 - Buffer Length: 256 - Filter Length: 57", Higher Results Are Better "12c",10353000000,10350000000,10338000000 "10c",10346000000,10351000000,10361000000 "8c",10340000000,10349000000,10360000000 "6c",10343000000,10354000000,10350000000 "simdjson 2.0 - Throughput Test: Kostya", Higher Results Are Better "12c",4.1,4.12,4.12 "10c",4.1,4.11,4.12 "8c",4.11,4.11,4.11 "6c",4.1,4.12,4.1 "CockroachDB 22.2 - Workload: KV, 95% Reads - Concurrency: 1024", Higher Results Are Better "12c",65100.8,65363.3,63521.2 "10c",62816.7,54308,65115.2,53337.1,64179.4,65677,65283.8,62944.9,63770.1,64307.3,63570.6,53375.1,62659.1,65177.6,63924.7 "8c",54319.6,53705.2,62877.7,63890.4,53422.5,63131,53653.3,62558.7,53603.2,52785.3,63373.7,54039.9,53337.2,63928.7,64306 "6c",56362.5,67136.4,64254.6,63045.7,63450.2,62189.8,64494.4,53765.2,64928.3,62717.1,53546.6,63858.2,54812.9,54093.2,53404.1 "CockroachDB 22.2 - Workload: KV, 95% Reads - Concurrency: 512", Higher Results Are Better "12c",64301.3,65758.6,63342.9 "10c",63268.3,57767.5,63529.4,57700.9,64265.7,57508.8,56961.8,64260.5,64961,56325.4,66511.8,66712.5,57302.2,55737.1,58731.9 "8c",63718.2,65813.1,62804.4 "6c",57133.1,66050,66050,63719.5,62137.7,64469,63036,65159.2,56318.9,65632.3,63120.2,57990.2,62356.4,64416.9,62408 "oneDNN 3.0 - Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "12c",1881.1,1756.17,1919.85,2031.8,2035.76,1651.96,2024.01,2008.68,2117.81,2061.74,2003.15,1947.35,2039.38,2017.13,2034.66 "10c",2036,2053.46,2002.69 "8c",2000.22,2019.56,1926.66 "6c",1957.12,2026.45,2128.97,2099.39,2112.84,2053.15,2113.19,2075.98,2060.35,2098.25 "oneDNN 3.0 - Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU", Lower Results Are Better "12c",3.90452,3.97332,3.98628 "10c",4.18439,4.21782,4.00347,3.91288,4.35888,3.83047,3.81069,4.07138,3.90152,3.96477,4.20148,3.65481 "8c",4.16451,4.13555,4.48853,3.67553,3.86139,4.03418,4.03061,4.10651,3.63766,4.23968,4.18251,3.35995 "6c",3.94553,4.0006,3.9485 "SVT-AV1 1.4 - Encoder Mode: Preset 12 - Input: Bosphorus 4K", Higher Results Are Better "12c",183.895,246.509,260.729,285.591,268.144,280.198,277.925,270.764,284.788,228.766,239.957,214.363,251.352,244.02,239.53 "10c",185.395,263.121,284.791,249.14,247.688,281.116,237.454,230.275,240.016,225.356,222.882,244.659,203.641,276.804,228.194 "8c",168.374,221.835,225.59,226.993,255.542,216.841,225.665,247.156,196.862,242.736,288.609,229.399,256.446,191.071,225.354 "6c",154.635,170.521,264.638,251.048,248.521,228.522,186.142,214.157,248.717,223.207,244.433,219.42,221.133 "LuxCoreRender 2.6 - Scene: Orange Juice - Acceleration: CPU", Higher Results Are Better "12c",28.13,27.73,34.67,27.62,27.84,27.91,27.9,27.35,27.93,27.35,27.71,28.57,28.22,28.59,34.83 "10c",28.43,28.52,27.62 "8c",27.63,34.29,27.42,28.14,28.15,26.84,27.56,28.24,27.46,34.38,27.96,27.54,27.9,34.54,27.57 "6c",26.96,34.34,26.76,34.24,27.56,27.92,27.38,33.99,27.75,27.65,27.86,27.76,27.17,28.19,27.96 "LuxCoreRender 2.6 - Scene: Danish Mood - Acceleration: CPU", Higher Results Are Better "12c",9.85,9.81,9.26,9.24,9.86,9.56,9.65,9.67,10.52,10.01,9.64,9.09,9.51,9.55,10.13 "10c",10.1,9.63,9.47,10.23,8.99,9.24,9.49,9.81,9.31,8.92,9.2,11.02 "8c",9.44,9.16,9.82,9.24,9.2,9.42,9.96,8.86,9.48,10.55,9.85,9.5,9.47,9.88,9.62 "6c",9.55,9.38,9.02,8.93,10.42,9.39,9.13,9.6,9.75,9.5,10.27,8.93 "NAS Parallel Benchmarks 3.4 - Test / Class: IS.D", Higher Results Are Better "12c",8463.13,8359.93,8649.98 "10c",6552.67,6542.89,6911.05,6568.24,8338.26,6490.72,6632.54,7651.5,7428.12,8437.58,7405.21,6540.27 "8c",7133.17,6343.75,6432.34,7127.09,6437.54,6192.81,7335.61,6971.58,7317.88,7122.34,6053.19,6334.65,5871.65,6167.41,7294.59 "6c",6272.87,6174.73,5747.24,6125.03,5228.88,4983.75,6152.1,4961.45,4956.65,5458.38,6385.81,5833.27 "High Performance Conjugate Gradient 3.1 - ", Higher Results Are Better "12c",74.5542,87.8309,88.0237,88.0971,88.0471,87.7285,87.7859,87.4822,88.1178,88.2919,88.056,87.7565 "10c",51.2529,45.3254,44.1977,44.0031,43.9389,44.2696,43.7841,43.9027,73.9764 "8c",41.6928,45.7814,46.3234,46.6097,45.6097,45.0971,45.0966,44.8327,43.9615 "6c",28.6594,37.6591,37.8461,37.895,37.9474,37.0948,37.3416,36.9249,37.5017