AMD EPYC 4th Gen AVX-512 Comparison

AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2212195-NE-AVXCOMPAR69
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

C/C++ Compiler Tests 3 Tests
CPU Massive 7 Tests
Creator Workloads 9 Tests
Cryptography 2 Tests
Game Development 2 Tests
HPC - High Performance Computing 16 Tests
Machine Learning 11 Tests
Molecular Dynamics 3 Tests
Multi-Core 10 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 7 Tests
OpenMPI Tests 3 Tests
Python 2 Tests
Raytracing 2 Tests
Renderers 2 Tests
Scientific Computing 3 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
AVX-512 On
December 18 2022
  20 Hours, 2 Minutes
AVX-512 Off
December 18 2022
  15 Hours, 29 Minutes
Invert Hiding All Results Option
  17 Hours, 45 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

AMD EPYC 4th Gen AVX-512 Comparison AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article. ,,"AVX-512 On","AVX-512 Off" Processor,,2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads) Motherboard,,AMD Titanite_4G (RTI1002E BIOS),AMD Titanite_4G (RTI1002E BIOS) Chipset,,AMD Device 14a4,AMD Device 14a4 Memory,,1520GB,1520GB Disk,,800GB INTEL SSDPF21Q800GB,800GB INTEL SSDPF21Q800GB Graphics,,ASPEED,ASPEED Monitor,,VGA HDMI,VGA HDMI Network,,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe OS,,Ubuntu 22.10,Ubuntu 22.10 Kernel,,6.1.0-phx (x86_64),6.1.0-phx (x86_64) Desktop,,GNOME Shell 43.0,GNOME Shell 43.0 Display Server,,X Server 1.21.1.4,X Server 1.21.1.4 Vulkan,,1.3.224,1.3.224 Compiler,,GCC 12.2.0 + Clang 15.0.2-1,GCC 12.2.0 + Clang 15.0.2-1 File-System,,ext4,ext4 Screen Resolution,,1920x1080,1920x1080 ,,"AVX-512 On","AVX-512 Off" "CPU Temperature Monitor - Phoronix Test Suite System Monitoring (Celsius)",,49.97,51.26 "CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,434.8,449.58 "miniBUDE - Implementation: OpenMP - Input Deck: BM1 (Billion Interactions/s)",HIB,291.982,202.604 "miniBUDE - Implementation: OpenMP - Input Deck: BM2 (Billion Interactions/s)",HIB,346.081,255.661 "miniBUDE - Implementation: OpenMP - Input Deck: BM1 (Billion Interactions/s/Watt)",HIB,1.041,0.489 "miniBUDE - Implementation: OpenMP - Input Deck: BM2 (Billion Interactions/s/Watt)",HIB,0.694,0.453 "OpenVINO - Model: Face Detection FP16 - Device: CPU (FPS)",HIB,102.04,43.94 "OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,193.93,94.97 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (FPS)",HIB,148967.98,108449.49 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (FPS)",HIB,170652.71,151239.60 "OpenVINO - Model: Person Detection FP16 - Device: CPU (FPS)",HIB,43.34,25.50 "OpenVINO - Model: Person Detection FP32 - Device: CPU (FPS)",HIB,43.34,25.74 "OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,19800.20,9672.94 "OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (FPS)",HIB,9988.44,4110.49 "OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (FPS)",HIB,11202.62,6065.76 "OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (FPS)",HIB,7452.96,3782.08 "OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,9065.34,5135.56 "OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,956.88,445.59 "Embree - Binary: Pathtracer ISPC - Model: Asian Dragon Obj (FPS)",HIB,184.4701,153.4476 "Embree - Binary: Pathtracer ISPC - Model: Asian Dragon (FPS/Watt)",HIB,0.707,0.431 "Embree - Binary: Pathtracer ISPC - Model: Asian Dragon (FPS)",HIB,212.9364,176.8831 "Embree - Binary: Pathtracer ISPC - Model: Asian Dragon Obj (FPS/Watt)",HIB,0.725,0.481 "Embree - Binary: Pathtracer ISPC - Model: Crown (FPS)",HIB,180.9315,151.0558 "SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 4K (FPS)",HIB,246.572,239.881 "SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 4K (FPS)",HIB,245.555,233.944 "Embree - Binary: Pathtracer ISPC - Model: Crown (FPS/Watt)",HIB,0.524,0.344 "SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 4K (FPS/Watt)",HIB,1.513,0.986 "SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 4K (FPS/Watt)",HIB,1.4,0.968 "simdjson - Throughput Test: PartialTweets (GB/s/Watt)",HIB,0.032,0.023 "simdjson - Throughput Test: PartialTweets (GB/s)",HIB,6.70,5.14 "simdjson - Throughput Test: LargeRandom (GB/s)",HIB,1.26,1.04 "simdjson - Throughput Test: Kostya (GB/s)",HIB,4.18,3.39 "simdjson - Throughput Test: DistinctUserID (GB/s)",HIB,6.86,5.25 "simdjson - Throughput Test: LargeRandom (GB/s/Watt)",HIB,0.006,0.005 "simdjson - Throughput Test: Kostya (GB/s/Watt)",HIB,0.02,0.015 "simdjson - Throughput Test: DistinctUserID (GB/s/Watt)",HIB,0.033,0.024 "simdjson - Throughput Test: TopTweet (GB/s)",HIB,6.52,5.38 "simdjson - Throughput Test: TopTweet (GB/s/Watt)",HIB,0.031,0.024 "miniBUDE - Implementation: OpenMP - Input Deck: BM1 (GFInst/s)",HIB,7299.545,5065.096 "miniBUDE - Implementation: OpenMP - Input Deck: BM2 (GFInst/s)",HIB,8652.005,6391.519 "Intel Open Image Denoise - Run: RT.hdr_alb_nrm.3840x2160 (Images / Sec)",HIB,3.51,3.50 "Intel Open Image Denoise - Run: RT.hdr_alb_nrm.3840x2160 (Images / Sec/Watt)",HIB,0.012,0.01 "Intel Open Image Denoise - Run: RT.ldr_alb_nrm.3840x2160 (Images / Sec/Watt)",HIB,0.012,0.01 "Intel Open Image Denoise - Run: RTLightmap.hdr.4096x4096 (Images / Sec/Watt)",HIB,0.005,0.004 "Intel Open Image Denoise - Run: RT.ldr_alb_nrm.3840x2160 (Images / Sec)",HIB,3.51,3.51 "Intel Open Image Denoise - Run: RTLightmap.hdr.4096x4096 (Images / Sec)",HIB,1.66,1.72 "TensorFlow - Device: CPU - Batch Size: 16 - Model: ResNet-50 (images/sec)",HIB,22.15,12.75 "TensorFlow - Device: CPU - Batch Size: 16 - Model: AlexNet (images/sec)",HIB,157.29,55.11 "TensorFlow - Device: CPU - Batch Size: 16 - Model: GoogLeNet (images/sec)",HIB,60.17,31.12 "TensorFlow - Device: CPU - Batch Size: 16 - Model: ResNet-50 (images/sec/Watt)",HIB,0.072,0.038 "TensorFlow - Device: CPU - Batch Size: 16 - Model: AlexNet (images/sec/Watt)",HIB,0.525,0.173 "TensorFlow - Device: CPU - Batch Size: 16 - Model: GoogLeNet (images/sec/Watt)",HIB,0.195,0.104 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inferences/min/Watt)",HIB,0.548,0.497 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inferences/min/Watt)",HIB,28.541,23.568 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inferences/min/Watt)",HIB,2.379,2.051 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inferences/min)",HIB,271,250 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inferences/min)",HIB,7401,6288 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inferences/min/Watt)",HIB,1.393,1.315 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inferences/min)",HIB,516,499 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inferences/min)",HIB,1051,918 "OpenVKL - Benchmark: vklBenchmark ISPC (Items / Sec)",HIB,1332,1155 "OpenVKL - Benchmark: vklBenchmark ISPC (Items / Sec/Watt)",HIB,2.853,2.355 "OSPRay - Benchmark: gravity_spheres_volume/dim_512/ao/real_time (Items/sec)",HIB,44.1566,26.3794 "OSPRay - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time (Items/sec)",HIB,43.0711,25.1354 "OSPRay - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time (Items/sec/Watt)",HIB,0.074,0.041 "OSPRay - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time (Items/sec)",HIB,54.2187,40.5117 "OSPRay - Benchmark: gravity_spheres_volume/dim_512/ao/real_time (Items/sec/Watt)",HIB,0.076,0.043 "OSPRay - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time (Items/sec/Watt)",HIB,0.091,0.065 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (items/sec)",HIB,84.9988,73.5380 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,616.6804,509.4462 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,187.0837,177.5387 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1195.9367,1005.1615 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1953.0255,1410.8051 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.5206,30.6062 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (items/sec)",HIB,100.5458,71.0437 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,761.2241,490.3658 "Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,189.5611,157.819 "Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,857.2265,690.8722 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.2518,30.5267 "Cpuminer-Opt - Algorithm: scrypt (kH/s)",HIB,4800.61,2946.08 "Cpuminer-Opt - Algorithm: scrypt (kH/s/Watt)",HIB,8.076,5.279 "Cpuminer-Opt - Algorithm: Quad SHA-256, Pyrite (kH/s)",HIB,2260680,1322960 "Cpuminer-Opt - Algorithm: Quad SHA-256, Pyrite (kH/s/Watt)",HIB,3657.529,2252.989 "Cpuminer-Opt - Algorithm: x25x (kH/s)",HIB,7696.06,5784.25 "Cpuminer-Opt - Algorithm: x25x (kH/s/Watt)",HIB,13.548,9.971 "Cpuminer-Opt - Algorithm: Garlicoin (kH/s)",HIB,71553,48827 "Cpuminer-Opt - Algorithm: Garlicoin (kH/s/Watt)",HIB,119.969,83.215 "Cpuminer-Opt - Algorithm: Skeincoin (kH/s/Watt)",HIB,3137.556,2381.936 "Cpuminer-Opt - Algorithm: LBC, LBRY Credits (kH/s/Watt)",HIB,1658.507,802.762 "Cpuminer-Opt - Algorithm: Skeincoin (kH/s)",HIB,1951330,1427543 "Cpuminer-Opt - Algorithm: LBC, LBRY Credits (kH/s)",HIB,1066950,491740 "AI Benchmark Alpha - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3655.25,3710.43 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3558.88,3697.8 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3109.43,3135.25 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3541.16,3711.83 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2868.39,2986.9 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3003.32,2938.06 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3550.9,3710.77 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3570.99,3701.55 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2944.53,3214.25 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3527.15,3641.4 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2878.73,2908.24 "Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3533.07,3678.77 "TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3663.75,3713.14 "TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3458.15,3732 "TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3586.18,3726.81 "LeelaChessZero - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3683.95,3700.34 "LeelaChessZero - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3685.09,3699.28 "Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2974.09,3508.39 "Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3371.79,3592.04 "Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2928.33,3445.59 "OpenVKL - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3408.84,3373.13 "OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3080.62,3072.96 "OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3051.17,3082.79 "OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3054.57,3104.1 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2939.43,2997.26 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2929.94,2979.04 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2904.27,2978.35 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2950.45,3001.5 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2888.49,2936.7 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2876.44,2988.85 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2858.62,2995.4 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2921.96,2993.27 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2935.35,2971.62 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2868.37,3004.41 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2906.14,2960.32 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2907.3,3006.5 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2931.19,3000.68 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2925.76,2971.47 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2923.29,2972.25 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2936.87,2996.11 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2909.58,2955.92 "OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2943.3,2973.4 "oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3181.88,3347.84 "oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3393.99,3525.84 "oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3007.81,3665.95 "oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3570.57,3622.69 "oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3567.66,3626.86 "oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3507.27,3611.7 "Mobile Neural Network - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3679.28,3699.72 "Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3009.4,3058.31 "Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3111.92,3154.76 "Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3104.59,3350.91 "Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3079.49,3030.14 "Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3002.44,3067.56 "Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3059.52,2933 "NCNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3565.67,3574.38 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3125.56,2906.37 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3128.94,3080.75 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3605.38,3193.41 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3630.12,3673.94 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3479.89,3150.36 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3466.22,3100.27 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3037.41,3069.55 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3059.83,2848.15 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3035.65,3068.36 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2971.83,2729.54 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3098.85,2942.46 "OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3256.35,2965.61 "GROMACS - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3168.27,3357.72 "ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3577.02,3611.53 "ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3664.92,3701.93 "ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3663.27,3701.26 "ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3571.99,3607.6 "Numpy Benchmark - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3672.75,3702.41 "miniBUDE - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2913.13,3505.27 "miniBUDE - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3201.47,3288.43 "SVT-AV1 - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3201.53,3728.48 "SVT-AV1 - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3273.8,3718.3 "Numenta Anomaly Benchmark - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3531.9,3707.41 "Numenta Anomaly Benchmark - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3236.71,3718.16 "Numenta Anomaly Benchmark - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3436.84,3701.99 "Intel Open Image Denoise - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3124.26,3625.91 "Intel Open Image Denoise - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3211.97,3609.95 "Intel Open Image Denoise - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3215.57,3636.42 "Darmstadt Automotive Parallel Heterogeneous Suite - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3515.77,3718.89 "Darmstadt Automotive Parallel Heterogeneous Suite - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3647.5,3698.64 "simdjson - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3638.64,3701.7 "simdjson - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3601.15,3700.69 "simdjson - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3624.51,3704.16 "simdjson - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3643.23,3703.47 "simdjson - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3639.96,3701.26 "OpenFOAM - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3185.68,3265.15 "CP2K Molecular Dynamics - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3660.54,3664.87 "JPEG XL libjxl - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3657.01,3701.38 "JPEG XL libjxl - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3682.16,3701.38 "JPEG XL libjxl - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3643.34,3696.21 "SMHasher - Hash: FarmHash32 x86_64 AVX (MiB/sec)",HIB,39794.44,36483.70 "JPEG XL libjxl - Input: JPEG - Quality: 90 (MP/s)",HIB,9.55,9.13 "JPEG XL libjxl - Input: JPEG - Quality: 100 (MP/s)",HIB,0.74,0.72 "JPEG XL libjxl - Input: PNG - Quality: 90 (MP/s)",HIB,9.95,9.52 "JPEG XL libjxl - Input: JPEG - Quality: 90 (MP/s/Watt)",HIB,0.043,0.039 "JPEG XL libjxl - Input: JPEG - Quality: 100 (MP/s/Watt)",HIB,0.003,0.003 "JPEG XL libjxl - Input: PNG - Quality: 90 (MP/s/Watt)",HIB,0.045,0.041 "LeelaChessZero - Backend: BLAS (Nodes/s)",HIB,9077,8423 "LeelaChessZero - Backend: Eigen (Nodes/s)",HIB,9096,8162 "LeelaChessZero - Backend: BLAS (Nodes/s/Watt)",HIB,23.782,21.932 "LeelaChessZero - Backend: Eigen (Nodes/s/Watt)",HIB,24.891,21.292 "GROMACS - Implementation: MPI CPU - Input: water_GMX50_bare (Ns/Day)",HIB,18.764,18.467 "GROMACS - Implementation: MPI CPU - Input: water_GMX50_bare (Ns/Day/Watt)",HIB,0.035,0.033 "AI Benchmark Alpha - Device AI Score (Score/Watt)",HIB,20.522,9.349 "AI Benchmark Alpha - Device Inference Score (Score)",HIB,3510,1821 "AI Benchmark Alpha - Device Training Score (Score)",HIB,2701,1066 "Numpy Benchmark - (Score/Watt)",HIB,2.687,2.474 "AI Benchmark Alpha - Device AI Score (Score)",HIB,6211,2887 "Numpy Benchmark - (Score)",HIB,575.66,548.83 "Darmstadt Automotive Parallel Heterogeneous Suite - Backend: OpenMP - Kernel: NDT Mapping (Test Cases/min)",HIB,1371.18,1335.63 "Darmstadt Automotive Parallel Heterogeneous Suite - Backend: OpenMP - Kernel: Points2Image (Test Cases/min)",HIB,13677.764494843,11521.38 "Darmstadt Automotive Parallel Heterogeneous Suite - Backend: OpenMP - Kernel: NDT Mapping (Test Cases/min/Watt)",HIB,6.416,5.455 "Darmstadt Automotive Parallel Heterogeneous Suite - Backend: OpenMP - Kernel: Points2Image (Test Cases/min/Watt)",HIB,52.823,42.188 "AI Benchmark Alpha - CPU Temperature Monitor (Celsius)",LIB,39.21,40.62 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,43.66,45.16 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,49.4,51.54 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,47.98,50.55 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,51.19,54.42 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,51.87,54.9 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,47.8,50.7 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,48.5,50.59 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,51.94,51.54 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,50.13,52.15 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,52.94,54.43 "Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,48.69,50.69 "TensorFlow - CPU Temperature Monitor (Celsius)",LIB,41.66,43.43 "TensorFlow - CPU Temperature Monitor (Celsius)",LIB,40.53,41.03 "TensorFlow - CPU Temperature Monitor (Celsius)",LIB,41.7,40.49 "LeelaChessZero - CPU Temperature Monitor (Celsius)",LIB,51.98,57.42 "LeelaChessZero - CPU Temperature Monitor (Celsius)",LIB,53.41,39.89 "Embree - CPU Temperature Monitor (Celsius)",LIB,40.45,45.78 "Embree - CPU Temperature Monitor (Celsius)",LIB,38.4,42.39 "Embree - CPU Temperature Monitor (Celsius)",LIB,40.52,45.81 "OpenVKL - CPU Temperature Monitor (Celsius)",LIB,49.91,52.24 "OSPRay - CPU Temperature Monitor (Celsius)",LIB,56.2,59.76 "OSPRay - CPU Temperature Monitor (Celsius)",LIB,56.82,60.35 "OSPRay - CPU Temperature Monitor (Celsius)",LIB,57.75,61.28 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,56.31,58.88 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,58.4,60.67 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,59.04,61.29 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,57.91,60.2 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,59.73,62 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,60.33,60.27 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,57.66,59.91 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,58.37,60.6 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,58.94,61.29 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,56.96,59.86 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,59.68,61.63 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,59.85,59.94 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,58.44,60.35 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,58.72,60.78 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,59.32,61.27 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,58.21,59.98 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,59.86,61.61 "OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,57.95,60.75 "oneDNN - CPU Temperature Monitor (Celsius)",LIB,46.02,47.73 "oneDNN - CPU Temperature Monitor (Celsius)",LIB,43.54,43.77 "oneDNN - CPU Temperature Monitor (Celsius)",LIB,39.32,41.36 "oneDNN - CPU Temperature Monitor (Celsius)",LIB,45.97,45.88 "oneDNN - CPU Temperature Monitor (Celsius)",LIB,46.67,46.63 "oneDNN - CPU Temperature Monitor (Celsius)",LIB,45.84,46.79 "Mobile Neural Network - CPU Temperature Monitor (Celsius)",LIB,48.36,49.52 "Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,52.16,52.4 "Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,58.61,57.87 "Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,57.13,58.18 "Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,56.3,57.15 "Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,57.9,58.73 "Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,59.01,59.2 "NCNN - CPU Temperature Monitor (Celsius)",LIB,44.45,46.1 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,57.35,56.19 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,58.13,62.45 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,55.42,59.9 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,52.16,59.22 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,57.42,58.18 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,57.96,58.74 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,59.43,63 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,60.88,60.05 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,57.87,61.14 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,58.98,59.95 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,56.8,57.97 "OpenVINO - CPU Temperature Monitor (Celsius)",LIB,58.43,56.29 "GROMACS - CPU Temperature Monitor (Celsius)",LIB,56.11,54.85 "ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,51.09,53.38 "ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,39.9,43.19 "ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,46.47,48.37 "ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,48.03,50.46 "Numpy Benchmark - CPU Temperature Monitor (Celsius)",LIB,36.34,37.86 "miniBUDE - CPU Temperature Monitor (Celsius)",LIB,38.53,45.48 "miniBUDE - CPU Temperature Monitor (Celsius)",LIB,47.75,53.01 "SVT-AV1 - CPU Temperature Monitor (Celsius)",LIB,36.81,42.38 "SVT-AV1 - CPU Temperature Monitor (Celsius)",LIB,34.59,40.55 "Numenta Anomaly Benchmark - CPU Temperature Monitor (Celsius)",LIB,40.39,43.18 "Numenta Anomaly Benchmark - CPU Temperature Monitor (Celsius)",LIB,39.19,42.8 "Numenta Anomaly Benchmark - CPU Temperature Monitor (Celsius)",LIB,38.84,41.49 "Intel Open Image Denoise - CPU Temperature Monitor (Celsius)",LIB,38.13,41.62 "Intel Open Image Denoise - CPU Temperature Monitor (Celsius)",LIB,38.19,43.31 "Intel Open Image Denoise - CPU Temperature Monitor (Celsius)",LIB,39.78,44.73 "Darmstadt Automotive Parallel Heterogeneous Suite - CPU Temperature Monitor (Celsius)",LIB,35.45,39.41 "Darmstadt Automotive Parallel Heterogeneous Suite - CPU Temperature Monitor (Celsius)",LIB,38.03,39.2 "simdjson - CPU Temperature Monitor (Celsius)",LIB,40.49,51.01 "simdjson - CPU Temperature Monitor (Celsius)",LIB,36.74,47.04 "simdjson - CPU Temperature Monitor (Celsius)",LIB,36.37,46.25 "simdjson - CPU Temperature Monitor (Celsius)",LIB,36.17,46.91 "simdjson - CPU Temperature Monitor (Celsius)",LIB,36.07,46.19 "OpenFOAM - CPU Temperature Monitor (Celsius)",LIB,62.64,64.94 "CP2K Molecular Dynamics - CPU Temperature Monitor (Celsius)",LIB,44.52,44.37 "JPEG XL libjxl - CPU Temperature Monitor (Celsius)",LIB,39.72,39.36 "JPEG XL libjxl - CPU Temperature Monitor (Celsius)",LIB,36.48,36.56 "JPEG XL libjxl - CPU Temperature Monitor (Celsius)",LIB,36.96,36.75 "SMHasher - Hash: FarmHash32 x86_64 AVX (cycles/hash)",LIB,26.387,26.412 "OSPRay Studio - Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,148,181 "OSPRay Studio - Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,2353,2871 "OSPRay Studio - Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,4698,5749 "OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,581,710 "OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,9271,11321 "OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,18546,22647 "OSPRay Studio - Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,154,184 "OSPRay Studio - Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,2384,2924 "OSPRay Studio - Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,4764,5861 "OSPRay Studio - Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,604,722 "OSPRay Studio - Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,9385,11524 "OSPRay Studio - Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,18808,22985 "OSPRay Studio - Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,177,214 "OSPRay Studio - Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,2804,3413 "OSPRay Studio - Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,5608,6820 "OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,694,841 "OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,11070,13398 "OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,22184,26785 "oneDNN - Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU (ms)",LIB,0.516167,0.537682 "oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU (ms)",LIB,22.5875,22.8354 "oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU (ms)",LIB,0.989591,1.76336 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU (ms)",LIB,1962.06,4953.98 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,1955.39,4989.13 "oneDNN - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,2361.27,1715.76 "Mobile Neural Network - Model: resnet-v2-50 (ms)",LIB,15.441,24.098 "Mobile Neural Network - Model: SqueezeNetV1.0 (ms)",LIB,8.579,9.146 "Mobile Neural Network - Model: inception-v3 (ms)",LIB,45.812,30.436 "NCNN - Target: CPU - Model: mnasnet (ms)",LIB,42.30,44.19 "NCNN - Target: CPU - Model: efficientnet-b0 (ms)",LIB,57.71,62.86 "NCNN - Target: CPU - Model: blazeface (ms)",LIB,25.88,29.00 "NCNN - Target: CPU - Model: googlenet (ms)",LIB,72.80,76.13 "NCNN - Target: CPU - Model: resnet50 (ms)",LIB,66.34,67.48 "NCNN - Target: CPU - Model: regnety_400m (ms)",LIB,247.32,270.12 "NCNN - Target: CPU - Model: vision_transformer (ms)",LIB,74.93,86.16 "NCNN - Target: CPU - Model: FastestDet (ms)",LIB,58.95,60.73 "OpenVINO - Model: Face Detection FP16 - Device: CPU (ms)",LIB,469.29,1088.50 "OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,246.98,503.50 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (ms)",LIB,0.55,1.21 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (ms)",LIB,0.36,0.57 "OpenVINO - Model: Person Detection FP16 - Device: CPU (ms)",LIB,1100.25,1864.93 "OpenVINO - Model: Person Detection FP32 - Device: CPU (ms)",LIB,1101.00,1845.95 "OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,9.63,19.69 "OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (ms)",LIB,4.79,11.66 "OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (ms)",LIB,4.28,7.90 "OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (ms)",LIB,6.43,12.67 "OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,5.29,9.33 "OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (ms)",LIB,50.11,107.62 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,11.7586,13.5907 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,155.3462,187.8540 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.3413,5.6282 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,80.0826,95.3347 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,49.0328,67.9118 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,28.9609,32.6647 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,9.9408,14.0655 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,125.7860,195.1656 "Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.2712,6.3313 "Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,111.7282,138.5861 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,29.1892,32.7505 "Numenta Anomaly Benchmark - Detector: Bayesian Changepoint (sec)",LIB,16.677,17.389 "Numenta Anomaly Benchmark - Detector: Windowed Gaussian (sec)",LIB,4.727,4.882 "Numenta Anomaly Benchmark - Detector: Relative Entropy (sec)",LIB,9.898,10.035 "OpenFOAM - Input: drivaerFastback, Medium Mesh Size - Mesh Time (sec)",LIB,135.77418,144.3478 "OpenFOAM - Input: drivaerFastback, Medium Mesh Size - Execution Time (sec)",LIB,113.63733,135.21648 "CP2K Molecular Dynamics - Input: Fayalite-FIST (sec)",LIB,1122.725,1198.408 "AI Benchmark Alpha - CPU Power Consumption Monitor (Watts)",LIB,302.65,308.79 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,306.45,321.84 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,479.34,508.29 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,324.57,352.22 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,516.75,552 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,530.66,558.42 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,321.79,350.76 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,334.16,352.89 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,536.99,502.51 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,341.29,364.84 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,552.74,551.67 "Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,328.4,351.07 "TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,307.14,338.79 "TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,299.74,318.92 "TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,308.04,298.91 "LeelaChessZero - CPU Power Consumption Monitor (Watts)",LIB,381.67,384.04 "LeelaChessZero - CPU Power Consumption Monitor (Watts)",LIB,365.43,383.34 "Embree - CPU Power Consumption Monitor (Watts)",LIB,301.06,410.27 "Embree - CPU Power Consumption Monitor (Watts)",LIB,254.47,318.92 "Embree - CPU Power Consumption Monitor (Watts)",LIB,345.51,438.59 "OpenVKL - CPU Power Consumption Monitor (Watts)",LIB,466.92,490.53 "OSPRay - CPU Power Consumption Monitor (Watts)",LIB,579.96,617.94 "OSPRay - CPU Power Consumption Monitor (Watts)",LIB,581.88,619.7 "OSPRay - CPU Power Consumption Monitor (Watts)",LIB,593.48,627.82 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,593,614.05 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,599.28,621.76 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,606.01,628.81 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,589.6,610.5 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,617.93,637.87 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,623,609.76 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,591.32,612.92 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,598.66,621.06 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,604.19,626.51 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,577.88,609.01 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,615.86,635.42 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,615.86,609.38 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,597.2,620.67 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,602.28,620.61 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,611.01,629.66 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,591.33,611.93 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,618.36,636.62 "OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,589.53,620 "oneDNN - CPU Power Consumption Monitor (Watts)",LIB,327.3,379.51 "oneDNN - CPU Power Consumption Monitor (Watts)",LIB,376.06,392.47 "oneDNN - CPU Power Consumption Monitor (Watts)",LIB,248.76,323.91 "oneDNN - CPU Power Consumption Monitor (Watts)",LIB,418.59,412.46 "oneDNN - CPU Power Consumption Monitor (Watts)",LIB,419.24,412.52 "oneDNN - CPU Power Consumption Monitor (Watts)",LIB,413.84,413.93 "Mobile Neural Network - CPU Power Consumption Monitor (Watts)",LIB,327.57,334.93 "Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,594.44,558.04 "Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,618.09,587.2 "Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,568.06,580.08 "Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,596.43,586.76 "Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,621.93,599.32 "Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,643.32,612.56 "NCNN - CPU Power Consumption Monitor (Watts)",LIB,396.44,400.13 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,639.23,585.03 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,611.9,662.24 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,565.59,592.38 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,514.04,591.56 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,604.54,578.59 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,607.42,593.3 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,639.18,683.89 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,660.03,598.02 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,597.63,633.62 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,633.22,613.49 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,588.02,587.65 "OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,636.45,594.7 "GROMACS - CPU Power Consumption Monitor (Watts)",LIB,534.88,552.82 "ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,494.16,502.96 "ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,259.31,266.8 "ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,370.52,379.57 "ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,441.77,447.6 "Numpy Benchmark - CPU Power Consumption Monitor (Watts)",LIB,214.2,221.87 "miniBUDE - CPU Power Consumption Monitor (Watts)",LIB,280.58,414.07 "miniBUDE - CPU Power Consumption Monitor (Watts)",LIB,498.76,564.45 "SVT-AV1 - CPU Power Consumption Monitor (Watts)",LIB,162.93,243.27 "SVT-AV1 - CPU Power Consumption Monitor (Watts)",LIB,175.42,241.76 "Numenta Anomaly Benchmark - CPU Power Consumption Monitor (Watts)",LIB,215.98,251.15 "Numenta Anomaly Benchmark - CPU Power Consumption Monitor (Watts)",LIB,184.72,259.24 "Numenta Anomaly Benchmark - CPU Power Consumption Monitor (Watts)",LIB,202.81,250.83 "Intel Open Image Denoise - CPU Power Consumption Monitor (Watts)",LIB,287.61,366.67 "Intel Open Image Denoise - CPU Power Consumption Monitor (Watts)",LIB,288.65,365.55 "Intel Open Image Denoise - CPU Power Consumption Monitor (Watts)",LIB,325.63,398.95 "Darmstadt Automotive Parallel Heterogeneous Suite - CPU Power Consumption Monitor (Watts)",LIB,213.7,244.83 "Darmstadt Automotive Parallel Heterogeneous Suite - CPU Power Consumption Monitor (Watts)",LIB,258.94,273.1 "simdjson - CPU Power Consumption Monitor (Watts)",LIB,211.42,224.4 "simdjson - CPU Power Consumption Monitor (Watts)",LIB,207.04,222.49 "simdjson - CPU Power Consumption Monitor (Watts)",LIB,209.87,223.52 "simdjson - CPU Power Consumption Monitor (Watts)",LIB,209,221.17 "simdjson - CPU Power Consumption Monitor (Watts)",LIB,209.43,221.48 "OpenFOAM - CPU Power Consumption Monitor (Watts)",LIB,662.16,673.86 "CP2K Molecular Dynamics - CPU Power Consumption Monitor (Watts)",LIB,357.99,361.54 "JPEG XL libjxl - CPU Power Consumption Monitor (Watts)",LIB,223.4,233.92 "JPEG XL libjxl - CPU Power Consumption Monitor (Watts)",LIB,217.33,222.62 "JPEG XL libjxl - CPU Power Consumption Monitor (Watts)",LIB,222.23,232.37