AMD EPYC 9754 1P benchmarks with AVX-512 benchmarking and then AVX-512 disabled. Tests by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2307197-NE-AMDBERGAM43
AMD EPYC 9754 Bergamo AVX-512
AMD EPYC 9754 1P benchmarks with AVX-512 benchmarking and then AVX-512 disabled. Tests by Michael Larabel for a future article.
,,"AVX512 On","AVX512 Off"
Processor,,AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads),AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)
Motherboard,,AMD Titanite_4G (RTI1007B BIOS),AMD Titanite_4G (RTI1007B BIOS)
Chipset,,AMD Device 14a4,AMD Device 14a4
Memory,,768GB,768GB
Disk,,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007
Graphics,,ASPEED,ASPEED
Network,,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe
OS,,Ubuntu 22.04,Ubuntu 22.04
Kernel,,5.19.0-41-generic (x86_64),5.19.0-41-generic (x86_64)
Desktop,,GNOME Shell 42.5,GNOME Shell 42.5
Display Server,,X Server 1.21.1.4,X Server 1.21.1.4
Vulkan,,1.3.224,1.3.224
Compiler,,GCC 11.3.0,GCC 11.3.0
File-System,,ext4,ext4
Screen Resolution,,1024x768,1024x768
,,"AVX512 On","AVX512 Off"
"CPU Temperature Monitor - Phoronix Test Suite System Monitoring (Celsius)",,51.4,44.22
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring (Megahertz)",,2918.06,2979.69
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,231.36,179.15
"miniBUDE - Implementation: OpenMP - Input Deck: BM1 (Billion Interactions/s)",HIB,237.027,187.107
"miniBUDE - Implementation: OpenMP - Input Deck: BM2 (Billion Interactions/s)",HIB,238.887,181.132
"miniBUDE - Implementation: OpenMP - Input Deck: BM1 (Billion Interactions/s/Watt)",HIB,1.55,1.026
"miniBUDE - Implementation: OpenMP - Input Deck: BM2 (Billion Interactions/s/Watt)",HIB,0.89,0.62
"OpenVINO - Model: Face Detection FP16 - Device: CPU (FPS)",HIB,60.73,26.18
"OpenVINO - Model: Person Detection FP16 - Device: CPU (FPS)",HIB,27.08,15.06
"OpenVINO - Model: Person Detection FP32 - Device: CPU (FPS)",HIB,27.01,14.99
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (FPS)",HIB,1430.45,1190.91
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,118.00,57.95
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (FPS)",HIB,5690.34,3954.90
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (FPS)",HIB,6073.22,2551.70
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,580.40,251.97
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,11818.33,5692.99
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,6638.71,3317.34
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (FPS)",HIB,110240.89,62564.16
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (FPS)",HIB,73970.12,66895.49
"Embree - Binary: Pathtracer ISPC - Model: Crown (FPS/Watt)",HIB,0.672,0.56
"Embree - Binary: Pathtracer ISPC - Model: Asian Dragon (FPS/Watt)",HIB,0.92,0.715
"Embree - Binary: Pathtracer ISPC - Model: Crown (FPS)",HIB,125.5414,112.2274
"Embree - Binary: Pathtracer ISPC - Model: Asian Dragon Obj (FPS/Watt)",HIB,1.07,0.842
"Embree - Binary: Pathtracer ISPC - Model: Asian Dragon (FPS)",HIB,157.6450,132.9504
"Embree - Binary: Pathtracer ISPC - Model: Asian Dragon Obj (FPS)",HIB,134.8396,115.2682
"miniBUDE - Implementation: OpenMP - Input Deck: BM1 (GFInst/s)",HIB,5925.670,4677.682
"miniBUDE - Implementation: OpenMP - Input Deck: BM2 (GFInst/s)",HIB,5972.187,4528.305
"libxsmm - M N K: 128 (GFLOPS/s/Watt)",HIB,13.066,12.527
"libxsmm - M N K: 256 (GFLOPS/s)",HIB,3342.5,2415.3
"libxsmm - M N K: 256 (GFLOPS/s/Watt)",HIB,15.9,11.399
"libxsmm - M N K: 128 (GFLOPS/s)",HIB,2690.7,2573.3
"TensorFlow - Device: CPU - Batch Size: 16 - Model: AlexNet (images/sec/Watt)",HIB,2.966,0.576
"TensorFlow - Device: CPU - Batch Size: 32 - Model: AlexNet (images/sec/Watt)",HIB,4.376,0.691
"TensorFlow - Device: CPU - Batch Size: 64 - Model: AlexNet (images/sec/Watt)",HIB,5.938,0.778
"TensorFlow - Device: CPU - Batch Size: 256 - Model: AlexNet (images/sec/Watt)",HIB,6.984,0.839
"TensorFlow - Device: CPU - Batch Size: 512 - Model: AlexNet (images/sec/Watt)",HIB,7.097,0.865
"TensorFlow - Device: CPU - Batch Size: 16 - Model: GoogLeNet (images/sec/Watt)",HIB,0.774,0.335
"TensorFlow - Device: CPU - Batch Size: 16 - Model: ResNet-50 (images/sec/Watt)",HIB,0.294,0.113
"TensorFlow - Device: CPU - Batch Size: 32 - Model: GoogLeNet (images/sec/Watt)",HIB,1.138,0.36
"TensorFlow - Device: CPU - Batch Size: 32 - Model: ResNet-50 (images/sec/Watt)",HIB,0.407,0.124
"TensorFlow - Device: CPU - Batch Size: 64 - Model: GoogLeNet (images/sec/Watt)",HIB,1.476,0.369
"TensorFlow - Device: CPU - Batch Size: 64 - Model: ResNet-50 (images/sec)",HIB,96.63,18.45
"TensorFlow - Device: CPU - Batch Size: 64 - Model: ResNet-50 (images/sec/Watt)",HIB,0.483,0.131
"TensorFlow - Device: CPU - Batch Size: 256 - Model: GoogLeNet (images/sec/Watt)",HIB,2.078,0.362
"TensorFlow - Device: CPU - Batch Size: 16 - Model: AlexNet (images/sec)",HIB,342.88,70.10
"TensorFlow - Device: CPU - Batch Size: 32 - Model: AlexNet (images/sec)",HIB,562.48,84.96
"TensorFlow - Device: CPU - Batch Size: 64 - Model: AlexNet (images/sec)",HIB,857.55,97.59
"TensorFlow - Device: CPU - Batch Size: 256 - Model: ResNet-50 (images/sec/Watt)",HIB,0.537,0.143
"TensorFlow - Device: CPU - Batch Size: 256 - Model: AlexNet (images/sec)",HIB,1422.36,106.28
"TensorFlow - Device: CPU - Batch Size: 512 - Model: AlexNet (images/sec)",HIB,1632.40,109.88
"TensorFlow - Device: CPU - Batch Size: 16 - Model: GoogLeNet (images/sec)",HIB,104.77,39.64
"TensorFlow - Device: CPU - Batch Size: 16 - Model: ResNet-50 (images/sec)",HIB,43.11,15.91
"TensorFlow - Device: CPU - Batch Size: 32 - Model: GoogLeNet (images/sec)",HIB,180.77,44.46
"TensorFlow - Device: CPU - Batch Size: 32 - Model: ResNet-50 (images/sec)",HIB,71.62,17.48
"TensorFlow - Device: CPU - Batch Size: 512 - Model: GoogLeNet (images/sec/Watt)",HIB,1.766,0.369
"TensorFlow - Device: CPU - Batch Size: 64 - Model: GoogLeNet (images/sec)",HIB,277.24,46.28
"TensorFlow - Device: CPU - Batch Size: 256 - Model: GoogLeNet (images/sec)",HIB,501.67,46.17
"TensorFlow - Device: CPU - Batch Size: 512 - Model: ResNet-50 (images/sec/Watt)",HIB,0.542,0.148
"TensorFlow - Device: CPU - Batch Size: 256 - Model: ResNet-50 (images/sec)",HIB,119.32,19.89
"TensorFlow - Device: CPU - Batch Size: 512 - Model: GoogLeNet (images/sec)",HIB,417.25,46.92
"TensorFlow - Device: CPU - Batch Size: 512 - Model: ResNet-50 (images/sec)",HIB,122.81,20.78
"OpenVKL - Benchmark: vklBenchmark ISPC (Items / Sec)",HIB,1398,1179
"OpenVKL - Benchmark: vklBenchmark ISPC (Items / Sec/Watt)",HIB,5.858,4.569
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/ao/real_time (Items/sec)",HIB,32.7557,19.1731
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time (Items/sec)",HIB,31.6753,18.0203
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time (Items/sec)",HIB,27.9715,19.5463
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/ao/real_time (Items/sec/Watt)",HIB,0.118,0.066
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time (Items/sec/Watt)",HIB,0.114,0.062
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time (Items/sec/Watt)",HIB,0.106,0.072
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,73.5393,61.3689
"Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1381.5669,718.3032
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,247.9653,213.6393
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,970.0568,870.9541
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,624.7370,522.1104
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,127.0611,69.3341
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,316.1679,260.7671
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,73.1459,61.1755
"Cpuminer-Opt - Algorithm: x25x (kH/s/Watt)",HIB,16.854,10.811
"Cpuminer-Opt - Algorithm: scrypt (kH/s/Watt)",HIB,8.913,6.476
"Cpuminer-Opt - Algorithm: Blake-2 S (kH/s/Watt)",HIB,22160.821,14551.236
"Cpuminer-Opt - Algorithm: Garlicoin (kH/s/Watt)",HIB,272.425,202.319
"Cpuminer-Opt - Algorithm: Skeincoin (kH/s/Watt)",HIB,3691.562,2892.865
"Cpuminer-Opt - Algorithm: Myriad-Groestl (kH/s/Watt)",HIB,51.65,44.666
"Cpuminer-Opt - Algorithm: LBC, LBRY Credits (kH/s/Watt)",HIB,2003.504,1052.188
"Cpuminer-Opt - Algorithm: scrypt (kH/s)",HIB,2993.21,2033.15
"Cpuminer-Opt - Algorithm: Skeincoin (kH/s)",HIB,1174953,937977
"Cpuminer-Opt - Algorithm: Myriad-Groestl (kH/s)",HIB,8628.76,7149.95
"Cpuminer-Opt - Algorithm: Quad SHA-256, Pyrite (kH/s/Watt)",HIB,4347.583,2825.313
"Cpuminer-Opt - Algorithm: x25x (kH/s)",HIB,4977.89,3010.37
"Cpuminer-Opt - Algorithm: Blake-2 S (kH/s)",HIB,7238650,4555580
"Cpuminer-Opt - Algorithm: Garlicoin (kH/s)",HIB,53090,39473
"Cpuminer-Opt - Algorithm: LBC, LBRY Credits (kH/s)",HIB,660660,332667
"Cpuminer-Opt - Algorithm: Quad SHA-256, Pyrite (kH/s)",HIB,1498937,876137
"miniBUDE - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2596.54,2529.32
"miniBUDE - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2796.22,2696.28
"libxsmm - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3087.64,3086
"libxsmm - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3053.52,3038.32
"Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2511.34,2627.44
"Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2565.48,2583.53
"Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2841,2855.36
"OpenVKL - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2983.53,2958.42
"OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2885.39,2925.73
"OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2874.99,2925.25
"OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3023.76,3052.01
"oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2998.37,2824.21
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2908.54,3018.62
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2959.08,2951.65
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2925.04,2779.15
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3058.02,3065.11
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2803.75,2899.47
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3020.51,3045.75
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2885.64,2745.69
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2965.63,2918.62
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2800.7,2992.29
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2836.18,3038.94
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2751.31,3057.33
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2742.05,3072.51
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2753.56,3078.92
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2977.26,3032.2
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3040.64,3074.96
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2992.05,3064.29
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3065.92,3083.66
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2995.48,3075.46
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3021.38,3089.82
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2916.06,3085.78
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2956.33,3085.27
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2973.8,3083.42
"TensorFlow - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2958.12,3085.93
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3011.23,2933.49
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3025.57,3015.27
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3001.83,3022.95
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3011.93,2962.04
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3033.89,2930.67
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3005.55,3047.57
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3012.68,2940.03
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3005.76,2951.54
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2708.05,2490.87
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2930.63,2648.87
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2936.37,2644.66
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3029.08,2917.75
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2695.61,2688.47
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2705.17,2659.24
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2718.41,2373.12
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2660.92,2536.86
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2618.88,2671.47
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2678.6,2483.31
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2892.45,2590.47
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2761.45,2626.22
"miniBUDE - CPU Temperature Monitor (Celsius)",LIB,36.27,37.01
"miniBUDE - CPU Temperature Monitor (Celsius)",LIB,53.42,55.09
"libxsmm - CPU Temperature Monitor (Celsius)",LIB,50.34,49.14
"libxsmm - CPU Temperature Monitor (Celsius)",LIB,49.71,49.37
"Embree - CPU Temperature Monitor (Celsius)",LIB,43.2,44.16
"Embree - CPU Temperature Monitor (Celsius)",LIB,41.4,42.18
"Embree - CPU Temperature Monitor (Celsius)",LIB,39.29,36.72
"OpenVKL - CPU Temperature Monitor (Celsius)",LIB,53.11,54.49
"OSPRay - CPU Temperature Monitor (Celsius)",LIB,55.09,57.54
"OSPRay - CPU Temperature Monitor (Celsius)",LIB,57.17,59.73
"OSPRay - CPU Temperature Monitor (Celsius)",LIB,55.6,57
"oneDNN - CPU Temperature Monitor (Celsius)",LIB,39.17,39.83
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,58.67,55.17
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,66.42,63.58
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,64.01,63.97
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,45.44,43.7
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,63.36,62.91
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,42.22,40.92
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,63.23,59.55
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,68.7,61.98
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,41.12,40.33
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,37.8,37.13
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,38.29,36.5
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,44.8,35.96
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,49.84,36.18
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,38.5,35.71
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,38.15,37.18
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,40.25,35.32
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,41.82,37.55
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,44.29,35.87
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,45.26,38.07
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,50.91,36.4
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,48.39,38.33
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,50.93,36.83
"TensorFlow - CPU Temperature Monitor (Celsius)",LIB,48.79,39.11
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,57.53,54.46
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,58.13,53.75
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,53.15,52.95
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,62.85,65.21
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,60.4,60.72
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,53.12,53.98
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,57.72,58.31
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,57.61,58.33
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,63.07,59.32
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,61.2,57.45
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,60.59,58.01
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,51.73,53.88
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,59.48,65.47
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,59.16,67.75
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,64.17,61.09
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,57.32,56.71
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,61.29,67.37
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,60.59,57.05
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,64.63,61.77
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,63.4,63.86
"oneDNN - Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,1174.75,1317.57
"OpenVINO - Model: Face Detection FP16 - Device: CPU (ms)",LIB,1048.37,2423.39
"OpenVINO - Model: Person Detection FP16 - Device: CPU (ms)",LIB,2334.29,4153.59
"OpenVINO - Model: Person Detection FP32 - Device: CPU (ms)",LIB,2339.81,4170.49
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (ms)",LIB,44.84,53.79
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,540.35,1094.52
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (ms)",LIB,11.26,16.17
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (ms)",LIB,10.52,25.06
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (ms)",LIB,110.35,254.01
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,10.82,22.47
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,9.63,19.28
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (ms)",LIB,0.99,1.91
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (ms)",LIB,1.58,1.76
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,858.4029,1023.1690
"Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,46.2608,88.9093
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,259.6468,298.0628
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,65.8909,73.3502
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,102.2238,122.2295
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,498.4779,906.9414
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,201.5964,244.1513
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,859.7119,1025.4806
"miniBUDE - CPU Power Consumption Monitor (Watts)",LIB,152.91,182.37
"miniBUDE - CPU Power Consumption Monitor (Watts)",LIB,268.29,292.27
"libxsmm - CPU Power Consumption Monitor (Watts)",LIB,205.93,205.43
"libxsmm - CPU Power Consumption Monitor (Watts)",LIB,210.22,211.88
"Embree - CPU Power Consumption Monitor (Watts)",LIB,186.8,200.34
"Embree - CPU Power Consumption Monitor (Watts)",LIB,171.32,186.06
"Embree - CPU Power Consumption Monitor (Watts)",LIB,126,136.94
"OpenVKL - CPU Power Consumption Monitor (Watts)",LIB,238.66,258.07
"OSPRay - CPU Power Consumption Monitor (Watts)",LIB,276.95,290.55
"OSPRay - CPU Power Consumption Monitor (Watts)",LIB,278.83,292.23
"OSPRay - CPU Power Consumption Monitor (Watts)",LIB,262.99,271.67
"oneDNN - CPU Power Consumption Monitor (Watts)",LIB,176.75,202.02
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,295.35,278.45
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,335.83,313.97
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,326.64,313.07
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,194.88,195.1
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,318.28,324.24
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,167.06,160.08
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,329.75,316.17
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,344.77,310.1
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,115.59,121.66
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,128.55,122.96
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,144.41,125.39
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,203.67,126.68
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,230.01,127.04
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,135.4,118.42
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,146.59,140.27
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,158.9,123.57
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,176.04,141.13
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,187.89,125.28
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,200.22,140.41
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,241.46,127.43
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,222.08,139.18
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,236.33,127.28
"TensorFlow - CPU Power Consumption Monitor (Watts)",LIB,226.78,140.06
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,253.4,244.08
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,250.2,234.67
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,234.05,228.59
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,279.18,284.53
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,255.74,256.22
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,228.29,235.17
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,247.71,247.67
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,244.34,245.54
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,315.25,286.79
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,306.48,283.27
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,306.23,292.68
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,256.02,266.79
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,295.4,323.54
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,306.34,330.42
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,327.65,288.21
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,295.1,292.95
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,306.82,336.58
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,308.52,293.36
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,316.45,298.93
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,311.38,308.21