Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301176-NE-SAPPHIRER14
Sapphire Rapids AVX-512 Benchmarks
Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.
,,"Xeon 8380: AVX-512 Off","Xeon 8380: AVX-512 On","Xeon 8490H: AVX-512 Off","Xeon 8490H: AVX-512 On","EPYC 9654: AVX-512 Off","EPYC 9654: AVX-512 On"
Processor,,2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads),2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads),2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads)
Motherboard,,Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS),Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),AMD Titanite_4G (RTI1002E BIOS),AMD Titanite_4G (RTI1002E BIOS)
Chipset,,Intel Ice Lake IEH,Intel Ice Lake IEH,Intel Device 1bce,Intel Device 1bce,AMD Device 14a4,AMD Device 14a4
Memory,,512GB,512GB,1008GB,1008GB,1520GB,1520GB
Disk,,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007
Graphics,,ASPEED,ASPEED,ASPEED,ASPEED,ASPEED,ASPEED
Monitor,,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI
Network,,2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP,2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe
OS,,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10
Kernel,,5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64)
Desktop,,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1
Display Server,,X Server 1.21.1.4,X Server 1.21.1.4,X Server 1.21.1.4,X Server 1.21.1.4,X Server 1.21.1.4,X Server 1.21.1.4
Vulkan,,1.3.224,1.3.224,1.3.224,1.3.224,1.3.224,1.3.224
Compiler,,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0
File-System,,ext4,ext4,ext4,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080,1920x1080,1920x1080,1920x1080
,,"Xeon 8380: AVX-512 Off","Xeon 8380: AVX-512 On","Xeon 8490H: AVX-512 Off","Xeon 8490H: AVX-512 On","EPYC 9654: AVX-512 Off","EPYC 9654: AVX-512 On"
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring (Megahertz)",,3114.77,2939.27,3041.53,3000.31,3667.6,3615.9
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,365.97,451.19,588.67,582.55,,
"miniBUDE - Implementation: OpenMP - Input Deck: BM1 (Billion Interactions/s)",HIB,71.846,93.573,99.225,143.451,207.697,290.962
"miniBUDE - Implementation: OpenMP - Input Deck: BM1 (Billion Interactions/s/Watt)",HIB,0.161,0.218,0.181,0.292,0.619,1.024
"miniBUDE - Implementation: OpenMP - Input Deck: BM2 (Billion Interactions/s)",HIB,79.723,103.550,104.106,145.754,254.853,342.508
"miniBUDE - Implementation: OpenMP - Input Deck: BM2 (Billion Interactions/s/Watt)",HIB,0.156,0.204,0.17,0.246,0.481,0.679
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (FPS)",HIB,50413.98,67701.60,73906.76,103184.01,114083.24,118103.94
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (FPS)",HIB,1750.30,4442.95,3878.79,6206.72,6218.25,11029.45
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (FPS)",HIB,1014.27,1119.45,1732.74,3738.92,3791.80,7420.49
"Embree - Binary: Pathtracer ISPC - Model: Asian Dragon (FPS/Watt)",HIB,0.24,0.272,0.168,0.255,0.518,0.69
"Embree - Binary: Pathtracer ISPC - Model: Crown (FPS/Watt)",HIB,0.167,0.184,0.11,0.193,0.418,0.509
"Embree - Binary: Pathtracer ISPC - Model: Asian Dragon (FPS)",HIB,96.3441,106.1798,90.3959,122.5260,177.6774,213.9512
"Embree - Binary: Pathtracer ISPC - Model: Crown (FPS)",HIB,70.5079,74.8033,62.0377,92.6512,153.1815,181.8889
"miniBUDE - Implementation: OpenMP - Input Deck: BM1 (GFInst/s)",HIB,1796.159,2339.323,2480.607,3586.273,5192.425,7274.050
"miniBUDE - Implementation: OpenMP - Input Deck: BM2 (GFInst/s)",HIB,1993.067,2588.758,2602.652,3643.840,6371.320,8562.694
"Intel Open Image Denoise - Run: RT.hdr_alb_nrm.3840x2160 (Images / Sec/Watt)",HIB,0.006,0.009,0.007,0.01,0.012,0.012
"Intel Open Image Denoise - Run: RTLightmap.hdr.4096x4096 (Images / Sec/Watt)",HIB,0.003,0.004,0.003,0.004,0.005,0.005
"Intel Open Image Denoise - Run: RT.hdr_alb_nrm.3840x2160 (Images / Sec)",HIB,2.07,2.94,2.95,4.19,3.46,3.48
"Intel Open Image Denoise - Run: RTLightmap.hdr.4096x4096 (Images / Sec)",HIB,1.03,1.42,1.48,1.99,1.72,1.66
"OpenVKL - Benchmark: vklBenchmark ISPC (Items / Sec)",HIB,792,917,1034,1196,1176,1341
"OpenVKL - Benchmark: vklBenchmark ISPC (Items / Sec/Watt)",HIB,1.734,2.014,1.726,2.057,2.405,2.874
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/ao/real_time (Items/sec/Watt)",HIB,0.027,0.04,0.034,0.054,0.043,0.075
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time (Items/sec/Watt)",HIB,0.026,0.04,0.033,0.053,0.041,0.074
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time (Items/sec/Watt)",HIB,0.038,0.049,0.048,0.064,0.065,0.092
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/ao/real_time (Items/sec)",HIB,14.3455,21.2242,23.1748,36.3643,26.3953,43.7081
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time (Items/sec)",HIB,13.7792,21.0640,22.8328,35.9544,25.3096,43.2358
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time (Items/sec)",HIB,19.9578,25.5179,32.4837,42.9662,40.6658,54.1553
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,183.8325,227.4544,264.7704,424.2714,510.8775,613.9355
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,379.5792,455.0312,584.1487,875.6416,1006.0824,1205.1813
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,113.3261,228.1219,187.6477,281.2361,206.3171,191.3325
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,541.8617,835.7846,832.8542,1492.8844,1410.4222,1966.4052
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,16.8275,20.1933,21.2862,27.0670,30.8553,34.2322
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,43.1140,48.4134,66.7540,92.0211,120.5142,84.8676
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (items/sec)",HIB,45.8547,79.1405,46.8614,83.7008,71.5088,100.2855
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,158.5261,221.7294,232.2085,355.6686,491.3426,704.5818
"Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,69.7264,83.4197,84.8378,100.5397,109.2581,126.0114
"Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,247.2732,318.7928,405.7230,592.4522,660.5371,809.0751
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,16.7996,20.2313,21.1789,26.8432,30.4563,34.5008
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,43.1601,48.2393,66.7281,92.0328,120.5189,84.3996
"Cpuminer-Opt - Algorithm: scrypt (kH/s)",HIB,1122.74,2307.42,1623.88,3665.55,2947.94,4816.31
"Cpuminer-Opt - Algorithm: Triple SHA-256, Onecoin (kH/s)",HIB,647033,1328547,1092637,2074200,3338850,3326287
"Cpuminer-Opt - Algorithm: Quad SHA-256, Pyrite (kH/s)",HIB,355173,924040,687320,1472620,1334363,2252500
"Cpuminer-Opt - Algorithm: scrypt (kH/s/Watt)",HIB,2.249,4.627,2.618,5.636,5.437,8.054
"Cpuminer-Opt - Algorithm: Deepcoin (kH/s/Watt)",HIB,116.452,130.172,139.119,161.983,284.103,274.2
"Cpuminer-Opt - Algorithm: Skeincoin (kH/s/Watt)",HIB,800.435,1225.349,1035.238,1658.456,2428.444,3141.207
"Cpuminer-Opt - Algorithm: LBC, LBRY Credits (kH/s/Watt)",HIB,314.922,841.198,404.762,1033.116,834.907,1639.752
"Cpuminer-Opt - Algorithm: x25x (kH/s)",HIB,1840.41,2650.36,2166.90,4071.59,5712.58,7691.78
"Cpuminer-Opt - Algorithm: Triple SHA-256, Onecoin (kH/s/Watt)",HIB,1301.098,2672.898,1741.885,3203.648,5632.967,4975.703
"Cpuminer-Opt - Algorithm: Quad SHA-256, Pyrite (kH/s/Watt)",HIB,710.081,1859.256,1053.055,2276.981,2351.119,3555.703
"Cpuminer-Opt - Algorithm: x25x (kH/s/Watt)",HIB,3.713,5.338,3.313,6.322,10.302,13.447
"Cpuminer-Opt - Algorithm: Deepcoin (kH/s)",HIB,57930,64690,91107,105513,165240,160290
"Cpuminer-Opt - Algorithm: Skeincoin (kH/s)",HIB,399350,613273,677733,1072453,1413063,1990790
"Cpuminer-Opt - Algorithm: LBC, LBRY Credits (kH/s)",HIB,157083,419133,263917,672677,492780,1068993
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2976.98,2795.9,3038.98,2810.29,3709,3708.95
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2912.11,2658.36,2946.44,2739.54,3709,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2943.87,2506.26,3287.49,3360.23,3708.91,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2701.11,2582.73,2690.42,2613.81,3709,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2813.09,2702.75,3376.77,3277.52,3709,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2835.42,2731.23,2897.84,2758.89,3709,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2936.97,2689.46,3338.2,3337.42,3709,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2856.54,2704.63,2956.37,2821.77,3708.97,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3086.6,2877.68,3335.14,3282.46,3708.98,3708.99
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2883.8,2672.86,2540.23,2474.62,3709,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2834.61,2707.62,3338.32,3216.06,3709,3709
"Neural Magic DeepSparse - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2851.54,2747.12,2907.36,2733.68,3709,3708.93
"LeelaChessZero - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3292.51,3285.55,3429.01,3432.97,3709,3709.02
"LeelaChessZero - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3281.52,3283.63,3415.13,3431.65,3709,3709
"Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2765.28,2565.14,3074.54,3148.38,3434,3474.26
"Embree - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2850.31,2636.37,3070.52,3006.61,3462.8,3454.37
"OpenVKL - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2988.69,2929.05,2931.06,2887.71,3442.04,3486.01
"Intel Open Image Denoise - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2644.39,2484.49,2976.52,2985.41,3709,3709
"Intel Open Image Denoise - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2632.24,2543.96,2888.03,2755.84,3709,3709
"OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2855.45,2866.53,2900.68,2652.54,3210.13,3315.52
"OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2842.78,2873.43,2870.01,2689.91,3286.61,3267.78
"OSPRay - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2874.31,2590.11,2827.79,2769.32,3283.87,3287.4
"OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2893.57,2622.27,2891.42,2818.86,3276,3229.97
"OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2895.11,2639.14,2891.51,2766.18,3122.61,3157.82
"OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2881.42,2594.91,2877.33,2787.1,3177.76,3169.22
"OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2897.09,2609.05,2874.56,2823.98,3208.32,3308.27
"OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2867.88,2615.33,2836.9,2841.62,3186.89,3169.51
"OSPRay Studio - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2940.27,2577.91,2875.06,2803.99,3353.6,3343.21
"oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2610.75,2463.92,3132.72,3013.2,3666,3617.61
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2914.43,2665.18,2927.59,2817.46,3110.3,3249.64
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2888.78,2643.21,2957.05,2875.21,3335.89,3465.81
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2868.13,2651.15,2927.09,2857.47,3343.09,3410.31
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2916.53,2832.8,2906.57,2729.58,3487.56,3368.18
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2798.55,2779.27,2857.54,2936.48,3360.04,3515.22
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2776.23,2673.53,2872.56,2861.18,3299.49,3367.28
"Cpuminer-Opt - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2737.13,2623.57,2760.78,2817.16,3270.61,3394.73
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2585.83,2378.88,2584.6,2332.5,3709,3709
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2952.33,2464.76,2504.87,2571.73,3709,3709
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2788.99,2555.76,2479.96,2431.39,3709,3709
"miniBUDE - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2689.33,2694.51,2980.48,3105.81,3570.92,3597.25
"miniBUDE - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2943.56,2927.95,3016.33,2986.92,3709,3709
"OpenFOAM - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2959.08,2948.55,2735.03,2718.73,3709,3709.02
"OpenFOAM - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2980.24,2974.56,2870.69,2868.19,3709,3709
"SMHasher - Hash: FarmHash32 x86_64 AVX (MiB/sec)",HIB,30330.53,33979.99,37809.71,42508.35,36458.31,39795.36
"LeelaChessZero - Backend: BLAS (Nodes/s)",HIB,4780,5524,7542,10671,9425,9171
"LeelaChessZero - Backend: BLAS (Nodes/s/Watt)",HIB,12.093,14.012,14.107,19.808,24.695,24.191
"LeelaChessZero - Backend: Eigen (Nodes/s/Watt)",HIB,12.062,14.526,15.379,20.606,21.894,24.735
"LeelaChessZero - Backend: Eigen (Nodes/s)",HIB,4709,5750,8243,11134,8161,9085
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,62.34,61.39,46.12,47.32,48.39,48.49
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,70.96,67.48,49.25,48.66,55.22,53.22
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,72.43,69.21,47.99,48.31,54.68,51.97
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,73.09,71.83,49.9,50.14,56.4,55.39
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,66.51,67.84,46.86,47.84,53.07,52.39
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,64.63,67.15,46.87,47.81,54.3,52.19
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,65.88,66.78,46.14,47.74,52.81,52.83
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,65.7,68.2,47.69,48.39,44.79,52.93
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,66.11,65.21,45.53,45.45,42.84,42.68
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,70.06,70.25,49.22,49.76,46.39,46.32
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,65.39,67.31,46.62,47.75,43.61,43.31
"Neural Magic DeepSparse - CPU Temperature Monitor (Celsius)",LIB,64.77,66.83,46.66,47.79,44.85,43.53
"LeelaChessZero - CPU Temperature Monitor (Celsius)",LIB,60.47,71.37,48.76,44.16,46.72,40.84
"LeelaChessZero - CPU Temperature Monitor (Celsius)",LIB,65.29,66.24,47.75,43.65,46.31,40.64
"Embree - CPU Temperature Monitor (Celsius)",LIB,57.26,59.72,46.46,41.38,41.18,37.98
"Embree - CPU Temperature Monitor (Celsius)",LIB,61.37,57.94,46.83,42.39,42.18,39.98
"OpenVKL - CPU Temperature Monitor (Celsius)",LIB,69.77,69.3,49.72,48.73,47.03,45.24
"Intel Open Image Denoise - CPU Temperature Monitor (Celsius)",LIB,61.2,59.52,43.04,42.14,40.59,39.27
"Intel Open Image Denoise - CPU Temperature Monitor (Celsius)",LIB,59.15,57.82,43.41,42.32,40.87,39.68
"OSPRay - CPU Temperature Monitor (Celsius)",LIB,72.76,73.63,54.32,52.96,51.95,49.32
"OSPRay - CPU Temperature Monitor (Celsius)",LIB,72.16,71.64,55.05,53.77,52.77,49.7
"OSPRay - CPU Temperature Monitor (Celsius)",LIB,73.2,71.52,55.09,54.1,53.21,50.52
"OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,69.43,69.12,51.94,51.67,51.89,50.48
"OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,68.82,67.06,51.75,53.78,53.26,51.41
"OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,70.9,69.76,52.35,52.99,52.06,52.26
"OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,69.42,68.75,52.47,52.34,52.04,50.44
"OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,71.52,68.49,53.76,51.56,52.98,52.28
"OSPRay Studio - CPU Temperature Monitor (Celsius)",LIB,66.34,70.06,53.34,52.54,52.62,51.43
"oneDNN - CPU Temperature Monitor (Celsius)",LIB,57.62,59.32,39.82,40.95,36.99,37.73
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,68.06,68.72,50.54,51.1,48.03,50.14
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,69.9,70.07,51.93,52.28,50.93,55.17
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,70.21,70.84,53.91,52.72,50.97,52.94
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,69.68,69.47,53.43,52.08,50.8,52.15
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,70.18,70.34,54.53,53.02,50.56,50.78
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,69.73,71.11,53.91,52.76,50.92,52.6
"Cpuminer-Opt - CPU Temperature Monitor (Celsius)",LIB,69.81,70.74,54.02,52.42,51.26,53.37
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,73.27,73.47,53.81,52.99,50.69,50.87
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,74.99,74.24,53.23,52.32,52.53,51.65
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,72.7,72.62,53.53,52.8,50.88,52.63
"miniBUDE - CPU Temperature Monitor (Celsius)",LIB,65.07,65.79,48.48,46.05,42.25,41.15
"miniBUDE - CPU Temperature Monitor (Celsius)",LIB,72.36,72.68,52.39,48.68,48.71,47.83
"OpenFOAM - CPU Temperature Monitor (Celsius)",LIB,71.62,71.85,53.51,54.15,53.96,55.35
"OpenFOAM - CPU Temperature Monitor (Celsius)",LIB,70.16,69.77,54.29,54.65,54.3,55.54
"SMHasher - Hash: FarmHash32 x86_64 AVX (cycles/hash)",LIB,31.584,31.084,23.268,23.273,26.413,26.551
"OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,1491,1308,980,859,705,581
"OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,23943,20872,15601,13589,11216,9260
"OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,48165,41834,31373,27204,22475,18500
"OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer (ms)",LIB,1770,1563,1170,1029,836,695
"OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer (ms)",LIB,28490,24927,18608,16332,13341,11058
"OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer (ms)",LIB,62780,49847,37300,32749,26541,22120
"oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU (ms)",LIB,1.99286,0.875196,2.01241,0.736822,1.73667,0.986214
"Mobile Neural Network - Model: mobilenetV3 (ms)",LIB,1.764,1.709,2.288,2.055,3.889,3.866
"Mobile Neural Network - Model: squeezenetv1.1 (ms)",LIB,2.678,2.297,3.551,2.737,7.566,7.204
"Mobile Neural Network - Model: resnet-v2-50 (ms)",LIB,18.133,7.909,17.716,8.496,24.081,14.727
"Mobile Neural Network - Model: SqueezeNetV1.0 (ms)",LIB,4.195,3.999,5.222,4.415,9.278,8.762
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (ms)",LIB,1.58,1.16,1.57,1.04,1.14,0.96
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (ms)",LIB,11.41,4.49,30.91,19.31,7.71,4.34
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (ms)",LIB,19.68,17.83,17.29,8.01,12.64,6.46
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,217.0993,175.6914,226.2678,141.1445,187.3515,155.9118
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,105.2624,87.8658,102.6136,68.4347,95.1665,79.4967
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,8.8158,4.3750,5.3242,3.5509,4.8444,5.2240
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,73.7463,47.8216,71.9346,40.1407,67.9016,48.7003
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,59.4175,49.5145,46.9735,36.9382,32.4024,29.2029
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,916.9360,819.5325,887.5893,648.1995,787.3270,1128.8450
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,21.7973,12.6264,21.3212,11.9378,13.9740,9.9667
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,251.5678,180.1704,257.5622,168.2285,194.7179,135.9937
"Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,14.3286,11.9769,11.7823,9.9734,9.1835,7.9604
"Neural Magic DeepSparse - Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,161.3342,125.1639,147.4578,101.0425,144.8858,118.3525
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,59.5159,49.4208,47.2094,37.2473,32.8263,28.9771
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,913.4196,821.9588,889.3899,647.7545,787.7235,1132.6133
"OpenFOAM - Input: drivaerFastback, Medium Mesh Size - Mesh Time (sec)",LIB,162.72306,160.6645,169.84164,159.67329,146.75453,145.89944
"OpenFOAM - Input: drivaerFastback, Medium Mesh Size - Execution Time (sec)",LIB,358.63124,361.36688,194.78975,195.47713,110.94948,112.38169
"OpenFOAM - Input: drivaerFastback, Large Mesh Size - Mesh Time (sec)",LIB,887.20762,1051.3525,1039.3153,847.91029,867.379,996.77741
"OpenFOAM - Input: drivaerFastback, Large Mesh Size - Execution Time (sec)",LIB,7106.7611,7117.0059,4319.1245,4305.1242,2803.5444,2849.611
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,423.53,423.16,577.34,574.76,490.27,475.62
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,469.84,468.91,619.84,618.61,532.23,498.87
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,336.16,330.83,477.41,483.39,346.41,324.27
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,488.76,490.29,636.05,636.94,552.07,539.83
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,314.48,309.32,468.13,468.4,344.31,336.08
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,423.91,424.09,579.26,575.15,500.64,453.86
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,322.04,313.16,466.39,471.13,340.51,340.27
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,437.31,453.02,598.84,608.53,494,537.92
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,314.45,296.11,466.79,442.49,320.85,316.15
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,485.92,488.17,636.84,636.97,555.47,563.77
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,308.23,307.49,468.14,463.48,334.36,328.16
"Neural Magic DeepSparse - CPU Power Consumption Monitor (Watts)",LIB,424.25,423.52,575.96,576.22,492.05,449.53
"LeelaChessZero - CPU Power Consumption Monitor (Watts)",LIB,395.29,394.24,534.64,538.72,381.66,379.11
"LeelaChessZero - CPU Power Consumption Monitor (Watts)",LIB,390.39,395.84,535.98,540.33,372.74,367.29
"Embree - CPU Power Consumption Monitor (Watts)",LIB,400.96,389.97,537.44,480.24,343.25,310.11
"Embree - CPU Power Consumption Monitor (Watts)",LIB,421.57,406.24,565.19,478.88,366.77,357.33
"OpenVKL - CPU Power Consumption Monitor (Watts)",LIB,456.78,455.32,599.21,581.38,488.95,466.56
"Intel Open Image Denoise - CPU Power Consumption Monitor (Watts)",LIB,351.27,329.46,446.72,432.92,291.64,288.89
"Intel Open Image Denoise - CPU Power Consumption Monitor (Watts)",LIB,374.67,359.55,487.71,477.81,328.65,331.79
"OSPRay - CPU Power Consumption Monitor (Watts)",LIB,524.83,530.36,689.16,676.18,614.11,580.71
"OSPRay - CPU Power Consumption Monitor (Watts)",LIB,523.63,528.92,688.18,674.63,616.9,581.84
"OSPRay - CPU Power Consumption Monitor (Watts)",LIB,530.21,523.67,679.41,667.18,624.39,591.62
"OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,500.65,497.27,663.86,661.77,615.21,611.59
"OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,497.33,488.82,650.1,684.96,648.16,627.16
"OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,517.4,511.05,662.67,669.91,614.53,631.84
"OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,503.22,500.78,666.51,660.08,620.19,599.55
"OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,524.66,499.04,687.97,652.2,636.59,629.17
"OSPRay Studio - CPU Power Consumption Monitor (Watts)",LIB,460.86,519.61,673.37,659.15,618.56,592.07
"oneDNN - CPU Power Consumption Monitor (Watts)",LIB,306.45,330.6,417.66,439.83,241.2,261.28
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,499.12,498.71,620.23,650.33,542.18,597.99
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,497.3,497.04,627.27,647.45,592.73,668.51
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,500.19,496.99,652.69,646.74,567.54,633.49
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,495.69,496.51,654.01,644.01,554.51,572.01
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,497.46,496.96,654.88,651.38,581.62,584.57
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,498.92,500.49,654.66,646.66,581.88,633.77
"Cpuminer-Opt - CPU Power Consumption Monitor (Watts)",LIB,498.8,498.26,652.03,651.11,590.22,651.92
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,516.2,517.02,674.16,670.46,579.7,583.01
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,517.82,518.52,668.46,667.99,622.09,594.48
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,518.5,518.86,674.93,674,604.27,638.51
"miniBUDE - CPU Power Consumption Monitor (Watts)",LIB,447.53,430.19,549.62,491.9,335.56,284.05
"miniBUDE - CPU Power Consumption Monitor (Watts)",LIB,512.58,508.57,612,593.08,530.15,504.56
"OpenFOAM - CPU Power Consumption Monitor (Watts)",LIB,539.74,540.67,696.05,695.05,661.82,659.15
"OpenFOAM - CPU Power Consumption Monitor (Watts)",LIB,547.75,547.41,709.42,709.53,650.61,655.07