2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 23.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2302115-NE-OONXSAPPH22
OONX Sapphire Rapids
2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 23.04 via the Phoronix Test Suite.
,,"ONNX Runtime 1.14","ONNX Runtime 1.14 - No AMX","ONNX Runtime 1.14 use_dnnl"
Processor,,2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)
Motherboard,,Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)
Chipset,,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce
Memory,,1008GB,1008GB,1008GB
Disk,,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96
Graphics,,ASPEED,ASPEED,ASPEED
Monitor,,VGA HDMI,VGA HDMI,VGA HDMI
Network,,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T
OS,,Ubuntu 23.04,Ubuntu 23.04,Ubuntu 23.04
Kernel,,5.19.0-21-generic (x86_64),5.19.0-21-generic (x86_64),5.19.0-21-generic (x86_64)
Desktop,,GNOME Shell 43.2,GNOME Shell 43.2,GNOME Shell 43.2
Display Server,,X Server 1.21.1.6,X Server 1.21.1.6,X Server 1.21.1.6
Compiler,,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0
File-System,,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080
,,"ONNX Runtime 1.14","ONNX Runtime 1.14 - No AMX","ONNX Runtime 1.14 use_dnnl"
"ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,11.5378,11.26627,11.2020
"ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,9.36451,9.47631,9.56208
"ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,10.00997,10.4618,9.93450
"ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,3.03253,2.95924,3.00654
"ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,209.662,209.703,211.423
"ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,179.895,180.391,178.529
"ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,14.9354,15.1688,15.1855
"ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,15.0267,14.9954,14.9979
"ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,190.019,195.149,194.522
"ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,153.596,158.305,150.860
"ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,33.9663,,32.6092
"ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,27.2147,,27.4259
"ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,177.925,,175.674
"ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,162.477,,164.899
"ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,684.146,,695.777
"ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,589.197,,590.795
"ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,39.7690,,40.0070
"ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,32.8994,,31.7784
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2919.08,2905.29,2910.83
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,610.95,613.94,613.29
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,46.25,48.24,48.39
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2903.97,2917.2,2921.25
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,611.15,611.81,611.81
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,47.23,47.65,47.45
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2752.96,2751.37,2770.59
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,668.72,673.64,668.74
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,51.5,50.98,51.5
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2921.95,2905.18,2916.07
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,611.31,611.05,612.94
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,48.15,48.53,48.5
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3456.84,3450.16,3456.98
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,437.42,438.82,440.49
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,53.02,53.17,53.16
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3495.33,3478.3,3488.91
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,446.6,445.53,446.41
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,37.53,40.87,39.09
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3459.63,3470.38,3466.04
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,561.64,564.38,565.55
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,47.62,47.92,49.25
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3178.95,3180.6,3178.86
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,562.24,560.24,563.2
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,45.33,45.14,45.8
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3481.53,3486.47,3493.87
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,434.53,435.51,436.21
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,48.1,48.93,49.32
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3493.79,3475.07,3477.56
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,438.83,439.07,438.63
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,37.45,37.47,38.15
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2934.76,,2931.78
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,622.19,,621.01
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,48.43,,48.91
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2910.57,,2928.81
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,623.46,,625
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,47.86,,48.36
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2904.22,,2904.55
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,615.88,,616.6
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,50.15,,50.68
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2889.73,,2888.67
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,632.54,,637.96
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,50.67,,48.9
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2908.26,,2914.44
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,601.98,,607.19
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,48.76,,49.72
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2908.02,,2903.22
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,614.98,,616.89
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,46.86,,48.1
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2981.68,,2997.09
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,582.21,,583
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,46.33,,47.87
"ONNX Runtime - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,3069.73,,3033.71
"ONNX Runtime - CPU Power Consumption Monitor (Watts)",LIB,561.87,,561.7
"ONNX Runtime - CPU Temperature Monitor (Celsius)",LIB,45.1,,46.03
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring (Megahertz)",,3026.38,,3073.43
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,577.11,,571.11
"CPU Temperature Monitor - Phoronix Test Suite System Monitoring (Celsius)",,47.63,,48.36
"ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,86.6683,88.9286,89.3915
"ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,106.799,105.531,104.582
"ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,100.2871,95.6002,101.0160
"ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,329.874,337.921,333.098
"ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,4.76912,4.76804,4.72937
"ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,5.55742,5.54240,5.60021
"ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,66.9705,65.9243,65.8822
"ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,66.5490,66.6888,66.6855
"ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,5.26053,5.13582,5.15414
"ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,6.50527,6.31109,6.62309
"ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,29.4406,,30.6762
"ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,36.7433,,36.4666
"ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,5.61969,,5.69175
"ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,6.15564,,6.06317
"ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,1.46149,,1.43703
"ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,1.69517,,1.69067
"ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,25.1440,,24.9956
"ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,30.4046,,31.4694