2 x Intel Xeon Platinum 8490H oneDNN Intel AMX Sapphire Rapids benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301158-NE-ONEDNN30I77
oneDNN 3.0 Intel Sapphire Rapids AMX
2 x Intel Xeon Platinum 8490H oneDNN Intel AMX Sapphire Rapids benchmarks by Michael Larabel for a future article.
,,"AVX512_CORE_AMX","AVX512_CORE_FP16","AVX512_CORE_BF16","AVX512_CORE_VNNI","AVX512_CORE"
Processor,,2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)
Motherboard,,Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)
Chipset,,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce
Memory,,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG
Disk,,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96
Graphics,,ASPEED,ASPEED,ASPEED,ASPEED,ASPEED
Monitor,,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI
Network,,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T
OS,,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04
Kernel,,6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64)
Desktop,,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2
Display Server,,X Server 1.21.1.3,X Server 1.21.1.3,X Server 1.21.1.3,X Server 1.21.1.3,X Server 1.21.1.3
Vulkan,,1.2.204,1.2.204,1.2.204,1.2.204,1.2.204
Compiler,,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1
File-System,,ext4,ext4,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080,1920x1080,1920x1080
,,"AVX512_CORE_AMX","AVX512_CORE_FP16","AVX512_CORE_BF16","AVX512_CORE_VNNI","AVX512_CORE"
"oneDNN - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,850.346,875.284,864.459,862.421,856.896
"oneDNN - Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,5.73717,6.48366,6.58841,6.82433,6.64816
"oneDNN - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,0.329961,0.383785,0.386636,16.5751,16.4589
"oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,0.580646,2.17073,2.17109,3.06721,3.05612
"oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,0.445779,1.04511,1.04836,2.37892,2.38361
"CPU Temperature Monitor - Phoronix Test Suite System Monitoring (Celsius)",,48.95,49.66,49,47.07,46.72
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,565.15,570.71,567.97,550.33,545.16
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring (Megahertz)",,2940.37,2938.87,2941.89,2941.72,2933.61
"oneDNN - CPU Temperature Monitor (Celsius)",LIB,48.92,49.6,49.73,48.74,48.63
"oneDNN - CPU Power Consumption Monitor (Watts)",LIB,575.78,575.76,576.5,576.1,576.14
"oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2927.45,2922.69,2923.11,2923.89,2925.95
"oneDNN - CPU Temperature Monitor (Celsius)",LIB,42.52,44.18,43.72,42.69,42.79
"oneDNN - CPU Power Consumption Monitor (Watts)",LIB,485.11,511.59,506.69,485.99,487.45
"oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2877.43,2876.85,2766.36,3013.63,2958.93
"oneDNN - CPU Temperature Monitor (Celsius)",LIB,43.39,44.53,44.17,45.06,45.24
"oneDNN - CPU Power Consumption Monitor (Watts)",LIB,493.47,507.78,510.43,534.11,535.67
"oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2985.15,2924.23,2933.08,2940.25,2925.84
"oneDNN - CPU Temperature Monitor (Celsius)",LIB,40.22,40.86,40.17,39.84,40.7
"oneDNN - CPU Power Consumption Monitor (Watts)",LIB,440.25,416.08,424.52,427.9,430.29
"oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2917.52,2755.27,3109.7,2951.86,2866.84
"oneDNN - CPU Temperature Monitor (Celsius)",LIB,41.39,46,43.12,43.71,44.88
"oneDNN - CPU Power Consumption Monitor (Watts)",LIB,533.77,585.68,590.99,596.1,595.83
"oneDNN - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2766.44,2843.71,2791.2,2917.26,2858.24