2023-01-18-1402 2 x Intel Xeon E5-2680 v2 testing with a Supermicro X9DR3-F v0123456789 (3.4 BIOS) and Matrox MGA G200eW WPCM450 on Arch Linux via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2301186-NE-20230118120 .
2023-01-18-1402 Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution 2 x Intel Xeon E5-2680 v2 2 x Intel Xeon E5-2680 v2 @ 3.60GHz (20 Cores / 40 Threads) Supermicro X9DR3-F v0123456789 (3.4 BIOS) Intel Xeon E7 v2/Xeon 128GB 120GB KINGSTON SA400S3 Matrox MGA G200eW WPCM450 2 x Intel I350 Arch Linux 6.1.6-arch1-1 (x86_64) GCC 12.2.0 xfs 1280x1024 OpenBenchmarking.org - Transparent Huge Pages: always - --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=c,c++,ada,fortran,go,lto,objc,obj-c++,d --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu - Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x42e - itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Unknown: No mitigations + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
2023-01-18-1402 onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Convolution Batch Shapes Auto - u8s8f32 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Deconvolution Batch shapes_3d - u8s8f32 - CPU onednn: IP Shapes 1D - f32 - CPU onednn: IP Shapes 1D - u8s8f32 - CPU onednn: IP Shapes 3D - f32 - CPU onednn: IP Shapes 3D - u8s8f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Training - u8s8f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Inference - f32 - CPU onednn: Recurrent Neural Network Inference - u8s8f32 - CPU onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU 2 x Intel Xeon E5-2680 v2 13.6139 24.3524 10.00285 4.00951 11.9317 5.55297 4.97658 4.65906 8.03746 2.23329 2.30625 5.90042 6163.96 6167.95 6260.78 3364.45 3393.93 3351.30 OpenBenchmarking.org
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 3 6 9 12 15 SE +/- 0.28, N = 15 13.61 MIN: 7.46 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 35.0 40.0 49.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 14 28 42 56 70
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 43.0 45.1 47.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 14 28 42 56 70
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 6 12 18 24 30 SE +/- 0.25, N = 15 24.35 MIN: 16.92 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 35.0 37.2 44.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 12 24 36 48 60
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 43.0 45.8 51.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 15 30 45 60 75
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 3 6 9 12 15 SE +/- 0.12, N = 3 10.00 MIN: 9.59 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 0.9021 1.8042 2.7063 3.6084 4.5105 SE +/- 0.03154, N = 15 4.00951 MIN: 3.76 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 35.0 47.8 52.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 15 30 45 60 75
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 43.0 50.7 55.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 15 30 45 60 75
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 3 6 9 12 15 SE +/- 0.03, N = 9 11.93 MIN: 11.84 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 1.2494 2.4988 3.7482 4.9976 6.247 SE +/- 0.00785, N = 9 5.55297 MIN: 5.51 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 1.1197 2.2394 3.3591 4.4788 5.5985 SE +/- 0.02322, N = 4 4.97658 MIN: 4.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 1.0483 2.0966 3.1449 4.1932 5.2415 SE +/- 0.03286, N = 4 4.65906 MIN: 4.3 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 2 4 6 8 10 SE +/- 0.01391, N = 5 8.03746 MIN: 7.9 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 0.5025 1.005 1.5075 2.01 2.5125 SE +/- 0.01188, N = 5 2.23329 MIN: 1.86 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 0.5189 1.0378 1.5567 2.0756 2.5945 SE +/- 0.02065, N = 4 2.30625 MIN: 2.05 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 1.3276 2.6552 3.9828 5.3104 6.638 SE +/- 0.78217, N = 15 5.90042 MIN: 2.25 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 34.0 41.3 47.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 14 28 42 56 70
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 42.0 47.6 52.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 15 30 45 60 75
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 1300 2600 3900 5200 6500 SE +/- 61.01, N = 3 6163.96 MIN: 6045.16 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 30.0 47.1 53.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 15 30 45 60 75
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 41.0 50.0 57.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 16 32 48 64 80
oneDNN Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 1300 2600 3900 5200 6500 SE +/- 59.21, N = 3 6167.95 MIN: 6057.96 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 36.0 46.5 55.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 15 30 45 60 75
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 46.0 53.4 58.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 16 32 48 64 80
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU 2 x Intel Xeon E5-2680 v2 1300 2600 3900 5200 6500 SE +/- 82.86, N = 3 6260.78 MIN: 6085.33 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 40.0 49.1 55.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 15 30 45 60 75
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 49.0 55.0 59.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 16 32 48 64 80
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 700 1400 2100 2800 3500 SE +/- 25.88, N = 3 3364.45 MIN: 3296.18 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 39.0 44.6 55.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 15 30 45 60 75
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 50.0 56.4 59.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 16 32 48 64 80
oneDNN Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon E5-2680 v2 700 1400 2100 2800 3500 SE +/- 31.48, N = 3 3393.93 MIN: 3323.37 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 38.0 49.3 54.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 15 30 45 60 75
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 50.0 55.4 59.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 16 32 48 64 80
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU 2 x Intel Xeon E5-2680 v2 700 1400 2100 2800 3500 SE +/- 24.00, N = 3 3351.30 MIN: 3292.8 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 38.0 46.1 54.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor 15 30 45 60 75
oneDNN System Temperature Monitor Min Avg Max 2 x Intel Xeon E5-2680 v2 49.0 56.4 60.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 System Temperature Monitor 16 32 48 64 80
CPU Temperature Monitor Phoronix Test Suite System Monitoring Min Avg Max 2 x Intel Xeon E5-2680 v2 30.0 41.4 55.0 OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring 15 30 45 60 75
System Temperature Monitor Phoronix Test Suite System Monitoring Min Avg Max 2 x Intel Xeon E5-2680 v2 40.0 48.3 60.0 OpenBenchmarking.org Celsius System Temperature Monitor Phoronix Test Suite System Monitoring 16 32 48 64 80
Phoronix Test Suite v10.8.4