10980XE onednn onnx Intel Core i9-10980XE testing with a ASRock X299 Steel Legend (P1.30 BIOS) and NVIDIA GeForce GTX 1080 Ti 11GB on Ubuntu 22.04 via the Phoronix Test Suite. ,,"A","B","C","D" Processor,,Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads),Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads),Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads),Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads) Motherboard,,ASRock X299 Steel Legend (P1.30 BIOS),ASRock X299 Steel Legend (P1.30 BIOS),ASRock X299 Steel Legend (P1.30 BIOS),ASRock X299 Steel Legend (P1.30 BIOS) Chipset,,Intel Sky Lake-E DMI3 Registers,Intel Sky Lake-E DMI3 Registers,Intel Sky Lake-E DMI3 Registers,Intel Sky Lake-E DMI3 Registers Memory,,32GB,32GB,32GB,32GB Disk,,Samsung SSD 970 PRO 512GB,Samsung SSD 970 PRO 512GB,Samsung SSD 970 PRO 512GB,Samsung SSD 970 PRO 512GB Graphics,,NVIDIA GeForce GTX 1080 Ti 11GB,NVIDIA GeForce GTX 1080 Ti 11GB,NVIDIA GeForce GTX 1080 Ti 11GB,NVIDIA GeForce GTX 1080 Ti 11GB Audio,,Realtek ALC1220,Realtek ALC1220,Realtek ALC1220,Realtek ALC1220 Monitor,,ASUS VP28U,ASUS VP28U,ASUS VP28U,ASUS VP28U Network,,Intel I219-V + Intel I211,Intel I219-V + Intel I211,Intel I219-V + Intel I211,Intel I219-V + Intel I211 OS,,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04 Kernel,,5.15.0-17-generic (x86_64),5.15.0-17-generic (x86_64),5.15.0-17-generic (x86_64),5.15.0-17-generic (x86_64) Desktop,,GNOME Shell 40.5,GNOME Shell 40.5,GNOME Shell 40.5,GNOME Shell 40.5 Display Server,,X Server 1.20.13,X Server 1.20.13,X Server 1.20.13,X Server 1.20.13 Display Driver,,NVIDIA 495.46,NVIDIA 495.46,NVIDIA 495.46,NVIDIA 495.46 OpenGL,,4.6.0,4.6.0,4.6.0,4.6.0 OpenCL,,OpenCL 3.0 CUDA 11.5.103,OpenCL 3.0 CUDA 11.5.103,OpenCL 3.0 CUDA 11.5.103,OpenCL 3.0 CUDA 11.5.103 Vulkan,,1.2.186,1.2.186,1.2.186,1.2.186 Compiler,,GCC 11.2.0,GCC 11.2.0,GCC 11.2.0,GCC 11.2.0 File-System,,ext4,ext4,ext4,ext4 Screen Resolution,,3840x2160,3840x2160,3840x2160,3840x2160 ,,"A","B","C","D" "fast-cli - Internet Download Speed (Mbit/s)",HIB,370,370,390,360 "fast-cli - Internet Upload Speed (Mbit/s)",HIB,6.7,6.9,7.9,6.8 "fast-cli - Internet Latency (ms)",LIB,8,8,13,10 "fast-cli - Internet Loaded Latency (Bufferbloat) (ms)",LIB,73,64,64,70 "speedtest-cli - Internet Download Speed (Mbit/s)",HIB,324.65,321.74,280.18,327.12 "speedtest-cli - Internet Upload Speed (Mbit/s)",HIB,9.47,9.22,8.4,8.95 "speedtest-cli - Internet Latency (ms)",LIB,23.87,15.487,28.782,22.677 "perf-bench - Benchmark: Epoll Wait (ops/sec)",HIB,31157,30615,35556,35205 "perf-bench - Benchmark: Futex Hash (ops/sec)",HIB,4494394,4493415,4513944,4499081 "perf-bench - Benchmark: Memcpy 1MB (GB/sec)",HIB,17.382564,16.766498,17.779377,17.277106 "perf-bench - Benchmark: Memset 1MB (GB/sec)",HIB,66.057732,68.321136,69.500836,68.902923 "perf-bench - Benchmark: Sched Pipe (ops/sec)",HIB,86982,78301,111014,76237 "perf-bench - Benchmark: Futex Lock-Pi (ops/sec)",HIB,236,215,222,231 "perf-bench - Benchmark: Syscall Basic (ops/sec)",HIB,17140545,17221544,17145832,17504146 "oneDNN - Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU (ms)",LIB,87.0693,89.0246,87.0626,90.3226 "oneDNN - Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU (ms)",LIB,58.0758,58.2895,57.2458,58.4361 "oneDNN - Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,83.8984,88.3586,89.5153,89.0099 "oneDNN - Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,44.4304,44.2168,45.8347,44.3999 "oneDNN - Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,93.3073,93.432,93.2753,91.696 "oneDNN - Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,55.9293,56.0613,56.7312,55.5827 "oneDNN - Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU (ms)",LIB,24.0564,24.384,24.4218,24.3468 "oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU (ms)",LIB,99.18,109.808,107.714,112.623 "oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU (ms)",LIB,19.0856,18.6987,19.6687,18.9448 "oneDNN - Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,23.7444,23.7723,24.0619,23.7889 "oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,50.2996,50.1553,0.774919,54.0262 "oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,9.33345,9.40424,1.62907,9.35235 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU (ms)",LIB,23584.2,23366.8,18304.9,23371.5 "oneDNN - Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU (ms)",LIB,26069.6,26549.2,26033.7,26872.5 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,23516.1,22790.9,22788.5,23844.1 "oneDNN - Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,27.0016,25.8871,26.1804,25.9415 "oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,116.514,135.473,130.958,118.154 "oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,22.3996,23.9021,22.7645,23.0195 "oneDNN - Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,28356.5,27247.5,28624.4,28758.8 "oneDNN - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU (ms)",LIB,35.2021,36.3562,26.991,31.2678 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,22990.4,22726.7,22605.3,23319.6 "oneDNN - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,27155,27353.6,28513.6,28429.2 "oneDNN - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,30.7784,34.5221,30.8774,33.3777 "oneDNN - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,37.7937,39.0485,37.7823,37.5531 "Java JMH - Throughput (Ops/s)",HIB,33246015808.702,33247767440.989,33236796629.92,33246121586.081 "ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Parallel (Inferences/min)",HIB,5799,5795,6114,6072 "ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Standard (Inferences/min)",HIB,8749,8812,9595,9591 "ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Parallel (Inferences/min)",HIB,444,448,447,449 "ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Standard (Inferences/min)",HIB,665,663,680,569 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Parallel (Inferences/min)",HIB,782,774,786,796 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inferences/min)",HIB,897,911,923,897 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel (Inferences/min)",HIB,101,102,101,101 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inferences/min)",HIB,148,119,,148 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel (Inferences/min)",HIB,1464,1474,,1491 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inferences/min)",HIB,2053,1538,,2014 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Parallel (Inferences/min)",HIB,5890,5975,,5969 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inferences/min)",HIB,6168,9884,,10255