intel onnx

Intel Core i5-14500 testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel UHD 770 ADL-S GT1 31GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2402049-NE-INTELONNX80

Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result

Hide
Result

Result
Identifier

View Logs

Performance Per
Dollar

Date
Run

Test
Duration

February 04

41 Minutes

February 04

41 Minutes

February 04

41 Minutes

February 04

41 Minutes

Invert Hiding All Results Option

41 Minutes

Only show results where is faster than

Only show results matching title/arguments (delimit multiple options with a comma):

Do not show results matching title/arguments (delimit multiple options with a comma):

intel onnx Intel Core i5-14500 testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel UHD 770 ADL-S GT1 31GB on Ubuntu 23.10 via the Phoronix Test Suite. ,,"a","b","c","d" Processor,,Intel Core i5-14600K @ 5.30GHz (14 Cores / 20 Threads),Intel Core i5-14600K @ 5.30GHz (14 Cores / 20 Threads),Intel Core i5-14500 @ 5.00GHz (14 Cores / 20 Threads),Intel Core i5-14500 @ 5.00GHz (14 Cores / 20 Threads) Motherboard,,ASUS PRIME Z790-P WIFI (1402 BIOS),ASUS PRIME Z790-P WIFI (1402 BIOS),ASUS PRIME Z790-P WIFI (1402 BIOS),ASUS PRIME Z790-P WIFI (1402 BIOS) Chipset,,Intel Device 7a27,Intel Device 7a27,Intel Device 7a27,Intel Device 7a27 Memory,,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36 Disk,,1024GB SOLIDIGM SSDPFKKW010X7,1024GB SOLIDIGM SSDPFKKW010X7,1024GB SOLIDIGM SSDPFKKW010X7,1024GB SOLIDIGM SSDPFKKW010X7 Graphics,,ASUS Intel RPL-S 31GB (1550MHz),ASUS Intel RPL-S 31GB (1550MHz),ASUS Intel UHD 770 ADL-S GT1 31GB (1550MHz),ASUS Intel UHD 770 ADL-S GT1 31GB (1550MHz) Audio,,Realtek ALC897,Realtek ALC897,Realtek ALC897,Realtek ALC897 Monitor,,ASUS VP28U,ASUS VP28U,ASUS VP28U,ASUS VP28U OS,,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10 Kernel,,6.7.0-060700-generic (x86_64),6.7.0-060700-generic (x86_64),6.7.0-060700-generic (x86_64),6.7.0-060700-generic (x86_64) Desktop,,GNOME Shell 45.0,GNOME Shell 45.0,GNOME Shell 45.0,GNOME Shell 45.0 Display Server,,X Server + Wayland,X Server + Wayland,X Server + Wayland,X Server + Wayland OpenGL,,4.6 Mesa 23.2.1-1ubuntu3.1,4.6 Mesa 23.2.1-1ubuntu3.1,4.6 Mesa 23.2.1-1ubuntu3.1,4.6 Mesa 23.2.1-1ubuntu3.1 Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0 File-System,,ext4,ext4,ext4,ext4 Screen Resolution,,1920x1080,1920x1080,1920x1080,1920x1080 ,,"a","b","c","d" "ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,109.53,113.197,109.357,107.328 "ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,173.505,174.028,176.035,176.575 "ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,10.0398,10.5773,10.1779,9.48916 "ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,12.8473,12.8285,11.8415,11.8566 "ONNX Runtime - Model: T5 Encoder - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,134.589,126.438,133.14,129.339 "ONNX Runtime - Model: T5 Encoder - Device: CPU - Executor: Standard (Inferences/sec)",HIB,201.51,201.77,208.882,210.031 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,16.07,13.7285,12.5893,14.4327 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,18.4604,18.5426,17.3278,17.3196 "ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,266.064,263.017,247.001,249.431 "ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,722.924,710.938,649.33,654.423 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,1.58044,1.52026,1.35743,1.44994 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,2.11386,2.09046,1.78177,1.78007 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,8.25464,8.23229,7.63408,7.53407 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,8.51173,8.49818,7.78147,7.78073 "ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,135.109,132.06,124.204,125.592 "ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,239.339,239.941,216.778,217.526 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,64.2721,64.7914,63.6816,61.3126 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,82.6432,82.6685,79.1907,79.1887 "ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel (Inferences/sec)",HIB,39.9747,39.4603,36.2335,36.1624 "ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard (Inferences/sec)",HIB,53.1498,52.4488,46.1761,45.9831 "ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,9.12514,8.83005,9.13993,9.31307 "ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,5.76013,5.74282,5.67713,5.65923 "ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,99.6017,94.5408,98.2498,105.381 "ONNX Runtime - Model: yolov4 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,77.8358,77.9497,84.4468,84.3393 "ONNX Runtime - Model: T5 Encoder - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,7.42879,7.90741,7.50952,7.73021 "ONNX Runtime - Model: T5 Encoder - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,4.96161,4.95524,4.78645,4.75974 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,62.2255,72.8399,79.431,69.2846 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,54.1682,53.9283,57.7089,57.7365 "ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,3.75732,3.80074,4.04715,4.00771 "ONNX Runtime - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,1.38253,1.40589,1.53907,1.52723 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,632.734,657.781,736.684,689.68 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,473.066,478.362,561.237,561.774 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,121.143,121.472,130.99,132.729 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,117.484,117.671,128.509,128.522 "ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,7.40035,7.57099,8.04979,7.9609 "ONNX Runtime - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,4.1776,4.16707,4.61229,4.59654 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,15.5579,15.4334,15.702,16.3088 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,12.0998,12.096,12.6271,12.6275 "ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel (Inference Time Cost (ms))",LIB,25.0142,25.3401,27.5969,27.6513 "ONNX Runtime - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard (Inference Time Cost (ms))",LIB,18.8133,19.0643,21.6546,21.7455