Tests for a future article. AMD Ryzen Threadripper PRO 5965WX 24-Cores testing with a ASUS Pro WS WRX80E-SAGE SE WIFI (1201 BIOS) and ASUS NVIDIA NV106 2GB on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2402042-NE-ONNXTR51458
onnx tr,
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",132.446,130.167,131.17
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",7.54222,7.67484,7.61641
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",160.182,146.341,123.714,147.921,145.304,124.827,140.864,160.271,126.78,157.571,141.461,147.983,161.143,159.207,158.131
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",6.24064,6.82771,8.07754,6.75572,6.87692,8.00507,7.09322,6.23715,7.88258,6.34365,7.06386,6.75247,6.20326,6.27889,6.321
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",9.49821,9.47672,9.4991
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",105.279,105.518,105.269
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",9.13746,8.50449,10.4765,8.84185,10.4607,9.29086,10.475,10.4738,9.07982,10.5218,9.5496,10.4246,8.91411,10.4197,9.00712
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",109.436,117.581,95.4486,113.095,95.5927,107.629,95.4621,95.4737,110.131,95.0374,104.713,95.9235,112.178,95.9687,111.019
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",176.742,178.074,175.871
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",5.6565,5.61428,5.68432
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",196.065,195.973,186.923,198.416,192.31
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",5.09978,5.10165,5.34825,5.0393,5.19923
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",12.1863,12.5057,12.7199
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",82.0564,79.9606,78.614
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",14.1402,14.6506,12.1721,11.8853,14.5618,11.8255,14.2748,14.6766,11.7959,11.7988,11.9494,14.9301,14.7549,11.8859,14.8912
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",70.7172,68.2535,82.1513,84.1341,68.6703,84.5591,70.0504,68.132,84.772,84.7505,83.6811,66.9759,67.7706,84.1286,67.1509
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",695.763,704.66,676.118
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",1.43552,1.4174,1.47737
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",809.753,665.407,799.882,790.517,665.188,795.315,798.764,793.442,796.121,797.381,795.085,663.879,794.388,666.018,814.38
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",1.23449,1.50227,1.24981,1.26443,1.50294,1.25693,1.25152,1.25985,1.2557,1.25372,1.25734,1.5057,1.25822,1.50092,1.2276
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",1.48555,1.4871,1.47978
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",673.148,672.445,675.771
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",3.27213,2.33942,2.32531,3.27955,3.28745,3.26007,2.34527,3.26289,2.33111,3.28475,2.32185,3.29161,3.26135,3.25472,3.17543
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",305.608,427.454,430.047,304.917,304.184,306.738,426.387,306.473,428.978,304.434,430.688,303.8,306.618,307.243,314.914
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",31.0036,30.3268,29.9115
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",32.2526,32.9726,33.4305
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",33.5739,34.708,31.1485,35.2867,29.3937,29.3911,35.6464,32.4401,28.9294,34.1995,35.1549,31.3963,29.3933,31.3518,32.1373
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",29.783,28.81,32.1019,28.3372,34.019,34.0214,28.0515,30.8237,34.5647,29.2382,28.4439,31.8481,34.019,31.8936,31.1144
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",238.085,236.562,235.56
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",4.19868,4.22598,4.24393
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",267.094,247.551,261.781,289.893,291.01,286.459,287.234,288.288,285.696,248.507,288.079,265.122
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",3.74332,4.03816,3.81917,3.44883,3.43477,3.49011,3.48057,3.46825,3.49963,4.02342,3.47057,3.77125
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",123.299,122.098,124.128
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"c",8.10903,8.18894,8.05488
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS",