Tests for a future article. AMD Ryzen Threadripper PRO 7995WX 96-Cores testing with a HP Z6 G5 A Workstation 8B24 (U65 Ver. 01.01.04 BIOS) and NVIDIA RTX A4000 16GB on CachyOS rolling via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2402162-NE-COMPUTE0976
compute,
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"NAMD 3.0b6 - Input: ATPase with 327,506 Atoms",
Higher Results Are Better
"a",8.4803256445048
"b",8.9180608568473
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"Intel Open Image Denoise 2.2 - Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only",
Higher Results Are Better
"a",1.4294924301228
"b",1.3931651318631
"Intel Open Image Denoise 2.2 - Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only",
Higher Results Are Better
"a",3.0343120000971
"b",2.953537895368
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"Intel Open Image Denoise 2.2 - Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only",
Higher Results Are Better
"a",3.0203267993597
"b",2.9657837528435
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"GROMACS 2024 - Implementation: MPI CPU - Input: water_GMX50_bare",
Higher Results Are Better
"a",
"b",
"NAMD 3.0b6 - Input: STMV with 1,066,628 Atoms",
Higher Results Are Better
"a",2.495364859773
"b",2.4944498490858
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"a",
"b",