2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2402196-NE-XEONFEBBY11
xeon febby,
"PyTorch 2.1 - Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l",
Higher Results Are Better
"a",0.42277579014499
"Llama.cpp b1808 - Model: llama-2-70b-chat.Q5_0.gguf",
Higher Results Are Better
"a",
"b",
"Llama.cpp b1808 - Model: llama-2-13b.Q4_0.gguf",
Higher Results Are Better
"a",
"b",
"Quicksilver 20230818 - Input: CORAL2 P2",
Higher Results Are Better
"a",
"b",
"Quicksilver 20230818 - Input: CTS2",
Higher Results Are Better
"a",
"b",
"Llama.cpp b1808 - Model: llama-2-7b.Q4_0.gguf",
Higher Results Are Better
"a",
"b",
"Llamafile 0.6 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",
"b",
"Quicksilver 20230818 - Input: CORAL2 P1",
Higher Results Are Better
"a",
"b",
"Llamafile 0.6 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",
"b",
"NAMD 3.0b6 - Input: STMV with 1,066,628 Atoms",
Higher Results Are Better
"a",1.7462246622802
"b",1.8163819487962
"Llamafile 0.6 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",
"b",
"NAMD 3.0b6 - Input: ATPase with 327,506 Atoms",
Higher Results Are Better
"a",5.9830798501837
"b",4.0202944463653
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"PyTorch 2.1 - Device: CPU - Batch Size: 1 - Model: ResNet-152",
Higher Results Are Better
"a",19.077643533055
"b",19.210356770127
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"Speedb 2.7 - Test: Update Random",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"Speedb 2.7 - Test: Read While Writing",
Higher Results Are Better
"a",
"b",
"Speedb 2.7 - Test: Read Random Write Random",
Higher Results Are Better
"a",
"b",
"Speedb 2.7 - Test: Random Read",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Lower Results Are Better
"a",
"b",
"ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Higher Results Are Better
"a",
"b",
"dav1d 1.4 - Video Input: Summer Nature 4K",
Higher Results Are Better
"a",
"b",
"dav1d 1.4 - Video Input: Chimera 1080p",
Higher Results Are Better
"a",
"b",
"dav1d 1.4 - Video Input: Summer Nature 1080p",
Higher Results Are Better
"a",
"b",
"dav1d 1.4 - Video Input: Chimera 1080p 10-bit",
Higher Results Are Better
"a",
"b",
"GROMACS 2024 - Implementation: MPI CPU - Input: water_GMX50_bare",
Higher Results Are Better
"a",
"b",
"PyTorch 2.1 - Device: CPU - Batch Size: 1 - Model: ResNet-50",
Higher Results Are Better
"a",51.656642576938
"b",51.00255058636
"TensorFlow 2.12 - Device: CPU - Batch Size: 1 - Model: ResNet-50",
Higher Results Are Better
"a",
"b",
"Intel Open Image Denoise 2.2 - Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only",
Higher Results Are Better
"a",2.4580170684705
"b",2.465519706899
"TensorFlow 2.12 - Device: CPU - Batch Size: 1 - Model: VGG-16",
Higher Results Are Better
"a",
"b",
"TensorFlow 2.12 - Device: CPU - Batch Size: 1 - Model: GoogLeNet",
Higher Results Are Better
"a",
"b",
"Y-Cruncher 0.8.3 - Pi Digits To Calculate: 1B",
Lower Results Are Better
"a",
"b",
"Intel Open Image Denoise 2.2 - Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only",
Higher Results Are Better
"a",5.1360013148163
"b",5.0001750061252
"Intel Open Image Denoise 2.2 - Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only",
Higher Results Are Better
"a",5.0966061699514
"b",5.1562870608133
"Y-Cruncher 0.8.3 - Pi Digits To Calculate: 500M",
Lower Results Are Better
"a",
"b",
"TensorFlow 2.12 - Device: CPU - Batch Size: 1 - Model: AlexNet",
Higher Results Are Better
"a",
"b",