general
2 x AMD EPYC 9274F 24-Core testing with a ASUS ESC8000A-E12 K14PG-D24 (1201 BIOS) and ASUS NVIDIA H100 NVL 94GB on Ubuntu 22.04 via the Phoronix Test Suite.


Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core: 

	Processor: 2 x AMD EPYC 9274F 24-Core @ 4.05GHz (48 Cores / 96 Threads), Motherboard: ASUS ESC8000A-E12 K14PG-D24 (1201 BIOS), Chipset: AMD Device 14a4, Memory: 1136GB, Disk: 240GB MR9540-8i, Graphics: ASUS NVIDIA H100 NVL 94GB, Network: 2 x Broadcom BCM57414 NetXtreme-E 10Gb/25Gb

	OS: Ubuntu 22.04, Kernel: 6.8.0-51-generic (x86_64), Display Server: X Server, Display Driver: NVIDIA, OpenCL: OpenCL 3.0 CUDA 12.7.33, Vulkan: 1.3.289, Compiler: GCC 11.4.0 + CUDA 12.6, File-System: ext4, Screen Resolution: 1920x1200


Llamafile 0.8.16
Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 12288 |============================


Llamafile 0.8.16
Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6144 |=============================


Llamafile 0.8.16
Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3072 |=============================


Llamafile 0.8.16
Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 1536 |=============================


Llamafile 0.8.16
Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 32768 |============================


Llamafile 0.8.16
Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16384 |============================


Llamafile 0.8.16
Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8192 |=============================


Llamafile 0.8.16
Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 256
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 4096 |=============================


Llamafile 0.8.16
Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5.00 |=============================


Llamafile 0.8.16
Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 32768 |============================


Llamafile 0.8.16
Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16384 |============================


Llamafile 0.8.16
Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 4.92 |=============================


Llamafile 0.8.16
Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 24.12 |============================


Llamafile 0.8.16
Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8192 |=============================


Llamafile 0.8.16
Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 4096 |=============================


Llamafile 0.8.16
Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 16
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 24.04 |============================


Llamafile 0.8.16
Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 56.82 |============================


Llamafile 0.8.16
Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 32768 |============================


Llamafile 0.8.16
Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16384 |============================


Llamafile 0.8.16
Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 57.78 |============================


Llamafile 0.8.16
Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8192 |=============================


Llamafile 0.8.16
Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 256
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 4096 |=============================


Llamafile 0.8.16
Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 42.16 |============================


Llamafile 0.8.16
Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 16
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 41.91 |============================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3121.14 |==========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3150.78 |==========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3144.42 |==========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 84.98 |============================


Llama.cpp b4397
Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 211.93 |===========================


Llama.cpp b4397
Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 212.92 |===========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 18308.61 |=========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 13052.60 |=========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8390.83 |==========================


Llama.cpp b4397
Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 63.08 |============================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 151.83 |===========================


Llama.cpp b4397
Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 44.00 |============================


Llama.cpp b4397
Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 42.88 |============================


Llama.cpp b4397
Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 43.54 |============================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 18283.75 |=========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 13019.73 |=========================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8352.57 |==========================


Llama.cpp b4397
Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 18.58 |============================


Llama.cpp b4397
Backend: NVIDIA CUDA - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 147.63 |===========================


Llama.cpp b4397
Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 45.57 |============================


Llama.cpp b4397
Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 43.85 |============================


Llama.cpp b4397
Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 43.87 |============================


Llama.cpp b4397
Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 17.56 |============================


AI Benchmark Alpha 0.1.2
Device AI Score
Score > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6576 |=============================


AI Benchmark Alpha 0.1.2
Device Training Score
Score > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3380 |=============================


AI Benchmark Alpha 0.1.2
Device Inference Score
Score > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3196 |=============================


PyBench 2018-02-16
Total For Average Test Times
Milliseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 738 |==============================


NCNN 20241226
Target: Vulkan GPU - Model: vision_transformer
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 56.65 |============================


NCNN 20241226
Target: Vulkan GPU - Model: regnety_400m
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 46.67 |============================


NCNN 20241226
Target: Vulkan GPU - Model: squeezenet_ssd
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 23.72 |============================


NCNN 20241226
Target: Vulkan GPU - Model: yolov4-tiny
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 31.30 |============================


NCNN 20241226
Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 23.15 |============================


NCNN 20241226
Target: Vulkan GPU - Model: resnet50
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 22.63 |============================


NCNN 20241226
Target: Vulkan GPU - Model: alexnet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.58 |=============================


NCNN 20241226
Target: Vulkan GPU - Model: resnet18
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 12.46 |============================


NCNN 20241226
Target: Vulkan GPU - Model: vgg16
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 41.41 |============================


NCNN 20241226
Target: Vulkan GPU - Model: googlenet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 22.25 |============================


NCNN 20241226
Target: Vulkan GPU - Model: blazeface
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.35 |=============================


NCNN 20241226
Target: Vulkan GPU - Model: efficientnet-b0
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16.99 |============================


NCNN 20241226
Target: Vulkan GPU - Model: mnasnet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.69 |============================


NCNN 20241226
Target: Vulkan GPU - Model: shufflenet-v2
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16.56 |============================


NCNN 20241226
Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 13.33 |============================


NCNN 20241226
Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.77 |============================


NCNN 20241226
Target: Vulkan GPU - Model: mobilenet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 23.15 |============================


NCNN 20241226
Target: CPU - Model: vision_transformer
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 57.21 |============================


NCNN 20241226
Target: CPU - Model: regnety_400m
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 45.73 |============================


NCNN 20241226
Target: CPU - Model: squeezenet_ssd
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 23.98 |============================


NCNN 20241226
Target: CPU - Model: yolov4-tiny
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 31.75 |============================


NCNN 20241226
Target: CPU - Model: resnet50
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 22.82 |============================


NCNN 20241226
Target: CPU - Model: alexnet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.32 |=============================


NCNN 20241226
Target: CPU - Model: resnet18
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 12.69 |============================


NCNN 20241226
Target: CPU - Model: vgg16
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 42.12 |============================


NCNN 20241226
Target: CPU - Model: googlenet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 22.65 |============================


NCNN 20241226
Target: CPU - Model: blazeface
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.39 |=============================


NCNN 20241226
Target: CPU - Model: efficientnet-b0
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16.71 |============================


NCNN 20241226
Target: CPU - Model: mnasnet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.52 |============================


NCNN 20241226
Target: CPU - Model: shufflenet-v2
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16.76 |============================


NCNN 20241226
Target: CPU-v2-v2 - Model: mobilenet-v2
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.85 |============================


spaCy 3.4.1
Model: en_core_web_lg
tokens/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 15338 |============================


Stress-NG 0.18.09
Test: Hyperbolic Trigonometric Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 293490.26 |========================


Stress-NG 0.18.09
Test: POSIX Regular Expressions
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 444669.60 |========================


Stress-NG 0.18.09
Test: System V Message Passing
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 14211326.19 |======================


Stress-NG 0.18.09
Test: Glibc Qsort Data Sorting
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 1590.91 |==========================


Stress-NG 0.18.09
Test: Glibc C String Functions
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 56864254.14 |======================


Stress-NG 0.18.09
Test: Integer Bit Operations
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 9623549.83 |=======================


Stress-NG 0.18.09
Test: Bessel Math Operations
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 36898.14 |=========================


Stress-NG 0.18.09
Test: Vector Floating Point
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 182971.03 |========================


Stress-NG 0.18.09
Test: Bitonic Integer Sort
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 672.51 |===========================


Stress-NG 0.18.09
Test: Trigonometric Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 151938.42 |========================


Stress-NG 0.18.09
Test: Fused Multiply-Add
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 47688547.66 |======================


Stress-NG 0.18.09
Test: Radix String Sort
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 2158.48 |==========================


Stress-NG 0.18.09
Test: Fractal Generator
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 393.67 |===========================


Stress-NG 0.18.09
Test: Context Switching
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 15485954.92 |======================


Stress-NG 0.18.09
Test: Wide Vector Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 2734553.44 |=======================


Stress-NG 0.18.09
Test: Logarithmic Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 374205.22 |========================


Stress-NG 0.18.09
Test: Jpeg Compression
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 66045.55 |=========================


Stress-NG 0.18.09
Test: Exponential Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 198051.5 |=========================


Stress-NG 0.18.09
Test: Socket Activity
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 20499.66 |=========================


Stress-NG 0.18.09
Test: Mixed Scheduler
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 38187.39 |=========================


Stress-NG 0.18.09
Test: Vector Shuffle
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 42786.90 |=========================


Stress-NG 0.18.09
Test: Memory Copying
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 13628.14 |=========================


Stress-NG 0.18.09
Test: Matrix 3D Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 16067.53 |=========================


Stress-NG 0.18.09
Test: Floating Point
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 20022.51 |=========================


Stress-NG 0.18.09
Test: x86_64 RdRand
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 20427852.82 |======================


Stress-NG 0.18.09
Test: Function Call
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 45580.45 |=========================


Stress-NG 0.18.09
Test: Integer Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 4586743.65 |=======================


Stress-NG 0.18.09
Test: AVX-512 VNNI
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6540887.21 |=======================


Stress-NG 0.18.09
Test: Vector Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 407859.79 |========================


Stress-NG 0.18.09
Test: Matrix Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 310400.31 |========================


Stress-NG 0.18.09
Test: Semaphores
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 61709090.58 |======================


Stress-NG 0.18.09
Test: Power Math
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 119629.76 |========================


Stress-NG 0.18.09
Test: CPU Stress
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 145536.61 |========================


Stress-NG 0.18.09
Test: CPU Cache
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 771976.41 |========================


Stress-NG 0.18.09
Test: SENDFILE
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 916359.11 |========================


Stress-NG 0.18.09
Test: AVL Tree
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 1194.06 |==========================


Stress-NG 0.18.09
Test: Pthread
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 135182.40 |========================


Stress-NG 0.18.09
Test: Forking
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 62039.40 |=========================


Stress-NG 0.18.09
Test: Cloning
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8039.79 |==========================


Stress-NG 0.18.09
Test: Malloc
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 106614259.32 |=====================


Stress-NG 0.18.09
Test: Atomic
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 257.02 |===========================


Stress-NG 0.18.09
Test: Mutex
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 14723637.91 |======================


Stress-NG 0.18.09
Test: MEMFD
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3377.15 |==========================


Stress-NG 0.18.09
Test: Futex
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 2352726.22 |=======================


Stress-NG 0.18.09
Test: Zlib
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6888.22 |==========================


Stress-NG 0.18.09
Test: Poll
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5524301.71 |=======================


Stress-NG 0.18.09
Test: Pipe
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 21174901.61 |======================


Stress-NG 0.18.09
Test: NUMA
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 400.80 |===========================


Stress-NG 0.18.09
Test: MMAP
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 12391.70 |=========================


Stress-NG 0.18.09
Test: Hash
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 12298718.43 |======================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 46.72 |============================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 47.34 |============================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 47.80 |============================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 46.77 |============================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 47.32 |============================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 51.52 |============================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 102.98 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 102.81 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 102.21 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 283.02 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 102.43 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 282.30 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 102.11 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 279.19 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 282.75 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 279.17 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 101.94 |===========================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 287.46 |===========================


PyTorch 2.2.1
Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.09 |=============================


PyTorch 2.2.1
Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.07 |=============================


PyTorch 2.2.1
Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.18 |=============================


PyTorch 2.2.1
Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.05 |=============================


PyTorch 2.2.1
Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5.99 |=============================


PyTorch 2.2.1
Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8.92 |=============================


PyTorch 2.2.1
Device: CPU - Batch Size: 512 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.61 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 256 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.45 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 64 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.51 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 512 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 30.05 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 32 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 12.29 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 256 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 29.01 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 16 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 11.27 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 64 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 29.06 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 32 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 29.03 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 16 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 29.77 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 1 - Model: ResNet-152
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 13.97 |============================


PyTorch 2.2.1
Device: CPU - Batch Size: 1 - Model: ResNet-50
batches/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 34.93 |============================


TensorFlow Lite 2022-05-18
Model: Mobilenet Quant
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 4098.48 |==========================


TensorFlow Lite 2022-05-18
Model: Mobilenet Float
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3350.72 |==========================


TensorFlow Lite 2022-05-18
Model: NASNet Mobile
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 69069.7 |==========================


TensorFlow Lite 2022-05-18
Model: Inception V4
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 37181.9 |==========================


TensorFlow Lite 2022-05-18
Model: SqueezeNet
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5088.14 |==========================


LiteRT 2024-10-15
Model: Quantized COCO SSD MobileNet v1
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5503.91 |==========================


LiteRT 2024-10-15
Model: Inception ResNet V2
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 45507.6 |==========================


LiteRT 2024-10-15
Model: Mobilenet Float
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3345.85 |==========================


LiteRT 2024-10-15
Model: NASNet Mobile
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 75527.3 |==========================


LiteRT 2024-10-15
Model: Inception V4
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 38062.4 |==========================


LiteRT 2024-10-15
Model: SqueezeNet
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5245.27 |==========================


LiteRT 2024-10-15
Model: DeepLab V3
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8793.87 |==========================


Intel MPI Benchmarks 2019.3
Test: IMB-MPI1 Sendrecv
Average usec < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 79.47 |============================


Intel MPI Benchmarks 2019.3
Test: IMB-MPI1 Sendrecv
Average Mbytes/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3393.59 |==========================


Intel MPI Benchmarks 2019.3
Test: IMB-MPI1 Exchange
Average usec < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 108.05 |===========================


Intel MPI Benchmarks 2019.3
Test: IMB-MPI1 Exchange
Average Mbytes/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6073.65 |==========================


Intel MPI Benchmarks 2019.3
Test: IMB-P2P PingPong
Average Msg/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 28744589 |=========================


R Benchmark

Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 0.1446 |===========================


Cython Benchmark 0.29.21
Test: N-Queens
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 17.98 |============================


Numpy Benchmark

Score > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 565.16 |===========================


oneDNN 3.6
Harness: Recurrent Neural Network Inference - Engine: CPU
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 398.49 |===========================


oneDNN 3.6
Harness: Recurrent Neural Network Training - Engine: CPU
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 669.68 |===========================


oneDNN 3.6
Harness: Deconvolution Batch shapes_3d - Engine: CPU
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 1.10328 |==========================


oneDNN 3.6
Harness: Deconvolution Batch shapes_1d - Engine: CPU
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8.66502 |==========================


oneDNN 3.6
Harness: Convolution Batch Shapes Auto - Engine: CPU
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 0.673369 |=========================


oneDNN 3.6
Harness: IP Shapes 3D - Engine: CPU
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 0.310889 |=========================


oneDNN 3.6
Harness: IP Shapes 1D - Engine: CPU
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 0.827742 |=========================


Timed LLVM Compilation 16.0
Build System: Unix Makefiles
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 198.90 |===========================


Timed LLVM Compilation 16.0
Build System: Ninja
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 135.29 |===========================


Timed Linux Kernel Compilation 6.8
Build: allmodconfig
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 258.64 |===========================


Timed Linux Kernel Compilation 6.8
Build: defconfig
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 30.30 |============================


Timed GCC Compilation 13.2
Time To Compile
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 913.62 |===========================


Epoch 4.19.4
Epoch3D Deck: Cone
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 384.19 |===========================


Timed MrBayes Analysis 3.2.7
Primate Phylogeny Analysis
Seconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 81.58 |============================


NAS Parallel Benchmarks 3.4
Test / Class: SP.C
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 108596.64 |========================


NAS Parallel Benchmarks 3.4
Test / Class: SP.B
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 146367.34 |========================


NAS Parallel Benchmarks 3.4
Test / Class: MG.C
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 119325.63 |========================


NAS Parallel Benchmarks 3.4
Test / Class: LU.C
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 199460.27 |========================


NAS Parallel Benchmarks 3.4
Test / Class: IS.D
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 4064.08 |==========================


NAS Parallel Benchmarks 3.4
Test / Class: FT.C
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 102149.25 |========================


NAS Parallel Benchmarks 3.4
Test / Class: EP.D
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 7273.96 |==========================


NAS Parallel Benchmarks 3.4
Test / Class: EP.C
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6692.95 |==========================


NAS Parallel Benchmarks 3.4
Test / Class: CG.C
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 50419.73 |=========================


NAS Parallel Benchmarks 3.4
Test / Class: BT.C
Total Mop/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 176096.16 |========================


HPL Linpack 2.3

GFLOPS > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 631.30 |===========================


Glibc Benchmarks 2.39
Benchmark: pthread_once
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5.65547 |==========================


Glibc Benchmarks 2.39
Benchmark: sincos
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 38.98 |============================


Glibc Benchmarks 2.39
Benchmark: ffsll
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5.67055 |==========================


Glibc Benchmarks 2.39
Benchmark: atanh
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 28.18 |============================


Glibc Benchmarks 2.39
Benchmark: asinh
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 22.58 |============================


Glibc Benchmarks 2.39
Benchmark: tanh
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 26.97 |============================


Glibc Benchmarks 2.39
Benchmark: sqrt
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 8.24574 |==========================


Glibc Benchmarks 2.39
Benchmark: sinh
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 22.96 |============================


Glibc Benchmarks 2.39
Benchmark: modf
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 6.61957 |==========================


Glibc Benchmarks 2.39
Benchmark: log2
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 10.42 |============================


Glibc Benchmarks 2.39
Benchmark: sin
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 63.12 |============================


Glibc Benchmarks 2.39
Benchmark: pow
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 35.56 |============================


Glibc Benchmarks 2.39
Benchmark: ffs
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 5.67032 |==========================


Glibc Benchmarks 2.39
Benchmark: exp
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 15.14 |============================


Glibc Benchmarks 2.39
Benchmark: cos
ns < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 70.82 |============================


Compile Bench 0.6
Test: Read Compiled Tree
MB/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 2657.42 |==========================


Compile Bench 0.6
Test: Initial Create
MB/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 399.79 |===========================


Compile Bench 0.6
Test: Compile
MB/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 1613.38 |==========================


Llama.cpp b4397
Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512
Tokens Per Second > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 193.81 |===========================


Scikit-Learn 1.2.2
Benchmark: Sparse Random Projections / 100 Iterations
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Kernel PCA Solvers / Time vs. N Components
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Kernel PCA Solvers / Time vs. N Samples
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Hist Gradient Boosting Categorical Only
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Non-Negative Matrix Factorization
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Polynomial Kernel Approximation
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: 20 Newsgroups / Logistic Regression
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Hist Gradient Boosting Higgs Boson
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Singular Value Decomposition
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Hist Gradient Boosting Threading
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Isotonic / Perturbed Logarithm
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Hist Gradient Boosting Adult
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Covertype Dataset Benchmark
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Sample Without Replacement
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: RCV1 Logreg Convergencet
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Isotonic / Pathological
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Parallel Pairwise
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Hist Gradient Boosting
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Incremental PCA
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Isotonic / Logistic
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: TSNE MNIST Dataset
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: LocalOutlierFactor
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Feature Expansions
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot OMP vs. LARS
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Hierarchical
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Text Vectorizers
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Fast KMeans
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Isolation Forest
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Lasso Path
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: SGDOneClassSVM
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: SGD Regression
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Neighbors
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: MNIST Dataset
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Plot Ward
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Sparsify
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Glmnet
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Lasso
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: Tree
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: SAGA
Seconds < Lower Is Better


Scikit-Learn 1.2.2
Benchmark: GLM
Seconds < Lower Is Better


NCNN 20241226
Target: Vulkan GPU - Model: FastestDet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 17.29 |============================


NCNN 20241226
Target: CPU - Model: FastestDet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 17.79 |============================


NCNN 20241226
Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 23.31 |============================


NCNN 20241226
Target: CPU-v3-v3 - Model: mobilenet-v3
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 14.36 |============================


NCNN 20241226
Target: CPU - Model: mobilenet
ms < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 23.31 |============================


spaCy 3.4.1
Model: en_core_web_trf
tokens/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 2751 |=============================


Stress-NG 0.18.09
Test: IO_uring
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 174744.18 |========================


Stress-NG 0.18.09
Test: Crypto
Bogo Ops/s > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 402622178.28 |=====================


TensorFlow Lite 2022-05-18
Model: Inception ResNet V2
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 68557.9 |==========================


LiteRT 2024-10-15
Model: Mobilenet Quant
Microseconds < Lower Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3255.76 |==========================


Intel MPI Benchmarks 2019.3
Test: IMB-MPI1 PingPong
Average Mbytes/sec > Higher Is Better
Ubuntu 22.04 - 2 x AMD EPYC 9274F 24-Core . 3739.53 |==========================