RHEL 10.0 Beta AMD EPYC Benchmarks
Red Hat Enterprise Linux 10 benchmarks on AMD EPYC. RHEL 10.0 Bets vs. RHEL 9.5 performance. Benchmarks by Michael Larabel for a future article.


RHEL 9.5: 

	Processor: AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads), Motherboard: Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS), Chipset: AMD Device 153a, Memory: 12 x 64GB DRAM-6000MT/s Micron MTC40F2046S1RC64BDY QSFF, Disk: 2048GB SOLIDIGM SSDPFKNU020TZ, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

	OS: Red Hat Enterprise Linux 9.5, Kernel: 5.14.0-503.16.1.el9_5.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.5.0 20240719, File-System: xfs, Screen Resolution: 1024x768

RHEL 10.0 Beta: 

	Processor: AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads), Motherboard: Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS), Chipset: AMD Device 153a, Memory: 12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF, Disk: 2048GB SOLIDIGM SSDPFKNU020TZ, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

	OS: Red Hat Enterprise Linux 10.0 Beta, Kernel: 6.11.0-0.rc5.23.el10.x86_64 (x86_64), Desktop: GNOME Shell, Compiler: GCC 14.2.1 20240801, File-System: xfs


Zstd Compression
Compression Level: 19 - Compression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 132.2 |=======================================================
RHEL 10.0 Beta . 127.6 |=====================================================


Cryptsetup
PBKDF2-sha512
Iterations Per Second > Higher Is Better
RHEL 9.5 ....... 2781227 |================================================
RHEL 10.0 Beta . 3043817 |=====================================================


Cryptsetup
PBKDF2-whirlpool
Iterations Per Second > Higher Is Better
RHEL 9.5 ....... 997402  |====================================================
RHEL 10.0 Beta . 1009583 |=====================================================


Zstd Compression
Compression Level: 19 - Decompression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 5024.8 |======================================================
RHEL 10.0 Beta . 4863.3 |====================================================


Cryptsetup
AES-XTS 256b Encryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 6509.8  |===========================
RHEL 10.0 Beta . 12705.7 |=====================================================


Cryptsetup
AES-XTS 256b Decryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 6541.4  |===========================
RHEL 10.0 Beta . 12748.7 |=====================================================


Cryptsetup
Serpent-XTS 256b Encryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 752.4 |=======================================================
RHEL 10.0 Beta . 742.9 |======================================================


Cryptsetup
Twofish-XTS 256b Encryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 710.1 |=======================================================
RHEL 10.0 Beta . 693.8 |======================================================


Cryptsetup
AES-XTS 512b Encryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 5171.6  |========================
RHEL 10.0 Beta . 11373.4 |=====================================================


Cryptsetup
AES-XTS 512b Decryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 5180.1  |========================
RHEL 10.0 Beta . 11383.4 |=====================================================


Zstd Compression
Compression Level: 3, Long Mode - Decompression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 6251.2 |======================================================
RHEL 10.0 Beta . 6182.1 |=====================================================


Cryptsetup
Serpent-XTS 512b Encryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 754.5 |=======================================================
RHEL 10.0 Beta . 744.6 |======================================================


Cryptsetup
Twofish-XTS 512b Encryption
MiB/s > Higher Is Better
RHEL 9.5 ....... 711.4 |=======================================================
RHEL 10.0 Beta . 690.8 |=====================================================


Zstd Compression
Compression Level: 19, Long Mode - Compression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 65.0 |========================================================
RHEL 10.0 Beta . 62.9 |======================================================


DaCapo Benchmark 23.11
Java Test: Apache Kafka
msec < Lower Is Better
RHEL 9.5 ....... 5110 |========================================================
RHEL 10.0 Beta . 5117 |========================================================


Zstd Compression
Compression Level: 19, Long Mode - Decompression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 4990.5 |======================================================
RHEL 10.0 Beta . 4971.9 |======================================================


Zstd Compression
Compression Level: 8, Long Mode - Decompression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 6558.7 |======================================================
RHEL 10.0 Beta . 6443.3 |=====================================================


DaCapo Benchmark 23.11
Java Test: Apache Tomcat
msec < Lower Is Better
RHEL 9.5 ....... 1158 |========================================================
RHEL 10.0 Beta . 1124 |======================================================


Zstd Compression
Compression Level: 8, Long Mode - Compression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 1430.3 |==================================================
RHEL 10.0 Beta . 1536.1 |======================================================


Zstd Compression
Compression Level: 8 - Decompression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 6160.1 |======================================================
RHEL 10.0 Beta . 6060.5 |=====================================================


Zstd Compression
Compression Level: 3, Long Mode - Compression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 1370.3 |===================================================
RHEL 10.0 Beta . 1457.8 |======================================================


DaCapo Benchmark 23.11
Java Test: Apache Xalan XSLT
msec < Lower Is Better
RHEL 9.5 ....... 911 |=========================================================
RHEL 10.0 Beta . 840 |=====================================================


DaCapo Benchmark 23.11
Java Test: H2 Database Engine
msec < Lower Is Better
RHEL 9.5 ....... 2119 |========================================================
RHEL 10.0 Beta . 2129 |========================================================


Zstd Compression
Compression Level: 8 - Compression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 4738.8 |=====================================
RHEL 10.0 Beta . 6854.7 |======================================================


Zstd Compression
Compression Level: 3 - Decompression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 5838.3 |======================================================
RHEL 10.0 Beta . 5751.3 |=====================================================


Zstd Compression
Compression Level: 3 - Compression Speed
MB/s > Higher Is Better
RHEL 9.5 ....... 13074.2 |=====================================================
RHEL 10.0 Beta . 13162.3 |=====================================================


DaCapo Benchmark 23.11
Java Test: Apache Lucene Search Index
msec < Lower Is Better
RHEL 9.5 ....... 2492 |========================================================
RHEL 10.0 Beta . 2468 |=======================================================


DaCapo Benchmark 23.11
Java Test: Avrora AVR Simulation Framework
msec < Lower Is Better
RHEL 9.5 ....... 2656 |========================================================
RHEL 10.0 Beta . 2580 |======================================================


DaCapo Benchmark 23.11
Java Test: BioJava Biological Data Framework
msec < Lower Is Better
RHEL 9.5 ....... 4505 |========================================================
RHEL 10.0 Beta . 4410 |=======================================================


Renaissance 0.16
Test: Apache Spark ALS
ms < Lower Is Better
RHEL 9.5 ....... 757.7 |=======================================================
RHEL 10.0 Beta . 742.5 |======================================================


Renaissance 0.16
Test: Apache Spark Bayes
ms < Lower Is Better
RHEL 9.5 ....... 175.7 |=====================================================
RHEL 10.0 Beta . 184.0 |=======================================================


Renaissance 0.16
Test: Apache Spark PageRank
ms < Lower Is Better
RHEL 9.5 ....... 2157.6 |======================================================
RHEL 10.0 Beta . 2101.1 |=====================================================


Renaissance 0.16
Test: Gaussian Mixture Model
ms < Lower Is Better
RHEL 9.5 ....... 3404.2 |======================================================
RHEL 10.0 Beta . 3217.0 |===================================================


Renaissance 0.16
Test: In-Memory Database Shootout
ms < Lower Is Better
RHEL 9.5 ....... 4389.6 |======================================================
RHEL 10.0 Beta . 4212.6 |====================================================


OpenVINO GenAI 2024.5
Model: Gemma-7b-int4-ov - Device: CPU
tokens/s > Higher Is Better
RHEL 9.5 ....... 37.70 |=======================================================
RHEL 10.0 Beta . 37.77 |=======================================================


OpenVINO GenAI 2024.5
Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU
tokens/s > Higher Is Better
RHEL 9.5 ....... 65.91 |=======================================================
RHEL 10.0 Beta . 66.11 |=======================================================


OpenVINO GenAI 2024.5
Model: Falcon-7b-instruct-int4-ov - Device: CPU
tokens/s > Higher Is Better
RHEL 9.5 ....... 50.71 |=======================================================
RHEL 10.0 Beta . 51.04 |=======================================================


OpenVINO GenAI 2024.5
Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU
tokens/s > Higher Is Better
RHEL 9.5 ....... 55.52 |======================================================
RHEL 10.0 Beta . 56.26 |=======================================================


OpenSSL
Algorithm: RSA4096
sign/s > Higher Is Better
RHEL 9.5 ....... 50420.0 |=====================================================
RHEL 10.0 Beta . 50685.2 |=====================================================


GROMACS 2024
Implementation: MPI CPU - Input: water_GMX50_bare
Ns Per Day > Higher Is Better
RHEL 9.5 ....... 17.39 |=====================================================
RHEL 10.0 Beta . 17.89 |=======================================================


OpenSSL
Algorithm: ChaCha20-Poly1305
byte/s > Higher Is Better
RHEL 9.5 ....... 598137198093 |================================================
RHEL 10.0 Beta . 596085117563 |================================================


OpenSSL
Algorithm: ChaCha20
byte/s > Higher Is Better
RHEL 9.5 ....... 875870628703 |================================================
RHEL 10.0 Beta . 872714248010 |================================================


OpenSSL
Algorithm: AES-256-GCM
byte/s > Higher Is Better
RHEL 9.5 ....... 1318996105533 |===============================================
RHEL 10.0 Beta . 1321398713187 |===============================================


TensorFlow 2.16.1
Device: CPU - Batch Size: 256 - Model: ResNet-50
images/sec > Higher Is Better
RHEL 9.5 ....... 167.38 |======================================================
RHEL 10.0 Beta . 166.28 |======================================================


OpenSSL
Algorithm: RSA4096
verify/s > Higher Is Better
RHEL 9.5 ....... 2028196.9 |===================================================
RHEL 10.0 Beta . 2030249.2 |===================================================


OpenSSL
Algorithm: SHA512
byte/s > Higher Is Better
RHEL 9.5 ....... 53817614890 |=================================================
RHEL 10.0 Beta . 54198025127 |=================================================


OpenSSL
Algorithm: SHA256
byte/s > Higher Is Better
RHEL 9.5 ....... 135224180487 |==============================================
RHEL 10.0 Beta . 139711381210 |================================================


TensorFlow 2.16.1
Device: CPU - Batch Size: 512 - Model: ResNet-50
images/sec > Higher Is Better
RHEL 9.5 ....... 169.46 |======================================================
RHEL 10.0 Beta . 169.53 |======================================================


NAMD 3.0
Input: ATPase with 327,506 Atoms
ns/day > Higher Is Better
RHEL 9.5 ....... 12.32 |=======================================================
RHEL 10.0 Beta . 12.40 |=======================================================


NAMD 3.0
Input: STMV with 1,066,628 Atoms
ns/day > Higher Is Better
RHEL 9.5 ....... 4.22607 |=====================================================
RHEL 10.0 Beta . 4.22989 |=====================================================


ACES DGEMM 1.0
Sustained Floating-Point Rate
GFLOP/s > Higher Is Better
RHEL 9.5 ....... 4249.88 |=====================================================
RHEL 10.0 Beta . 4252.68 |=====================================================


Xcompact3d Incompact3d 2021-03-11
Input: X3D-benchmarking input.i3d
Seconds < Lower Is Better
RHEL 9.5 ....... 390.73 |======================================================
RHEL 10.0 Beta . 363.07 |==================================================


Xcompact3d Incompact3d 2021-03-11
Input: input.i3d 193 Cells Per Direction
Seconds < Lower Is Better
RHEL 9.5 ....... 10.72 |=======================================================
RHEL 10.0 Beta . 10.50 |======================================================


WireGuard + Linux Networking Stack Stress Test

Seconds < Lower Is Better
RHEL 9.5 ....... 186.37 |======================================================
RHEL 10.0 Beta . 169.69 |=================================================


7-Zip Compression 24.05
Test: Compression Rating
MIPS > Higher Is Better
RHEL 9.5 ....... 939657 |=====================================================
RHEL 10.0 Beta . 963776 |======================================================


7-Zip Compression 24.05
Test: Decompression Rating
MIPS > Higher Is Better
RHEL 9.5 ....... 624565 |======================================================
RHEL 10.0 Beta . 627363 |======================================================


GraphicsMagick 1.3.43
Operation: Swirl
Iterations Per Minute > Higher Is Better
RHEL 9.5 ....... 1100 |=========================================
RHEL 10.0 Beta . 1497 |========================================================


GraphicsMagick 1.3.43
Operation: Rotate
Iterations Per Minute > Higher Is Better
RHEL 9.5 ....... 350 |===================================================
RHEL 10.0 Beta . 392 |=========================================================


GraphicsMagick 1.3.43
Operation: Sharpen
Iterations Per Minute > Higher Is Better
RHEL 9.5 ....... 350 |=============================================
RHEL 10.0 Beta . 446 |=========================================================


GraphicsMagick 1.3.43
Operation: Enhanced
Iterations Per Minute > Higher Is Better
RHEL 9.5 ....... 395 |==============================================
RHEL 10.0 Beta . 494 |=========================================================


GraphicsMagick 1.3.43
Operation: Resizing
Iterations Per Minute > Higher Is Better
RHEL 9.5 ....... 1412 |=========================================
RHEL 10.0 Beta . 1914 |========================================================


GraphicsMagick 1.3.43
Operation: Noise-Gaussian
Iterations Per Minute > Higher Is Better
RHEL 9.5 ....... 393 |===============================================
RHEL 10.0 Beta . 472 |=========================================================


GraphicsMagick 1.3.43
Operation: HWB Color Space
Iterations Per Minute > Higher Is Better
RHEL 9.5 ....... 831  |=======================================
RHEL 10.0 Beta . 1198 |========================================================


SVT-AV1 2.3
Encoder Mode: Preset 3 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
RHEL 9.5 ....... 15.83 |======================================================
RHEL 10.0 Beta . 16.02 |=======================================================


SVT-AV1 2.3
Encoder Mode: Preset 5 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
RHEL 9.5 ....... 55.72 |=====================================================
RHEL 10.0 Beta . 57.33 |=======================================================


SVT-AV1 2.3
Encoder Mode: Preset 8 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
RHEL 9.5 ....... 186.93 |=====================================================
RHEL 10.0 Beta . 190.02 |======================================================


SVT-AV1 2.3
Encoder Mode: Preset 13 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
RHEL 9.5 ....... 438.09 |======================================================
RHEL 10.0 Beta . 441.19 |======================================================


x265 4.1
Video Input: Bosphorus 4K
Frames Per Second > Higher Is Better
RHEL 9.5 ....... 18.81 |======================================================
RHEL 10.0 Beta . 19.23 |=======================================================


Chaos Group V-RAY 6.0
Mode: CPU
vsamples > Higher Is Better
RHEL 9.5 ....... 194494 |====================================================
RHEL 10.0 Beta . 202977 |======================================================


Blender 4.3
Blend File: Junkshop - Compute: CPU-Only
Seconds < Lower Is Better
RHEL 9.5 ....... 16.86 |=======================================================
RHEL 10.0 Beta . 16.65 |======================================================


Blender 4.3
Blend File: Classroom - Compute: CPU-Only
Seconds < Lower Is Better
RHEL 9.5 ....... 35.70 |=======================================================
RHEL 10.0 Beta . 35.14 |======================================================


Blender 4.3
Blend File: Fishy Cat - Compute: CPU-Only
Seconds < Lower Is Better
RHEL 9.5 ....... 18.83 |=======================================================
RHEL 10.0 Beta . 18.48 |======================================================


Blender 4.3
Blend File: Barbershop - Compute: CPU-Only
Seconds < Lower Is Better
RHEL 9.5 ....... 125.03 |======================================================
RHEL 10.0 Beta . 123.35 |=====================================================


Blender 4.3
Blend File: Pabellon Barcelona - Compute: CPU-Only
Seconds < Lower Is Better
RHEL 9.5 ....... 41.08 |=======================================================
RHEL 10.0 Beta . 41.03 |=======================================================


Timed Node.js Compilation 21.7.2
Time To Compile
Seconds < Lower Is Better
RHEL 9.5 ....... 116.54 |======================================================
RHEL 10.0 Beta . 105.89 |=================================================


PyPerformance 1.11
Benchmark: go
Milliseconds < Lower Is Better
RHEL 9.5 ....... 148.0 |=======================================================
RHEL 10.0 Beta . 73.9  |===========================


PyPerformance 1.11
Benchmark: chaos
Milliseconds < Lower Is Better
RHEL 9.5 ....... 57.0 |========================================================
RHEL 10.0 Beta . 34.9 |==================================


PyPerformance 1.11
Benchmark: float
Milliseconds < Lower Is Better
RHEL 9.5 ....... 63.1 |========================================================
RHEL 10.0 Beta . 42.8 |======================================


PyPerformance 1.11
Benchmark: nbody
Milliseconds < Lower Is Better
RHEL 9.5 ....... 74.4 |========================================================
RHEL 10.0 Beta . 54.0 |=========================================


PyPerformance 1.11
Benchmark: pathlib
Milliseconds < Lower Is Better
RHEL 9.5 ....... 9.67 |=======================================================
RHEL 10.0 Beta . 9.91 |========================================================


PyPerformance 1.11
Benchmark: raytrace
Milliseconds < Lower Is Better
RHEL 9.5 ....... 252 |=========================================================
RHEL 10.0 Beta . 159 |====================================


PyPerformance 1.11
Benchmark: xml_etree
Milliseconds < Lower Is Better
RHEL 9.5 ....... 39.1 |========================================================
RHEL 10.0 Beta . 31.5 |=============================================


PyPerformance 1.11
Benchmark: gc_collect
Milliseconds < Lower Is Better
RHEL 9.5 ....... 779 |=========================================================
RHEL 10.0 Beta . 656 |================================================


PyPerformance 1.11
Benchmark: json_loads
Milliseconds < Lower Is Better
RHEL 9.5 ....... 12.4 |========================================================
RHEL 10.0 Beta . 12.1 |=======================================================


PyPerformance 1.11
Benchmark: crypto_pyaes
Milliseconds < Lower Is Better
RHEL 9.5 ....... 60.3 |========================================================
RHEL 10.0 Beta . 42.0 |=======================================


PyPerformance 1.11
Benchmark: regex_compile
Milliseconds < Lower Is Better
RHEL 9.5 ....... 93.3 |========================================================
RHEL 10.0 Beta . 71.3 |===========================================


PyPerformance 1.11
Benchmark: asyncio_tcp_ssl
Milliseconds < Lower Is Better
RHEL 9.5 ....... 684 |=========================================================
RHEL 10.0 Beta . 476 |========================================


PyPerformance 1.11
Benchmark: asyncio_websockets
Milliseconds < Lower Is Better
RHEL 9.5 ....... 361 |=========================================================
RHEL 10.0 Beta . 123 |===================


PyPerformance 1.11
Benchmark: pickle_pure_python
Milliseconds < Lower Is Better
RHEL 9.5 ....... 233 |=========================================================
RHEL 10.0 Beta . 165 |========================================


Liquid-DSP 1.6
Threads: 64 - Buffer Length: 256 - Filter Length: 512
samples/s > Higher Is Better
RHEL 9.5 ....... 1426466667 |==================================================
RHEL 10.0 Beta . 1433900000 |==================================================


Liquid-DSP 1.6
Threads: 128 - Buffer Length: 256 - Filter Length: 512
samples/s > Higher Is Better
RHEL 9.5 ....... 1975233333 |==================================================
RHEL 10.0 Beta . 1993733333 |==================================================


Liquid-DSP 1.6
Threads: 192 - Buffer Length: 256 - Filter Length: 512
samples/s > Higher Is Better
RHEL 9.5 ....... 2131466667 |=================================================
RHEL 10.0 Beta . 2168666667 |==================================================


nginx 1.23.2
Connections: 500
Requests Per Second > Higher Is Better
RHEL 9.5 ....... 378869.13 |=============================================
RHEL 10.0 Beta . 425156.32 |===================================================


PHPBench 0.8.1
PHP Benchmark Suite
Score > Higher Is Better
RHEL 9.5 ....... 1168724 |=================================================
RHEL 10.0 Beta . 1273171 |=====================================================


ClickHouse 22.12.3.5
100M Rows Hits Dataset, First Run / Cold Cache
Queries Per Minute, Geo Mean > Higher Is Better
RHEL 9.5 ....... 744.33 |====================================================
RHEL 10.0 Beta . 768.98 |======================================================


ClickHouse 22.12.3.5
100M Rows Hits Dataset, Second Run
Queries Per Minute, Geo Mean > Higher Is Better
RHEL 9.5 ....... 780.37 |=====================================================
RHEL 10.0 Beta . 796.94 |======================================================


ClickHouse 22.12.3.5
100M Rows Hits Dataset, Third Run
Queries Per Minute, Geo Mean > Higher Is Better
RHEL 9.5 ....... 778.17 |=====================================================
RHEL 10.0 Beta . 791.13 |======================================================


SQLite Speedtest 3.30
Timed Time - Size 1,000
Seconds < Lower Is Better
RHEL 9.5 ....... 33.77 |======================================================
RHEL 10.0 Beta . 34.58 |=======================================================


Apache Cassandra 5.0
Test: Writes
Op/s > Higher Is Better
RHEL 9.5 ....... 532385 |======================================================
RHEL 10.0 Beta . 464647 |===============================================


PostgreSQL 17
Scaling Factor: 1000 - Clients: 800 - Mode: Read Only
TPS > Higher Is Better
RHEL 9.5 ....... 3275353 |=====================================================
RHEL 10.0 Beta . 3189942 |====================================================


PostgreSQL 17
Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency
ms < Lower Is Better
RHEL 9.5 ....... 0.244 |=====================================================
RHEL 10.0 Beta . 0.251 |=======================================================


PostgreSQL 17
Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only
TPS > Higher Is Better
RHEL 9.5 ....... 3240478 |=====================================================
RHEL 10.0 Beta . 3135212 |===================================================


PostgreSQL 17
Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency
ms < Lower Is Better
RHEL 9.5 ....... 0.308 |=====================================================
RHEL 10.0 Beta . 0.319 |=======================================================


Perl Benchmarks
Test: Pod2html
Seconds < Lower Is Better
RHEL 9.5 ....... 0.06380345 |==================================================
RHEL 10.0 Beta . 0.06082243 |================================================


Perl Benchmarks
Test: Interpreter
Seconds < Lower Is Better
RHEL 9.5 ....... 0.00084054 |==================================================
RHEL 10.0 Beta . 0.00076987 |==============================================


PyBench 2018-02-16
Total For Average Test Times
Milliseconds < Lower Is Better
RHEL 9.5 ....... 549 |=========================================================
RHEL 10.0 Beta . 487 |===================================================


OpenVINO GenAI 2024.5
Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token
ms < Lower Is Better
RHEL 9.5 ....... 37.53 |=======================================================
RHEL 10.0 Beta . 36.74 |======================================================


OpenVINO GenAI 2024.5
Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token
ms < Lower Is Better
RHEL 9.5 ....... 26.52 |=======================================================
RHEL 10.0 Beta . 26.48 |=======================================================


OpenVINO GenAI 2024.5
Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token
ms < Lower Is Better
RHEL 9.5 ....... 18.81 |=======================================================
RHEL 10.0 Beta . 18.78 |=======================================================


OpenVINO GenAI 2024.5
Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token
ms < Lower Is Better
RHEL 9.5 ....... 15.18 |=======================================================
RHEL 10.0 Beta . 15.13 |=======================================================


OpenVINO GenAI 2024.5
Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token
ms < Lower Is Better
RHEL 9.5 ....... 29.96 |=======================================================
RHEL 10.0 Beta . 29.57 |======================================================


OpenVINO GenAI 2024.5
Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token
ms < Lower Is Better
RHEL 9.5 ....... 19.72 |=======================================================
RHEL 10.0 Beta . 19.59 |=======================================================


OpenVINO GenAI 2024.5
Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token
ms < Lower Is Better
RHEL 9.5 ....... 24.95 |=======================================================
RHEL 10.0 Beta . 24.14 |=====================================================


OpenVINO GenAI 2024.5
Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token
ms < Lower Is Better
RHEL 9.5 ....... 18.01 |=======================================================
RHEL 10.0 Beta . 17.78 |======================================================