Linux Distros Emerald Rapids
Benchmarks for a future article.


Ubuntu Linux 23.10: 

	Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

	OS: Ubuntu 23.10, Kernel: 6.5.0-17-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768

CentOS Stream 9: 

	Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

	OS: CentOS Stream 9, Kernel: 5.14.0-419.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.4.1 20231218, File-System: xfs, Screen Resolution: 1920x1200

Fedora Server 39: 

	Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

	OS: Fedora Linux 39, Kernel: 6.7.6-200.fc39.x86_64 (x86_64), Compiler: GCC 13.2.1 20231205, File-System: xfs, Screen Resolution: 1024x768

Arch Linux: 

	Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

	OS: Arch Linux, Kernel: 6.7.6-arch1-2 (x86_64), Compiler: GCC 13.2.1 20230801, File-System: btrfs, Screen Resolution: 1920x1200


High Performance Conjugate Gradient 3.1
X Y Z: 104 104 104 - RT: 60
GFLOP/s > Higher Is Better
Ubuntu Linux 23.10 . 71.14 |==================================================
CentOS Stream 9 .... 71.13 |==================================================
Fedora Server 39 ... 72.46 |===================================================
Arch Linux ......... 71.13 |==================================================


High Performance Conjugate Gradient 3.1
X Y Z: 144 144 144 - RT: 60
GFLOP/s > Higher Is Better
Ubuntu Linux 23.10 . 69.34 |==================================================
CentOS Stream 9 .... 69.17 |==================================================
Fedora Server 39 ... 70.38 |===================================================
Arch Linux ......... 70.12 |===================================================


LeelaChessZero 0.30
Backend: BLAS
Nodes Per Second > Higher Is Better
Ubuntu Linux 23.10 . 15 |======================================================


LeelaChessZero 0.30
Backend: Eigen
Nodes Per Second > Higher Is Better
Ubuntu Linux 23.10 . 380 |=====================================================


Quicksilver 20230818
Input: CTS2
Figure Of Merit > Higher Is Better
Ubuntu Linux 23.10 . 7680222 |=================================================
CentOS Stream 9 .... 7398333 |===============================================
Fedora Server 39 ... 7367500 |===============================================
Arch Linux ......... 7723667 |=================================================


Quicksilver 20230818
Input: CORAL2 P1
Figure Of Merit > Higher Is Better
Ubuntu Linux 23.10 . 5931500 |=================================================
CentOS Stream 9 .... 5800833 |================================================
Fedora Server 39 ... 5835818 |================================================
Arch Linux ......... 5865500 |================================================


Quicksilver 20230818
Input: CORAL2 P2
Figure Of Merit > Higher Is Better
Ubuntu Linux 23.10 . 6744778 |===============================================
CentOS Stream 9 .... 6381000 |=============================================
Fedora Server 39 ... 6759600 |===============================================
Arch Linux ......... 7013889 |=================================================


CloverLeaf 1.3
Input: clover_bm16
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 279.21 |=======================================
CentOS Stream 9 .... 314.49 |============================================
Fedora Server 39 ... 255.39 |====================================
Arch Linux ......... 356.23 |==================================================


CloverLeaf 1.3
Input: clover_bm64_short
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 32.10 |===================================================
CentOS Stream 9 .... 25.01 |========================================
Fedora Server 39 ... 31.63 |==================================================
Arch Linux ......... 30.30 |================================================


NAMD 3.0b6
Input: ATPase with 327,506 Atoms
ns/day > Higher Is Better
Ubuntu Linux 23.10 . 4.70711 |=========================================
CentOS Stream 9 .... 3.20328 |============================
Fedora Server 39 ... 5.40706 |===============================================
Arch Linux ......... 5.59956 |=================================================


NAMD 3.0b6
Input: STMV with 1,066,628 Atoms
ns/day > Higher Is Better
Ubuntu Linux 23.10 . 1.49004 |======================================
CentOS Stream 9 .... 0.50251 |=============
Fedora Server 39 ... 1.92977 |=================================================
Arch Linux ......... 1.74784 |============================================


NWChem 7.0.2
Input: C240 Buckyball
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 1750.3 |==================================================


Xcompact3d Incompact3d 2021-03-11
Input: X3D-benchmarking input.i3d
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 169.18 |=============================================
CentOS Stream 9 .... 184.19 |=================================================
Fedora Server 39 ... 168.67 |=============================================
Arch Linux ......... 187.27 |==================================================


LAMMPS Molecular Dynamics Simulator 23Jun2022
Model: 20k Atoms
ns/day > Higher Is Better
Ubuntu Linux 23.10 . 56.68 |==============================================
CentOS Stream 9 .... 57.84 |===============================================
Fedora Server 39 ... 57.68 |===============================================
Arch Linux ......... 62.99 |===================================================


LAMMPS Molecular Dynamics Simulator 23Jun2022
Model: Rhodopsin Protein
ns/day > Higher Is Better
Ubuntu Linux 23.10 . 37.52 |=============================================
CentOS Stream 9 .... 39.80 |===============================================
Fedora Server 39 ... 39.01 |===============================================
Arch Linux ......... 42.75 |===================================================


easyWave r34
Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 177.75 |===========================================
CentOS Stream 9 .... 205.01 |==================================================
Fedora Server 39 ... 156.24 |======================================
Arch Linux ......... 145.71 |====================================


Embree 4.3
Binary: Pathtracer ISPC - Model: Crown
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 100.34 |===================================
CentOS Stream 9 .... 105.62 |=====================================
Fedora Server 39 ... 142.17 |==================================================
Arch Linux ......... 118.74 |==========================================


Embree 4.3
Binary: Pathtracer ISPC - Model: Asian Dragon
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 144.92 |========================================
CentOS Stream 9 .... 177.80 |==================================================
Fedora Server 39 ... 179.54 |==================================================
Arch Linux ......... 148.60 |=========================================


SVT-AV1 1.8
Encoder Mode: Preset 4 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 2.307 |=================================================
CentOS Stream 9 .... 2.358 |==================================================
Fedora Server 39 ... 2.346 |==================================================
Arch Linux ......... 2.395 |===================================================


SVT-AV1 1.8
Encoder Mode: Preset 8 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 21.32 |=================================================
CentOS Stream 9 .... 21.56 |==================================================
Fedora Server 39 ... 21.16 |=================================================
Arch Linux ......... 22.05 |===================================================


SVT-AV1 1.8
Encoder Mode: Preset 12 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 66.86 |==============================================
CentOS Stream 9 .... 69.87 |================================================
Fedora Server 39 ... 71.52 |=================================================
Arch Linux ......... 73.72 |===================================================


SVT-AV1 1.8
Encoder Mode: Preset 13 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 66.43 |==============================================
CentOS Stream 9 .... 69.72 |=================================================
Fedora Server 39 ... 70.87 |==================================================
Arch Linux ......... 72.91 |===================================================


VVenC 1.11
Video Input: Bosphorus 4K - Video Preset: Fast
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 2.785 |=================================================
CentOS Stream 9 .... 2.823 |==================================================
Fedora Server 39 ... 2.834 |==================================================
Arch Linux ......... 2.900 |===================================================


VVenC 1.11
Video Input: Bosphorus 4K - Video Preset: Faster
Frames Per Second > Higher Is Better
Ubuntu Linux 23.10 . 5.611 |================================================
CentOS Stream 9 .... 5.808 |==================================================
Fedora Server 39 ... 5.804 |==================================================
Arch Linux ......... 5.942 |===================================================


ACES DGEMM 1.0
Sustained Floating-Point Rate
GFLOP/s > Higher Is Better
Ubuntu Linux 23.10 . 37.97 |==============================
CentOS Stream 9 .... 63.64 |===================================================
Fedora Server 39 ... 37.72 |==============================
Arch Linux ......... 43.67 |===================================


Intel Open Image Denoise 2.2
Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only
Images / Sec > Higher Is Better
Ubuntu Linux 23.10 . 4.53 |===============================================
CentOS Stream 9 .... 5.04 |====================================================
Fedora Server 39 ... 4.68 |================================================
Arch Linux ......... 4.75 |=================================================


Intel Open Image Denoise 2.2
Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only
Images / Sec > Higher Is Better
Ubuntu Linux 23.10 . 4.54 |================================================
CentOS Stream 9 .... 4.90 |====================================================
Fedora Server 39 ... 4.70 |==================================================
Arch Linux ......... 4.75 |==================================================


Intel Open Image Denoise 2.2
Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only
Images / Sec > Higher Is Better
Ubuntu Linux 23.10 . 2.18 |=============================================
CentOS Stream 9 .... 2.51 |====================================================
Fedora Server 39 ... 2.25 |===============================================
Arch Linux ......... 2.36 |=================================================


OpenVKL 2.0.0
Benchmark: vklBenchmarkCPU ISPC
Items / Sec > Higher Is Better
Ubuntu Linux 23.10 . 2821 |==================================================
CentOS Stream 9 .... 2815 |==================================================
Fedora Server 39 ... 2821 |==================================================
Arch Linux ......... 2951 |====================================================


7-Zip Compression 22.01
Test: Compression Rating
MIPS > Higher Is Better
Ubuntu Linux 23.10 . 464813 |===============================
CentOS Stream 9 .... 751070 |=================================================
Fedora Server 39 ... 496138 |=================================
Arch Linux ......... 759279 |==================================================


7-Zip Compression 22.01
Test: Decompression Rating
MIPS > Higher Is Better
Ubuntu Linux 23.10 . 455056 |===============================================
CentOS Stream 9 .... 434200 |=============================================
Fedora Server 39 ... 428601 |============================================
Arch Linux ......... 482076 |==================================================


Y-Cruncher 0.8.3
Pi Digits To Calculate: 1B
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 7.207 |============================================
CentOS Stream 9 .... 7.913 |=================================================
Fedora Server 39 ... 8.270 |===================================================
Arch Linux ......... 7.561 |===============================================


Y-Cruncher 0.8.3
Pi Digits To Calculate: 5B
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 29.82 |=============================================
CentOS Stream 9 .... 32.85 |==================================================
Fedora Server 39 ... 33.73 |===================================================
Arch Linux ......... 33.65 |===================================================


ClickHouse 22.12.3.5
100M Rows Hits Dataset, First Run / Cold Cache
Queries Per Minute, Geo Mean > Higher Is Better
Ubuntu Linux 23.10 . 205.20 |=================================================
CentOS Stream 9 .... 183.62 |============================================
Fedora Server 39 ... 188.71 |=============================================
Arch Linux ......... 209.64 |==================================================


ClickHouse 22.12.3.5
100M Rows Hits Dataset, Second Run
Queries Per Minute, Geo Mean > Higher Is Better
Ubuntu Linux 23.10 . 214.31 |================================================
CentOS Stream 9 .... 200.18 |=============================================
Fedora Server 39 ... 202.14 |==============================================
Arch Linux ......... 221.80 |==================================================


ClickHouse 22.12.3.5
100M Rows Hits Dataset, Third Run
Queries Per Minute, Geo Mean > Higher Is Better
Ubuntu Linux 23.10 . 215.62 |=================================================
CentOS Stream 9 .... 201.05 |=============================================
Fedora Server 39 ... 206.83 |===============================================
Arch Linux ......... 221.71 |==================================================


Memcached 1.6.19
Set To Get Ratio: 1:10
Ops/sec > Higher Is Better
Ubuntu Linux 23.10 . 3370014.38 |============================
CentOS Stream 9 .... 3337339.10 |============================
Fedora Server 39 ... 5054518.76 |===========================================
Arch Linux ......... 5462773.67 |==============================================


Memcached 1.6.19
Set To Get Ratio: 1:100
Ops/sec > Higher Is Better
Ubuntu Linux 23.10 . 3477137.28 |=================
CentOS Stream 9 .... 2615816.73 |============
Fedora Server 39 ... 8983240.52 |===========================================
Arch Linux ......... 9633352.44 |==============================================


Redis 7.0.4
Test: GET - Parallel Connections: 500
Requests Per Second > Higher Is Better
Ubuntu Linux 23.10 . 1541713.80 |=======================================
CentOS Stream 9 .... 1821521.39 |==============================================
Fedora Server 39 ... 1838671.43 |==============================================
Arch Linux ......... 1777534.65 |============================================


Redis 7.0.4
Test: SET - Parallel Connections: 500
Requests Per Second > Higher Is Better
Ubuntu Linux 23.10 . 2134872.89 |============================================
CentOS Stream 9 .... 1978937.18 |=========================================
Fedora Server 39 ... 2125843.97 |============================================
Arch Linux ......... 2231227.61 |==============================================


Graph500 3.0
Scale: 26
bfs median_TEPS > Higher Is Better
Ubuntu Linux 23.10 . 1226550000 |=======================================
CentOS Stream 9 .... 1464120000 |==============================================
Fedora Server 39 ... 1195510000 |======================================
Arch Linux ......... 1275690000 |========================================


Graph500 3.0
Scale: 26
bfs max_TEPS > Higher Is Better
Ubuntu Linux 23.10 . 1289580000 |========================================
CentOS Stream 9 .... 1499600000 |==============================================
Fedora Server 39 ... 1253250000 |======================================
Arch Linux ......... 1323480000 |=========================================


Graph500 3.0
Scale: 26
sssp median_TEPS > Higher Is Better
Ubuntu Linux 23.10 . 483534000 |=============================================
CentOS Stream 9 .... 466398000 |===========================================
Fedora Server 39 ... 493031000 |=============================================
Arch Linux ......... 509964000 |===============================================


Graph500 3.0
Scale: 26
sssp max_TEPS > Higher Is Better
Ubuntu Linux 23.10 . 664991000 |=============================================
CentOS Stream 9 .... 640794000 |===========================================
Fedora Server 39 ... 663412000 |=============================================
Arch Linux ......... 692893000 |===============================================


GROMACS 2024
Implementation: MPI CPU - Input: water_GMX50_bare
Ns Per Day > Higher Is Better
Ubuntu Linux 23.10 . 9.630  |===================================
CentOS Stream 9 .... 5.939  |======================
Fedora Server 39 ... 7.180  |==========================
Arch Linux ......... 13.638 |==================================================


PostgreSQL 16
Scaling Factor: 100 - Clients: 1000 - Mode: Read Only
TPS > Higher Is Better
Ubuntu Linux 23.10 . 679317 |=================================================
Arch Linux ......... 698734 |==================================================


PostgreSQL 16
Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency
ms < Lower Is Better
Ubuntu Linux 23.10 . 1.489 |===================================================
Arch Linux ......... 1.440 |=================================================


PostgreSQL 16
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write
TPS > Higher Is Better
Ubuntu Linux 23.10 . 39542 |===================================================
Arch Linux ......... 18536 |========================


PostgreSQL 16
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency
ms < Lower Is Better
Ubuntu Linux 23.10 . 25.62 |========================
Arch Linux ......... 54.09 |===================================================


TensorFlow 2.12
Device: CPU - Batch Size: 512 - Model: ResNet-50
images/sec > Higher Is Better
Ubuntu Linux 23.10 . 73.12 |================================================
CentOS Stream 9 .... 76.68 |===================================================
Arch Linux ......... 77.06 |===================================================


RawTherapee
Total Benchmark Time
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 129.08 |==================================================
Fedora Server 39 ... 118.23 |==============================================
Arch Linux ......... 107.05 |=========================================


Neural Magic DeepSparse 1.6
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 132.68 |=================================================
CentOS Stream 9 .... 132.91 |==================================================
Arch Linux ......... 134.21 |==================================================


Neural Magic DeepSparse 1.6
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 478.76 |==================================================
CentOS Stream 9 .... 478.03 |==================================================
Arch Linux ......... 474.24 |==================================================


Neural Magic DeepSparse 1.6
Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 4547.54 |=================================================
CentOS Stream 9 .... 4462.53 |================================================
Arch Linux ......... 4534.89 |=================================================


Neural Magic DeepSparse 1.6
Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 14.06 |==================================================
CentOS Stream 9 .... 14.32 |===================================================
Arch Linux ......... 14.10 |==================================================


Neural Magic DeepSparse 1.6
Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 1837.11 |================================================
CentOS Stream 9 .... 1863.34 |=================================================
Arch Linux ......... 1868.77 |=================================================


Neural Magic DeepSparse 1.6
Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 34.76 |===================================================
CentOS Stream 9 .... 34.29 |==================================================
Arch Linux ......... 34.21 |==================================================


Neural Magic DeepSparse 1.6
Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 11099.64 |================================================
CentOS Stream 9 .... 11022.30 |===============================================
Arch Linux ......... 11213.16 |================================================


Neural Magic DeepSparse 1.6
Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 5.7515 |==================================================
CentOS Stream 9 .... 5.7833 |==================================================
Arch Linux ......... 5.6953 |=================================================


Neural Magic DeepSparse 1.6
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 829.51 |==================================================
CentOS Stream 9 .... 827.99 |==================================================
Arch Linux ......... 834.19 |==================================================


Neural Magic DeepSparse 1.6
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 77.02 |===================================================
CentOS Stream 9 .... 77.17 |===================================================
Arch Linux ......... 76.66 |===================================================


Neural Magic DeepSparse 1.6
Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 155.82 |==================================================
CentOS Stream 9 .... 152.57 |=================================================
Arch Linux ......... 154.32 |==================================================


Neural Magic DeepSparse 1.6
Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 409.01 |=================================================
CentOS Stream 9 .... 416.68 |==================================================
Arch Linux ......... 413.38 |==================================================


Neural Magic DeepSparse 1.6
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 1826.04 |================================================
CentOS Stream 9 .... 1866.52 |=================================================
Arch Linux ......... 1839.98 |================================================


Neural Magic DeepSparse 1.6
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 34.99 |===================================================
CentOS Stream 9 .... 34.23 |==================================================
Arch Linux ......... 34.74 |===================================================


Neural Magic DeepSparse 1.6
Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 853.21 |==================================================
CentOS Stream 9 .... 853.34 |==================================================
Arch Linux ......... 857.85 |==================================================


Neural Magic DeepSparse 1.6
Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 74.88 |===================================================
CentOS Stream 9 .... 74.80 |===================================================
Arch Linux ......... 74.53 |===================================================


Neural Magic DeepSparse 1.6
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 1223.16 |=================================================
CentOS Stream 9 .... 1223.65 |=================================================
Arch Linux ......... 1227.37 |=================================================


Neural Magic DeepSparse 1.6
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 52.28 |===================================================
CentOS Stream 9 .... 52.24 |===================================================
Arch Linux ......... 52.12 |===================================================


Neural Magic DeepSparse 1.6
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 176.57 |=================================================
CentOS Stream 9 .... 173.95 |================================================
Arch Linux ......... 181.33 |==================================================


Neural Magic DeepSparse 1.6
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 361.29 |=================================================
CentOS Stream 9 .... 366.38 |==================================================
Arch Linux ......... 351.75 |================================================


Neural Magic DeepSparse 1.6
Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 1866.23 |=================================================
CentOS Stream 9 .... 1810.95 |===============================================
Arch Linux ......... 1878.45 |=================================================


Neural Magic DeepSparse 1.6
Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 34.25 |==================================================
CentOS Stream 9 .... 35.28 |===================================================
Arch Linux ......... 34.04 |=================================================


Neural Magic DeepSparse 1.6
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
Ubuntu Linux 23.10 . 133.21 |=================================================
CentOS Stream 9 .... 133.28 |=================================================
Arch Linux ......... 134.93 |==================================================


Neural Magic DeepSparse 1.6
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
Ubuntu Linux 23.10 . 477.14 |==================================================
CentOS Stream 9 .... 476.58 |==================================================
Arch Linux ......... 471.82 |=================================================


GPAW 23.6
Input: Carbon Nanotube
Seconds < Lower Is Better
Ubuntu Linux 23.10 . 38.64  |==========
Fedora Server 39 ... 194.51 |==================================================


OpenVINO 2023.2.dev
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 375.75 |================================================
CentOS Stream 9 .... 328.37 |==========================================
Fedora Server 39 ... 340.97 |===========================================
Arch Linux ......... 392.84 |==================================================


OpenVINO 2023.2.dev
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 85.06 |=============================================
CentOS Stream 9 .... 97.34 |===================================================
Fedora Server 39 ... 93.74 |=================================================
Arch Linux ......... 81.35 |===========================================


OpenVINO 2023.2.dev
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 519.83 |=================================================
CentOS Stream 9 .... 528.79 |==================================================
Fedora Server 39 ... 529.14 |==================================================
Arch Linux ......... 531.53 |==================================================


OpenVINO 2023.2.dev
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 245.98 |==================================================
CentOS Stream 9 .... 241.67 |=================================================
Fedora Server 39 ... 241.70 |=================================================
Arch Linux ......... 240.65 |=================================================


OpenVINO 2023.2.dev
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 8901.61 |=================================================
CentOS Stream 9 .... 8908.74 |=================================================
Fedora Server 39 ... 8862.07 |================================================
Arch Linux ......... 8956.37 |=================================================


OpenVINO 2023.2.dev
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 14.37 |===================================================
CentOS Stream 9 .... 14.36 |===================================================
Fedora Server 39 ... 14.43 |===================================================
Arch Linux ......... 14.28 |==================================================


OpenVINO 2023.2.dev
Model: Face Detection Retail FP16-INT8 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 24570.10 |================================================
CentOS Stream 9 .... 24295.71 |===============================================
Fedora Server 39 ... 24296.54 |===============================================
Arch Linux ......... 24355.33 |================================================


OpenVINO 2023.2.dev
Model: Face Detection Retail FP16-INT8 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 5.20 |====================================================
CentOS Stream 9 .... 5.25 |====================================================
Fedora Server 39 ... 5.25 |====================================================
Arch Linux ......... 5.24 |====================================================


OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 2377.90 |================================================
CentOS Stream 9 .... 2412.51 |=================================================
Fedora Server 39 ... 2383.22 |================================================
Arch Linux ......... 2409.76 |=================================================


OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 53.79 |===================================================
CentOS Stream 9 .... 53.02 |==================================================
Fedora Server 39 ... 53.67 |===================================================
Arch Linux ......... 53.08 |==================================================


OpenVINO 2023.2.dev
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 1143.25 |=================================================
CentOS Stream 9 .... 617.45  |==========================
Fedora Server 39 ... 978.70  |==========================================
Arch Linux ......... 1092.75 |===============================================


OpenVINO 2023.2.dev
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 27.93 |===========================
CentOS Stream 9 .... 52.09 |===================================================
Fedora Server 39 ... 32.67 |================================
Arch Linux ......... 29.23 |=============================


OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 43516.98 |================================================
CentOS Stream 9 .... 40187.34 |============================================
Fedora Server 39 ... 42419.89 |===============================================
Arch Linux ......... 41472.25 |==============================================


OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 2.85 |=================================================
CentOS Stream 9 .... 3.02 |====================================================
Fedora Server 39 ... 2.86 |=================================================
Arch Linux ......... 2.94 |===================================================


OpenVINO 2023.2.dev
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 10033.95 |===============================================
CentOS Stream 9 .... 10113.47 |================================================
Fedora Server 39 ... 10082.93 |===============================================
Arch Linux ......... 10197.22 |================================================


OpenVINO 2023.2.dev
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 12.74 |===================================================
CentOS Stream 9 .... 12.65 |===================================================
Fedora Server 39 ... 12.69 |===================================================
Arch Linux ......... 12.54 |==================================================


OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 3217.84 |================================================
CentOS Stream 9 .... 3196.47 |================================================
Fedora Server 39 ... 3255.16 |=================================================
Arch Linux ......... 3189.70 |================================================


OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 39.76 |===================================================
CentOS Stream 9 .... 40.02 |===================================================
Fedora Server 39 ... 39.30 |==================================================
Arch Linux ......... 40.11 |===================================================


OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
Ubuntu Linux 23.10 . 61020.16 |==============================================
CentOS Stream 9 .... 60429.54 |=============================================
Fedora Server 39 ... 56624.98 |==========================================
Arch Linux ......... 64056.00 |================================================


OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 0.80 |==================================================
CentOS Stream 9 .... 0.83 |====================================================
Fedora Server 39 ... 0.83 |====================================================
Arch Linux ......... 0.77 |================================================


RocksDB 8.0
Test: Random Read
Op/s > Higher Is Better
Ubuntu Linux 23.10 . 599822046 |===========================================
Fedora Server 39 ... 652854125 |===============================================
Arch Linux ......... 608345894 |============================================


RocksDB 8.0
Test: Update Random
Op/s > Higher Is Better
Ubuntu Linux 23.10 . 125560 |=================================================
Fedora Server 39 ... 123092 |================================================
Arch Linux ......... 127451 |==================================================


RocksDB 8.0
Test: Read While Writing
Op/s > Higher Is Better
Ubuntu Linux 23.10 . 9775989 |=================================================
Fedora Server 39 ... 8567006 |===========================================
Arch Linux ......... 9385652 |===============================================


RocksDB 8.0
Test: Read Random Write Random
Op/s > Higher Is Better
Ubuntu Linux 23.10 . 955461  |========================================
Fedora Server 39 ... 1184837 |=================================================
Arch Linux ......... 932034  |=======================================


Speedb 2.7
Test: Random Read
Op/s > Higher Is Better
Ubuntu Linux 23.10 . 600703384 |=============================================
Fedora Server 39 ... 626261826 |===============================================
Arch Linux ......... 616573385 |==============================================


OSPRay 3.1
Benchmark: particle_volume/ao/real_time
Items Per Second > Higher Is Better
Ubuntu Linux 23.10 . 20.65 |===================================================
CentOS Stream 9 .... 20.50 |===================================================
Fedora Server 39 ... 20.44 |==================================================
Arch Linux ......... 20.67 |===================================================


OSPRay 3.1
Benchmark: particle_volume/scivis/real_time
Items Per Second > Higher Is Better
Ubuntu Linux 23.10 . 20.77 |===================================================
CentOS Stream 9 .... 20.44 |==================================================
Fedora Server 39 ... 20.54 |==================================================
Arch Linux ......... 20.78 |===================================================


OSPRay 3.1
Benchmark: particle_volume/pathtracer/real_time
Items Per Second > Higher Is Better
Ubuntu Linux 23.10 . 82.97 |===================================================
CentOS Stream 9 .... 83.57 |===================================================
Fedora Server 39 ... 82.14 |==================================================
Arch Linux ......... 82.51 |==================================================


OSPRay 3.1
Benchmark: gravity_spheres_volume/dim_512/ao/real_time
Items Per Second > Higher Is Better
Ubuntu Linux 23.10 . 28.61 |===========================================
CentOS Stream 9 .... 29.76 |=============================================
Fedora Server 39 ... 28.66 |===========================================
Arch Linux ......... 34.05 |===================================================


OSPRay 3.1
Benchmark: gravity_spheres_volume/dim_512/scivis/real_time
Items Per Second > Higher Is Better
Ubuntu Linux 23.10 . 28.92 |===============================================
CentOS Stream 9 .... 29.51 |================================================
Fedora Server 39 ... 28.43 |==============================================
Arch Linux ......... 31.58 |===================================================


OSPRay 3.1
Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time
Items Per Second > Higher Is Better
Ubuntu Linux 23.10 . 32.32 |=================================================
CentOS Stream 9 .... 33.29 |===================================================
Fedora Server 39 ... 31.70 |================================================
Arch Linux ......... 33.37 |===================================================


OSPRay Studio 1.0
Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 914 |=====================================================
Fedora Server 39 ... 902 |====================================================
Arch Linux ......... 874 |===================================================


OSPRay Studio 1.0
Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 911 |=====================================================
Fedora Server 39 ... 897 |====================================================
Arch Linux ......... 867 |==================================================


OSPRay Studio 1.0
Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 1079 |====================================================
Fedora Server 39 ... 1058 |===================================================
Arch Linux ......... 1026 |=================================================


OSPRay Studio 1.0
Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 12086 |===================================================
Fedora Server 39 ... 12187 |===================================================
Arch Linux ......... 11575 |================================================


OSPRay Studio 1.0
Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 32279 |===================================================
Fedora Server 39 ... 28035 |============================================
Arch Linux ......... 23884 |======================================


OSPRay Studio 1.0
Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 12243 |===================================================
Fedora Server 39 ... 12262 |===================================================
Arch Linux ......... 11658 |================================================


OSPRay Studio 1.0
Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 33174 |===================================================
Fedora Server 39 ... 27524 |==========================================
Arch Linux ......... 23687 |====================================


OSPRay Studio 1.0
Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 14508 |===================================================
Fedora Server 39 ... 14422 |===================================================
Arch Linux ......... 13639 |================================================


OSPRay Studio 1.0
Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 37285 |===================================================
Fedora Server 39 ... 34698 |===============================================
Arch Linux ......... 33976 |==============================================


OSPRay Studio 1.0
Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 234 |=====================================================
Fedora Server 39 ... 235 |=====================================================
Arch Linux ......... 226 |===================================================


OSPRay Studio 1.0
Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 233 |=====================================================
Fedora Server 39 ... 233 |=====================================================
Arch Linux ......... 223 |===================================================


OSPRay Studio 1.0
Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 276 |=====================================================
Fedora Server 39 ... 276 |=====================================================
Arch Linux ......... 265 |===================================================


OSPRay Studio 1.0
Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 3718 |====================================================
Fedora Server 39 ... 3683 |====================================================
Arch Linux ......... 3591 |==================================================


OSPRay Studio 1.0
Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 6448 |====================================================
Fedora Server 39 ... 6314 |===================================================
Arch Linux ......... 6380 |===================================================


OSPRay Studio 1.0
Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 3694 |====================================================
Fedora Server 39 ... 3655 |===================================================
Arch Linux ......... 3544 |==================================================


OSPRay Studio 1.0
Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 6324 |===================================================
Fedora Server 39 ... 6303 |===================================================
Arch Linux ......... 6399 |====================================================


OSPRay Studio 1.0
Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 4353 |====================================================
Fedora Server 39 ... 4377 |====================================================
Arch Linux ......... 4173 |==================================================


OSPRay Studio 1.0
Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
ms < Lower Is Better
Ubuntu Linux 23.10 . 7321 |===================================================
Fedora Server 39 ... 7424 |====================================================
Arch Linux ......... 7043 |=================================================