Benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401176-NE-GIGABYTEG67
Gigabyte G242-P36 Ampere Altra Max Server
Benchmarks by Michael Larabel for a future article.
,,"G242-P36","gig","dd"
Processor,,ARMv8 Neoverse-N1 @ 3.00GHz (128 Cores),ARMv8 Neoverse-N1 @ 3.00GHz (128 Cores),ARMv8 Neoverse-N1 @ 3.00GHz (128 Cores)
Motherboard,,GIGABYTE G242-P36-00 MP32-AR2-00 v01000100 (F31k SCP: 2.10.20220531 BIOS),GIGABYTE G242-P36-00 MP32-AR2-00 v01000100 (F31k SCP: 2.10.20220531 BIOS),GIGABYTE G242-P36-00 MP32-AR2-00 v01000100 (F31k SCP: 2.10.20220531 BIOS)
Chipset,,Ampere Computing LLC Altra PCI Root Complex A,Ampere Computing LLC Altra PCI Root Complex A,Ampere Computing LLC Altra PCI Root Complex A
Memory,,16 x 32 GB DDR4-3200MT/s Samsung M393A4K40DB3-CWE,16 x 32 GB DDR4-3200MT/s Samsung M393A4K40DB3-CWE,16 x 32 GB DDR4-3200MT/s Samsung M393A4K40DB3-CWE
Disk,,800GB Micron_7450_MTFDKBA800TFS,800GB Micron_7450_MTFDKBA800TFS,800GB Micron_7450_MTFDKBA800TFS
Graphics,,ASPEED,ASPEED,ASPEED
Monitor,,VGA HDMI,VGA HDMI,VGA HDMI
Network,,2 x Intel I350,2 x Intel I350,2 x Intel I350
OS,,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10
Kernel,,6.5.0-13-generic (aarch64),6.5.0-13-generic (aarch64),6.5.0-13-generic (aarch64)
Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0
File-System,,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080
,,"G242-P36","gig","dd"
"Llama.cpp - Model: llama-2-7b.Q4_0.gguf (Tokens/sec)",HIB,21.58,21.9,26.64
"Stress-NG - Test: Cloning (Bogo Ops/s)",HIB,7795.96,7312.78,6918.49
"RocksDB - Test: Random Read (Op/s)",HIB,434052355,450500912,404291813
"RocksDB - Test: Read Random Write Random (Op/s)",HIB,3320337,3449038,3537322
"Stress-NG - Test: Context Switching (Bogo Ops/s)",HIB,20365273.28,19654874.85,20708288.98
"LeelaChessZero - Backend: BLAS (Nodes/s)",HIB,62,59,60
"Stress-NG - Test: IO_uring (Bogo Ops/s)",HIB,604943.76,612149.93,583751.83
"Quicksilver - Input: CORAL2 P2 (Figure Of Merit)",HIB,25543333,25520000,24460000
"Stress-NG - Test: Forking (Bogo Ops/s)",HIB,52250.53,50130.97,50686.58
"Speedb - Test: Read Random Write Random (Op/s)",HIB,2419683,2518519,2473336
"RocksDB - Test: Update Random (Op/s)",HIB,431406,427908,443804
"Speedb - Test: Sequential Fill (Op/s)",HIB,295079,290059,285766
"Stress-NG - Test: Pipe (Bogo Ops/s)",HIB,30330081.18,29805509.12,30776841.73
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,430.1375,421.345,433.8593
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,146.7462,149.4774,145.2837
"Speedb - Test: Update Random (Op/s)",HIB,272275,264998,264748
"ACES DGEMM - Sustained Floating-Point Rate (GFLOP/s)",HIB,17.784983,18.27275,
"Speedb - Test: Random Read (Op/s)",HIB,409571625,418448304,420437471
"Speedb - Test: Random Fill (Op/s)",HIB,284987,278264,285316
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,23.5004,24.0125,23.4209
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,477.8141,472.0699,483.308
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,45.6788,46.7273,46.4998
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,2677.0708,2624.7719,2684.8341
"Llama.cpp - Model: llama-2-70b-chat.Q5_0.gguf (Tokens/sec)",HIB,3.07,3.13,3.14
"GROMACS - Implementation: MPI CPU - Input: water_GMX50_bare (Ns/Day)",HIB,4.588,4.688,
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,33.7473,33.869,33.1592
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,132.1032,133.4484,130.6575
"LeelaChessZero - Backend: Eigen (Nodes/s)",HIB,48,47,48
"Quicksilver - Input: CORAL2 P1 (Figure Of Merit)",HIB,25273333,25810000,25510000
"Timed Linux Kernel Compilation - Build: defconfig (sec)",LIB,78.703,80.078,80.243
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,1358.1773,1334.5433,1336.3924
"Stress-NG - Test: Socket Activity (Bogo Ops/s)",HIB,28009.07,27959.85,27536.79
"Speedb - Test: Random Fill Sync (Op/s)",HIB,207376,204410,207891
"Quicksilver - Input: CTS2 (Figure Of Merit)",HIB,16203333,16460000,16430000
"Llama.cpp - Model: llama-2-13b.Q4_0.gguf (Tokens/sec)",HIB,13.90,14.02,14.11
"Stress-NG - Test: MMAP (Bogo Ops/s)",HIB,1088.77,1104.19,1092.25
"RocksDB - Test: Read While Writing (Op/s)",HIB,8558845,8516060,8636563
"Stress-NG - Test: Mixed Scheduler (Bogo Ops/s)",HIB,36794.33,36309.29,36361.29
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,47.0250,46.5531,46.4194
"OpenSSL - Algorithm: SHA256 (byte/s)",HIB,101322961753,100039593750,101321237450
"Stress-NG - Test: MEMFD (Bogo Ops/s)",HIB,574.85,576.53,569.36
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,339.9765,339.5239,343.7639
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,185.3571,185.8675,183.6437
"Timed LLVM Compilation - Build System: Ninja (sec)",LIB,266.333,267.86,264.744
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,33.6229,33.5823,33.2422
"Timed LLVM Compilation - Build System: Unix Makefiles (sec)",LIB,411.521,408.271,407.19
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,1834.5799,1832.1154,1850.2264
"Stress-NG - Test: Semaphores (Bogo Ops/s)",HIB,167637763.59,167850957.68,166379337.67
"Stress-NG - Test: Poll (Bogo Ops/s)",HIB,7330369.96,7392099.82,7395099.64
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,314.1452,315.8962,316.9118
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,200.0280,198.9064,198.3147
"Stress-NG - Test: NUMA (Bogo Ops/s)",HIB,1419.06,1416.03,1426.45
"7-Zip Compression - Test: Decompression Rating (MIPS)",HIB,537647,541204,541552
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,1830.5760,1830.7174,1843.2396
"miniFE - Problem Size: Small (CG Mflops)",HIB,23996.0,24150.7,
"Stress-NG - Test: CPU Stress (Bogo Ops/s)",HIB,33761.08,33765.26,33559.87
"Timed Linux Kernel Compilation - Build: allmodconfig (sec)",LIB,308.297,309.477,310.137
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,1320.1354,1326.9581,1327.9962
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,55.5703,55.4233,55.7222
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1137.781,1141.451,1135.4365
"7-Zip Compression - Test: Compression Rating (MIPS)",HIB,333316,333057,331579
"Stress-NG - Test: Pthread (Bogo Ops/s)",HIB,113551.87,112993.15,113379.28
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,202.2279,202.6332,201.7554
"Stress-NG - Test: System V Message Passing (Bogo Ops/s)",HIB,21143237.72,21054213.79,21119614.31
"Stress-NG - Test: Wide Vector Math (Bogo Ops/s)",HIB,2346519.63,2355564.94,2354926.97
"Stress-NG - Test: Matrix 3D Math (Bogo Ops/s)",HIB,5099.81,5082.65,5089.19
"Stress-NG - Test: Malloc (Bogo Ops/s)",HIB,164364343.39,164067515.18,164592319.96
"Stress-NG - Test: CPU Cache (Bogo Ops/s)",HIB,879814.35,882510.28,882225.34
"Stress-NG - Test: AVL Tree (Bogo Ops/s)",HIB,299.50,299.1,299.99
"Algebraic Multi-Grid Benchmark - (Figure Of Merit)",HIB,1057064333,1060136000,
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,310.8403,310.6422,311.5325
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,476.3781,477.0964,477.6899
"Stress-NG - Test: Mutex (Bogo Ops/s)",HIB,37172432.66,37215286.04,37267646.91
"Stress-NG - Test: Fused Multiply-Add (Bogo Ops/s)",HIB,151220570.51,151387869.76,151037296.46
"Stress-NG - Test: Vector Shuffle (Bogo Ops/s)",HIB,86218.95,86375.79,86257.77
"Stress-NG - Test: Zlib (Bogo Ops/s)",HIB,5987.88,5993.74,5985.69
"Stress-NG - Test: Glibc C String Functions (Bogo Ops/s)",HIB,62783286.48,62867317.16,62845443.53
"Stress-NG - Test: Crypto (Bogo Ops/s)",HIB,252315.26,251986.12,251996.36
"Stress-NG - Test: Hash (Bogo Ops/s)",HIB,15671801.48,15654462.92,15654282.58
"Stress-NG - Test: Matrix Math (Bogo Ops/s)",HIB,681885.30,682490.75,682554.33
"Stress-NG - Test: Glibc Qsort Data Sorting (Bogo Ops/s)",HIB,2020.18,2022.01,2020.3
"OpenSSL - Algorithm: SHA512 (byte/s)",HIB,34478769590,34453399030,34448701700
"Stress-NG - Test: Vector Floating Point (Bogo Ops/s)",HIB,102535.35,102553.11,102604.74
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,132.3047,132.3228,132.2627
"OpenSSL - Algorithm: RSA4096 (verify/s)",HIB,517886.0,518115.9,518085.7
"OpenSSL - Algorithm: RSA4096 (sign/s)",HIB,6342.8,6345.6,6345.3
"Stress-NG - Test: AVX-512 VNNI (Bogo Ops/s)",HIB,4690386.64,4691697.85,4692452.8
"OpenSSL - Algorithm: AES-128-GCM (byte/s)",HIB,382688207300,382856328260,382793028680
"Stress-NG - Test: Vector Math (Bogo Ops/s)",HIB,398869.87,398993.46,399042.09
"OpenSSL - Algorithm: ChaCha20 (byte/s)",HIB,161732226070,161791663040,
"CacheBench - Test: Write (MB/s)",HIB,38239.970730,38251.591924,38252.62844
"OpenSSL - Algorithm: ChaCha20-Poly1305 (byte/s)",HIB,112213448840,112250396400,
"Stress-NG - Test: Floating Point (Bogo Ops/s)",HIB,22213.54,22219.8,22220.7
"Stress-NG - Test: Memory Copying (Bogo Ops/s)",HIB,27153.74,27162.14,27159.07
"CacheBench - Test: Read / Modify / Write (MB/s)",HIB,45034.976156,45027.472701,45041.154853
"Stress-NG - Test: SENDFILE (Bogo Ops/s)",HIB,1624492.92,1624969.46,1624702.09
"Stress-NG - Test: Function Call (Bogo Ops/s)",HIB,72283.18,72298.23,72290.81
"OpenSSL - Algorithm: AES-256-GCM (byte/s)",HIB,306487842680,306544534870,
"CacheBench - Test: Read (MB/s)",HIB,11438.276516,11438.666161,11438.863847
"Xmrig - Variant: Wownero - Hash Count: 1M (H/s)",HIB,1935.2,,
"Xmrig - Variant: Monero - Hash Count: 1M (H/s)",HIB,4201.7,,
"PyTorch - Device: CPU - Batch Size: 16 - Model: ResNet-152 (batches/sec)",HIB,0.67,,
"PyTorch - Device: CPU - Batch Size: 16 - Model: ResNet-50 (batches/sec)",HIB,1.83,,
"PyTorch - Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l (batches/sec)",HIB,0.30,,
"PyTorch - Device: CPU - Batch Size: 1 - Model: ResNet-152 (batches/sec)",HIB,0.68,,
"PyTorch - Device: CPU - Batch Size: 1 - Model: ResNet-50 (batches/sec)",HIB,1.91,,
"Stockfish - Total Time (Nodes/s)",HIB,188653177,177653916,226859548
"Stress-NG - Test: Futex (Bogo Ops/s)",HIB,343012.75,323012.96,318037.93
"Stress-NG - Test: Atomic (Bogo Ops/s)",HIB,7.29,5.64,6.8
"Speedb - Test: Read While Writing (Op/s)",HIB,12905035,13255341,13785530