new 2025 AMD EPYC 9655P 96-Core testing with a Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite. a: Processor: AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads), Motherboard: Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS), Chipset: AMD 1Ah, Memory: 12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.13.0-rc4-phx-stock (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1024x768 b: Processor: AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads), Motherboard: Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS), Chipset: AMD 1Ah, Memory: 12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.13.0-rc4-phx-stock (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1024x768 c: Processor: AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads), Motherboard: Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS), Chipset: AMD 1Ah, Memory: 12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.13.0-rc4-phx-stock (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1024x768 d: Processor: AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads), Motherboard: Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS), Chipset: AMD 1Ah, Memory: 12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.13.0-rc4-phx-stock (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1024x768 e: Processor: AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads), Motherboard: Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS), Chipset: AMD 1Ah, Memory: 12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.13.0-rc4-phx-stock (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1024x768 NCNN 20241226 Target: CPU - Model: resnet18 ms < Lower Is Better a . 6.78 |============================================ b . 10.42 |==================================================================== c . 8.08 |===================================================== d . 9.01 |=========================================================== NCNN 20241226 Target: CPU - Model: vgg16 ms < Lower Is Better a . 25.30 |============================================== b . 28.36 |==================================================== c . 29.85 |======================================================= d . 37.15 |==================================================================== NCNN 20241226 Target: CPU - Model: googlenet ms < Lower Is Better a . 12.71 |============================================================ b . 11.49 |====================================================== c . 11.22 |===================================================== d . 14.34 |==================================================================== NCNN 20241226 Target: CPU - Model: vision_transformer ms < Lower Is Better a . 28.83 |======================================================== b . 31.15 |============================================================ c . 35.07 |==================================================================== d . 27.60 |====================================================== Stress-NG 0.18.09 Test: Pipe Bogo Ops/s > Higher Is Better a . 93409969.84 |============================================================= b . 86342322.23 |========================================================= c . 94350773.07 |============================================================== d . 80625187.95 |===================================================== e . 77385407.33 |=================================================== NCNN 20241226 Target: CPU - Model: resnet50 ms < Lower Is Better a . 13.59 |================================================================ b . 14.46 |==================================================================== c . 12.43 |========================================================== d . 12.53 |=========================================================== NCNN 20241226 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better a . 6.27 |============================================================= b . 7.05 |===================================================================== c . 6.23 |============================================================= d . 6.24 |============================================================= Stress-NG 0.18.09 Test: Glibc C String Functions Bogo Ops/s > Higher Is Better a . 107612437.81 |====================================================== b . 116765511.69 |=========================================================== c . 121505178.26 |============================================================= d . 121109562.70 |============================================================= NCNN 20241226 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better a . 6.51 |=============================================================== b . 6.42 |============================================================== c . 6.41 |============================================================== d . 7.18 |===================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a . 111.83 |================================================================= b . 115.39 |=================================================================== c . 112.67 |================================================================= d . 107.16 |============================================================== Stress-NG 0.18.09 Test: Cloning Bogo Ops/s > Higher Is Better a . 17095.96 |============================================================= b . 17134.67 |============================================================= c . 17504.83 |============================================================== d . 18352.08 |================================================================= e . 17774.04 |=============================================================== Stress-NG 0.18.09 Test: MMAP Bogo Ops/s > Higher Is Better a . 10428.33 |================================================================= b . 9912.94 |============================================================== c . 9853.41 |============================================================= d . 9889.77 |============================================================== e . 9716.71 |============================================================= Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a . 105.26 |=============================================================== b . 112.48 |=================================================================== c . 112.48 |=================================================================== d . 106.51 |=============================================================== Stress-NG 0.18.09 Test: Exponential Math Bogo Ops/s > Higher Is Better a . 383630.44 |============================================================= b . 398930.74 |=============================================================== c . 389486.05 |============================================================== d . 404064.53 |================================================================ NCNN 20241226 Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 ms < Lower Is Better a . 11.66 |================================================================= b . 12.26 |==================================================================== c . 11.71 |================================================================= d . 11.72 |================================================================= NCNN 20241226 Target: CPU - Model: mobilenet ms < Lower Is Better a . 11.66 |================================================================= b . 12.26 |==================================================================== c . 11.71 |================================================================= d . 11.72 |================================================================= Stress-NG 0.18.09 Test: Poll Bogo Ops/s > Higher Is Better a . 10784198.10 |============================================================== b . 10723492.78 |============================================================== c . 10308236.16 |=========================================================== d . 10651633.76 |============================================================= e . 10421659.72 |============================================================ NCNN 20241226 Target: CPU - Model: FastestDet ms < Lower Is Better a . 8.35 |===================================================================== b . 8.37 |===================================================================== c . 8.02 |================================================================== d . 8.06 |================================================================== Stress-NG 0.18.09 Test: SENDFILE Bogo Ops/s > Higher Is Better a . 2154952.69 |============================================================ b . 2246589.22 |=============================================================== c . 2197431.31 |============================================================== d . 2168580.67 |============================================================= Stress-NG 0.18.09 Test: Semaphores Bogo Ops/s > Higher Is Better a . 308990236.83 |============================================================ b . 316698667.93 |============================================================= c . 304269865.57 |=========================================================== d . 311249205.79 |============================================================ Stress-NG 0.18.09 Test: Mutex Bogo Ops/s > Higher Is Better a . 53532986.47 |============================================================== b . 52886531.75 |============================================================= c . 53398638.82 |============================================================== d . 53247347.78 |============================================================== e . 51459083.90 |============================================================ NCNN 20241226 Target: CPU - Model: yolov4-tiny ms < Lower Is Better a . 15.57 |================================================================== b . 16.11 |==================================================================== c . 15.51 |================================================================= d . 15.99 |=================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a . 109.12 |================================================================= b . 113.29 |=================================================================== c . 113.24 |=================================================================== d . 109.20 |================================================================= Stress-NG 0.18.09 Test: Futex Bogo Ops/s > Higher Is Better a . 3638855.98 |============================================================= b . 3760562.78 |=============================================================== c . 3709094.16 |============================================================== d . 3675306.13 |============================================================== e . 3676509.08 |============================================================== NCNN 20241226 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better a . 8.78 |==================================================================== b . 8.82 |==================================================================== c . 8.68 |=================================================================== d . 8.97 |===================================================================== Stress-NG 0.18.09 Test: System V Message Passing Bogo Ops/s > Higher Is Better a . 47541326.12 |============================================================= b . 47921020.68 |============================================================== c . 46473032.42 |============================================================ d . 47987577.93 |============================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a . 351.86 |================================================================= b . 358.35 |================================================================== c . 358.79 |================================================================== d . 363.16 |=================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a . 110.17 |================================================================== b . 107.87 |================================================================= c . 109.42 |================================================================== d . 111.10 |=================================================================== Stress-NG 0.18.09 Test: Mixed Scheduler Bogo Ops/s > Higher Is Better a . 122963.08 |================================================================ b . 119811.36 |============================================================== c . 119458.91 |============================================================== d . 119549.12 |============================================================== NCNN 20241226 Target: CPU - Model: regnety_400m ms < Lower Is Better a . 30.93 |==================================================================== b . 30.11 |================================================================== c . 30.50 |=================================================================== d . 30.17 |================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a . 373.19 |=================================================================== b . 363.38 |================================================================= c . 370.94 |=================================================================== d . 366.93 |================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a . 371.10 |=================================================================== b . 373.68 |=================================================================== c . 364.03 |================================================================= d . 373.62 |=================================================================== Stress-NG 0.18.09 Test: Forking Bogo Ops/s > Higher Is Better a . 108842.42 |=============================================================== b . 107808.84 |============================================================== c . 108924.02 |=============================================================== d . 110596.05 |================================================================ e . 109992.73 |================================================================ Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a . 112.55 |=================================================================== b . 110.41 |================================================================== c . 109.76 |================================================================= d . 111.80 |=================================================================== Stress-NG 0.18.09 Test: IO_uring Bogo Ops/s > Higher Is Better a . 1174584.73 |=============================================================== b . 1158950.96 |============================================================== c . 1159544.85 |============================================================== d . 1151684.30 |============================================================== NCNN 20241226 Target: CPU - Model: mnasnet ms < Lower Is Better a . 5.56 |==================================================================== b . 5.63 |===================================================================== c . 5.55 |==================================================================== d . 5.66 |===================================================================== NCNN 20241226 Target: CPU - Model: blazeface ms < Lower Is Better a . 3.66 |===================================================================== b . 3.65 |===================================================================== c . 3.59 |==================================================================== d . 3.61 |==================================================================== NCNN 20241226 Target: CPU - Model: alexnet ms < Lower Is Better a . 3.65 |==================================================================== b . 3.63 |==================================================================== c . 3.69 |===================================================================== d . 3.70 |===================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a . 111.43 |================================================================== b . 111.22 |================================================================== c . 113.34 |=================================================================== d . 111.29 |================================================================== Stress-NG 0.18.09 Test: Context Switching Bogo Ops/s > Higher Is Better a . 63915053.03 |============================================================= b . 64954321.28 |============================================================== c . 63768508.75 |============================================================= d . 64355743.86 |============================================================= Stress-NG 0.18.09 Test: MEMFD Bogo Ops/s > Higher Is Better a . 1919.79 |================================================================== b . 1900.42 |================================================================= c . 1901.11 |================================================================= d . 1902.37 |================================================================= e . 1888.50 |================================================================= NCNN 20241226 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better a . 13.14 |=================================================================== b . 13.31 |==================================================================== c . 13.20 |=================================================================== d . 13.10 |=================================================================== Stress-NG 0.18.09 Test: Memory Copying Bogo Ops/s > Higher Is Better a . 31375.32 |================================================================= b . 31364.54 |================================================================= c . 31565.71 |================================================================= d . 31095.35 |================================================================ Stress-NG 0.18.09 Test: Jpeg Compression Bogo Ops/s > Higher Is Better a . 88326.04 |================================================================ b . 89241.18 |================================================================= c . 88010.39 |================================================================ d . 89337.30 |================================================================= Stress-NG 0.18.09 Test: Fractal Generator Bogo Ops/s > Higher Is Better a . 693.40 |=================================================================== b . 688.12 |================================================================== c . 684.29 |================================================================== d . 691.63 |=================================================================== Stress-NG 0.18.09 Test: Malloc Bogo Ops/s > Higher Is Better a . 284239015.26 |============================================================ b . 286876085.56 |============================================================= c . 286437650.05 |============================================================= d . 285984682.23 |============================================================= e . 288021758.69 |============================================================= Stress-NG 0.18.09 Test: Integer Bit Operations Bogo Ops/s > Higher Is Better a . 23056228.01 |============================================================== b . 22934130.22 |============================================================== c . 22766908.87 |============================================================= d . 23049501.32 |============================================================== Stress-NG 0.18.09 Test: NUMA Bogo Ops/s > Higher Is Better a . 2481.51 |================================================================= b . 2497.58 |================================================================== c . 2489.47 |================================================================= d . 2499.31 |================================================================== e . 2511.91 |================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a . 93.23 |=================================================================== b . 93.09 |=================================================================== c . 93.50 |==================================================================== d . 94.08 |==================================================================== Stress-NG 0.18.09 Test: Glibc Qsort Data Sorting Bogo Ops/s > Higher Is Better a . 2548.19 |================================================================= b . 2568.76 |================================================================== c . 2554.43 |================================================================== d . 2568.33 |================================================================== Stress-NG 0.18.09 Test: Trigonometric Math Bogo Ops/s > Higher Is Better a . 244291.11 |================================================================ b . 243089.84 |================================================================ c . 242366.63 |=============================================================== d . 242558.25 |================================================================ Stress-NG 0.18.09 Test: CPU Stress Bogo Ops/s > Higher Is Better a . 248390.75 |================================================================ b . 250283.98 |================================================================ c . 249308.78 |================================================================ d . 250245.19 |================================================================ Stress-NG 0.18.09 Test: Vector Shuffle Bogo Ops/s > Higher Is Better a . 84138.45 |================================================================= b . 84762.10 |================================================================= c . 84482.60 |================================================================= d . 84525.31 |================================================================= NCNN 20241226 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better a . 5.75 |===================================================================== b . 5.72 |===================================================================== c . 5.76 |===================================================================== d . 5.76 |===================================================================== Stress-NG 0.18.09 Test: AVX-512 VNNI Bogo Ops/s > Higher Is Better a . 14960065.56 |============================================================== b . 15009286.86 |============================================================== c . 14917255.99 |============================================================== d . 14905295.10 |============================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a . 47.43 |==================================================================== b . 47.60 |==================================================================== c . 47.61 |==================================================================== d . 47.75 |==================================================================== Stress-NG 0.18.09 Test: Integer Math Bogo Ops/s > Higher Is Better a . 8891028.49 |=============================================================== b . 8864583.16 |=============================================================== c . 8841688.10 |=============================================================== d . 8897966.82 |=============================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a . 45.72 |==================================================================== b . 45.58 |==================================================================== c . 45.81 |==================================================================== d . 45.85 |==================================================================== Stress-NG 0.18.09 Test: POSIX Regular Expressions Bogo Ops/s > Higher Is Better a . 661780.50 |================================================================ b . 658699.92 |================================================================ c . 660034.85 |================================================================ d . 660725.51 |================================================================ Stress-NG 0.18.09 Test: Logarithmic Math Bogo Ops/s > Higher Is Better a . 716302.05 |================================================================ b . 715277.29 |================================================================ c . 716894.75 |================================================================ d . 718105.01 |================================================================ Stress-NG 0.18.09 Test: Vector Floating Point Bogo Ops/s > Higher Is Better a . 379135.34 |================================================================ b . 379291.15 |================================================================ c . 378253.20 |================================================================ d . 379655.69 |================================================================ Stress-NG 0.18.09 Test: Floating Point Bogo Ops/s > Higher Is Better a . 19070.57 |================================================================= b . 19039.70 |================================================================= c . 19000.24 |================================================================= d . 19014.27 |================================================================= Stress-NG 0.18.09 Test: Power Math Bogo Ops/s > Higher Is Better a . 224273.32 |================================================================ b . 224447.95 |================================================================ c . 223750.11 |================================================================ d . 223675.37 |================================================================ Stress-NG 0.18.09 Test: AVL Tree Bogo Ops/s > Higher Is Better a . 1160.22 |================================================================== b . 1162.53 |================================================================== c . 1161.97 |================================================================== d . 1158.99 |================================================================== Stress-NG 0.18.09 Test: Function Call Bogo Ops/s > Higher Is Better a . 86214.78 |================================================================= b . 86322.56 |================================================================= c . 86162.29 |================================================================= d . 86399.13 |================================================================= Stress-NG 0.18.09 Test: Pthread Bogo Ops/s > Higher Is Better a . 302128.67 |================================================================ b . 302585.29 |================================================================ c . 302063.59 |================================================================ d . 301801.15 |================================================================ e . 302111.18 |================================================================ Stress-NG 0.18.09 Test: Bitonic Integer Sort Bogo Ops/s > Higher Is Better a . 1044.40 |================================================================== b . 1046.97 |================================================================== c . 1045.53 |================================================================== d . 1045.96 |================================================================== Stress-NG 0.18.09 Test: Socket Activity Bogo Ops/s > Higher Is Better a . 40702.33 |================================================================= b . 40726.66 |================================================================= c . 40788.38 |================================================================= d . 40689.50 |================================================================= Stress-NG 0.18.09 Test: Atomic Bogo Ops/s > Higher Is Better a . 309.28 |=================================================================== b . 309.50 |=================================================================== c . 308.81 |=================================================================== d . 309.49 |=================================================================== e . 309.34 |=================================================================== Stress-NG 0.18.09 Test: Radix String Sort Bogo Ops/s > Higher Is Better a . 1564.70 |================================================================== b . 1568.14 |================================================================== c . 1567.30 |================================================================== d . 1567.32 |================================================================== Stress-NG 0.18.09 Test: Fused Multiply-Add Bogo Ops/s > Higher Is Better a . 138497783.11 |============================================================= b . 138796151.41 |============================================================= c . 138579068.09 |============================================================= d . 138573633.55 |============================================================= Stress-NG 0.18.09 Test: Hash Bogo Ops/s > Higher Is Better a . 24396187.67 |============================================================== b . 24359044.61 |============================================================== c . 24386852.13 |============================================================== d . 24350902.07 |============================================================== e . 24400600.12 |============================================================== Stress-NG 0.18.09 Test: Matrix Math Bogo Ops/s > Higher Is Better a . 502535.38 |================================================================ b . 502617.42 |================================================================ c . 501693.42 |================================================================ d . 501990.13 |================================================================ Stress-NG 0.18.09 Test: Bessel Math Operations Bogo Ops/s > Higher Is Better a . 60411.47 |================================================================= b . 60356.62 |================================================================= c . 60345.10 |================================================================= d . 60304.13 |================================================================= Stress-NG 0.18.09 Test: Matrix 3D Math Bogo Ops/s > Higher Is Better a . 17150.13 |================================================================= b . 17168.28 |================================================================= c . 17161.93 |================================================================= d . 17176.65 |================================================================= Stress-NG 0.18.09 Test: Hyperbolic Trigonometric Math Bogo Ops/s > Higher Is Better a . 593312.68 |================================================================ b . 593034.23 |================================================================ c . 593368.41 |================================================================ d . 593440.18 |================================================================ Stress-NG 0.18.09 Test: Vector Math Bogo Ops/s > Higher Is Better a . 672950.00 |================================================================ b . 672523.57 |================================================================ c . 672908.81 |================================================================ d . 672816.39 |================================================================ Stress-NG 0.18.09 Test: Wide Vector Math Bogo Ops/s > Higher Is Better a . 6924089.96 |=============================================================== b . 6924707.06 |=============================================================== c . 6921682.49 |=============================================================== d . 6926027.09 |=============================================================== Stress-NG 0.18.09 Test: x86_64 RdRand Bogo Ops/s > Higher Is Better a . 43519846.09 |============================================================== b . 43509192.06 |============================================================== c . 43497875.23 |============================================================== d . 43522600.11 |============================================================== Stress-NG 0.18.09 Test: Zlib Bogo Ops/s > Higher Is Better a . 11768.97 |================================================================= b . 11766.10 |================================================================= c . 11767.97 |================================================================= d . 11769.34 |================================================================= e . 11768.36 |================================================================= Stress-NG 0.18.09 Test: CPU Cache Bogo Ops/s > Higher Is Better a . 1692665.99 |============================================================= b . 1628433.01 |========================================================== c . 1758101.66 |=============================================================== d . 1685503.52 |============================================================ Stress-NG 0.18.09 Test: Crypto Bogo Ops/s > Higher Is Better a . 899403404.99 |============================================================= b . 770723548.74 |==================================================== c . 904442086.58 |============================================================= d . 904135820.16 |============================================================= e . 276965.13 |