9684X EOY2024 AMD Linux 2 x AMD EPYC 9684X 96-Core testing with a AMD Titanite_4G (RTI1007B BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite. a: Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.11.0-13-generic (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1920x1200 b: Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.11.0-13-generic (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1920x1200 c: Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.10, Kernel: 6.11.0-13-generic (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 1920x1200 Etcpak 2.0 Benchmark: Multi-Threaded - Configuration: ETC2 Mpx/s > Higher Is Better a . 875.75 |=================================================================== b . 853.03 |================================================================= c . 856.22 |================================================================== miniFE 2.2 Problem Size: Small CG Mflops > Higher Is Better a . 65310.9 |================================================================ b . 67739.3 |================================================================== c . 50712.3 |================================================= NAMD 3.0 Input: ATPase with 327,506 Atoms ns/day > Higher Is Better a . 17.85 |==================================================================== b . 17.86 |==================================================================== c . 17.93 |==================================================================== NAMD 3.0 Input: STMV with 1,066,628 Atoms ns/day > Higher Is Better a . 5.65889 |================================================================= b . 5.65973 |================================================================= c . 5.71674 |================================================================== QuantLib 1.35-dev Size: S tasks/s > Higher Is Better QuantLib 1.35-dev Size: XXS tasks/s > Higher Is Better Laghos 3.1 Test: Triple Point Problem Major Kernels Total Rate > Higher Is Better a . 202.39 |================================================================== b . 203.72 |=================================================================== c . 204.16 |=================================================================== Laghos 3.1 Test: Sedov Blast Wave, ube_922_hex.mesh Major Kernels Total Rate > Higher Is Better a . 404.65 |=================================================================== b . 397.50 |================================================================== c . 403.45 |=================================================================== Palabos 2.3 Grid Size: 100 Mega Site Updates Per Second > Higher Is Better a . 734.58 |=================================================================== b . 729.04 |================================================================== c . 734.15 |=================================================================== Palabos 2.3 Grid Size: 400 Mega Site Updates Per Second > Higher Is Better a . 530.00 |=================================================================== b . 529.25 |=================================================================== c . 531.73 |=================================================================== Palabos 2.3 Grid Size: 500 Mega Site Updates Per Second > Higher Is Better a . 556.41 |=================================================================== b . 556.41 |=================================================================== c . 558.06 |=================================================================== Palabos 2.3 Grid Size: 1000 Mega Site Updates Per Second > Higher Is Better a . 659.94 |=================================================================== b . 659.84 |=================================================================== c . 661.55 |=================================================================== Palabos 2.3 Grid Size: 4000 Mega Site Updates Per Second > Higher Is Better Epoch 4.19.4 Epoch3D Deck: Cone Seconds < Lower Is Better a . 455.50 |================================================================== b . 461.42 |=================================================================== c . 458.47 |=================================================================== Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Seconds < Lower Is Better a . 160.91 |================================================================== b . 163.13 |=================================================================== c . 159.31 |================================================================= Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 129 Cells Per Direction Seconds < Lower Is Better a . 1.29827499 |========================================================== b . 1.28448296 |========================================================= c . 1.41423202 |=============================================================== Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Seconds < Lower Is Better a . 3.97435308 |============================================================ b . 4.15029907 |=============================================================== c . 4.05741787 |============================================================== RELION 5.0 Test: Basic - Device: CPU Seconds < Lower Is Better a . 76.04 |==================================================================== b . 74.22 |================================================================== c . 74.58 |=================================================================== WarpX 24.10 Input: Uniform Plasma Seconds < Lower Is Better a . 39.29 |================================================================ b . 41.44 |==================================================================== c . 41.03 |=================================================================== WarpX 24.10 Input: Plasma Acceleration Seconds < Lower Is Better a . 37.69 |================================================================== b . 39.12 |==================================================================== c . 37.79 |================================================================== BYTE Unix Benchmark 5.1.3-git Computational Test: Pipe LPS > Higher Is Better a . 302008825.4 |============================================================== b . 302075584.9 |============================================================== c . 302154327.2 |============================================================== BYTE Unix Benchmark 5.1.3-git Computational Test: Dhrystone 2 LPS > Higher Is Better a . 12634644588.3 |============================================================ b . 12655563306.7 |============================================================ c . 12636880431.6 |============================================================ BYTE Unix Benchmark 5.1.3-git Computational Test: System Call LPS > Higher Is Better a . 247897646.3 |============================================================== b . 247922303.2 |============================================================== c . 248008992.6 |============================================================== BYTE Unix Benchmark 5.1.3-git Computational Test: Whetstone Double MWIPS > Higher Is Better a . 2713226.7 |================================================================ b . 2714473.2 |================================================================ c . 2714351.2 |================================================================ WebP Image Encode 1.4 Encode Settings: Default MP/s > Higher Is Better a . 17.92 |==================================================================== b . 18.05 |==================================================================== c . 17.96 |==================================================================== WebP Image Encode 1.4 Encode Settings: Quality 100 MP/s > Higher Is Better a . 11.18 |==================================================================== b . 11.13 |==================================================================== c . 11.14 |==================================================================== WebP Image Encode 1.4 Encode Settings: Quality 100, Lossless MP/s > Higher Is Better a . 1.44 |===================================================================== b . 1.44 |===================================================================== c . 1.44 |===================================================================== WebP Image Encode 1.4 Encode Settings: Quality 100, Highest Compression MP/s > Higher Is Better a . 3.57 |==================================================================== b . 3.59 |===================================================================== c . 3.61 |===================================================================== WebP Image Encode 1.4 Encode Settings: Quality 100, Lossless, Highest Compression MP/s > Higher Is Better a . 0.56 |===================================================================== b . 0.56 |===================================================================== c . 0.56 |===================================================================== srsRAN Project 24.10 Test: PDSCH Processor Benchmark, Throughput Total Mbps > Higher Is Better a . 129795.7 |================================================================ b . 132681.9 |================================================================= c . 128169.6 |=============================================================== srsRAN Project 24.10 Test: PUSCH Processor Benchmark, Throughput Total Mbps > Higher Is Better a . 7635.4 |=============================================================== b . 8082.6 |=================================================================== c . 7631.4 |=============================================================== SVT-AV1 2.3 Encoder Mode: Preset 3 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 11.02 |==================================================================== b . 10.93 |=================================================================== c . 11.05 |==================================================================== SVT-AV1 2.3 Encoder Mode: Preset 5 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 39.60 |==================================================================== b . 38.52 |================================================================== c . 39.04 |=================================================================== SVT-AV1 2.3 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 110.45 |============================================================= b . 121.82 |=================================================================== c . 115.68 |================================================================ SVT-AV1 2.3 Encoder Mode: Preset 13 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 154.09 |======================================================= b . 187.69 |=================================================================== c . 184.33 |================================================================== SVT-AV1 2.3 Encoder Mode: Preset 3 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 28.76 |==================================================================== b . 28.79 |==================================================================== c . 28.78 |==================================================================== SVT-AV1 2.3 Encoder Mode: Preset 5 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 95.44 |==================================================================== b . 94.72 |=================================================================== c . 96.10 |==================================================================== SVT-AV1 2.3 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 316.40 |================================================================= b . 328.08 |=================================================================== c . 321.12 |================================================================== SVT-AV1 2.3 Encoder Mode: Preset 13 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 551.64 |========================================================== b . 480.53 |=================================================== c . 636.98 |=================================================================== VVenC 1.13 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better VVenC 1.13 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better VVenC 1.13 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better VVenC 1.13 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better x265 4.1 Video Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 35.86 |==================================================================== b . 35.78 |==================================================================== c . 36.03 |==================================================================== x265 4.1 Video Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 100.86 |=================================================================== b . 99.95 |================================================================== c . 98.10 |================================================================= x265 Video Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 34.90 |==================================================================== b . 34.83 |==================================================================== c . 35.01 |==================================================================== x265 Video Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 97.18 |=================================================================== b . 98.77 |==================================================================== c . 97.06 |=================================================================== ACES DGEMM 1.0 Sustained Floating-Point Rate GFLOP/s > Higher Is Better a . 3788.09 |================================================================== b . 3796.86 |================================================================== c . 3782.57 |================================================================== Intel Open Image Denoise 2.3 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Images / Sec > Higher Is Better a . 3.29 |===================================================================== b . 3.25 |==================================================================== c . 3.23 |==================================================================== Intel Open Image Denoise 2.3 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Images / Sec > Higher Is Better a . 3.25 |===================================================================== b . 3.26 |===================================================================== c . 3.25 |===================================================================== Intel Open Image Denoise 2.3 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Images / Sec > Higher Is Better a . 1.57 |===================================================================== b . 1.55 |==================================================================== c . 1.56 |===================================================================== OSPRay 3.2 Benchmark: particle_volume/ao/real_time Items Per Second > Higher Is Better a . 46.89 |==================================================================== b . 46.99 |==================================================================== c . 47.08 |==================================================================== OSPRay 3.2 Benchmark: particle_volume/scivis/real_time Items Per Second > Higher Is Better a . 46.85 |==================================================================== b . 46.95 |==================================================================== c . 47.02 |==================================================================== OSPRay 3.2 Benchmark: particle_volume/pathtracer/real_time Items Per Second > Higher Is Better a . 202.36 |=================================================================== b . 199.85 |================================================================== c . 201.16 |=================================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second > Higher Is Better a . 43.39 |==================================================================== b . 43.40 |==================================================================== c . 43.19 |==================================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second > Higher Is Better a . 42.91 |==================================================================== b . 42.87 |==================================================================== c . 42.80 |==================================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second > Higher Is Better a . 50.41 |==================================================================== b . 50.51 |==================================================================== c . 50.35 |==================================================================== 7-Zip Compression 24.05 Test: Compression Rating MIPS > Higher Is Better a . 804522 |=================================================================== b . 789248 |================================================================== c . 791157 |================================================================== 7-Zip Compression 24.05 Test: Decompression Rating MIPS > Higher Is Better a . 1155891 |=============================================================== b . 1180405 |================================================================= c . 1203970 |================================================================== 7-Zip Compression Test: Compression Rating MIPS > Higher Is Better a . 784684 |=================================================================== b . 773934 |================================================================== c . 776559 |================================================================== 7-Zip Compression Test: Decompression Rating MIPS > Higher Is Better a . 1178953 |================================================================= b . 1192798 |================================================================== c . 1181592 |================================================================= Stockfish 17 Chess Benchmark Nodes Per Second > Higher Is Better a . 512969802 |=========================================================== b . 477502351 |======================================================= c . 557325172 |================================================================ Timed FFmpeg Compilation 7.0 Time To Compile Seconds < Lower Is Better a . 19.90 |==================================================================== b . 20.03 |==================================================================== c . 19.76 |=================================================================== Timed Linux Kernel Compilation 6.8 Build: defconfig Seconds < Lower Is Better a . 28.84 |==================================================================== b . 29.00 |==================================================================== c . 28.69 |=================================================================== Timed Linux Kernel Compilation 6.8 Build: allmodconfig Seconds < Lower Is Better a . 206.65 |=================================================================== b . 207.60 |=================================================================== c . 205.87 |================================================================== Timed Node.js Compilation 21.7.2 Time To Compile Seconds < Lower Is Better a . 111.74 |=================================================================== b . 111.63 |=================================================================== c . 111.25 |=================================================================== Timed PHP Compilation 8.3.4 Time To Compile Seconds < Lower Is Better a . 41.19 |==================================================================== b . 41.22 |==================================================================== c . 41.29 |==================================================================== Build2 0.17 Time To Compile Seconds < Lower Is Better a . 73.15 |==================================================================== b . 73.58 |==================================================================== c . 72.49 |=================================================================== C-Ray 2.0 Resolution: 4K - Rays Per Pixel: 16 Seconds < Lower Is Better a . 18.26 |=================================================================== b . 18.50 |==================================================================== c . 18.22 |=================================================================== C-Ray 2.0 Resolution: 5K - Rays Per Pixel: 16 Seconds < Lower Is Better a . 32.10 |==================================================================== b . 32.07 |=================================================================== c . 32.31 |==================================================================== C-Ray 2.0 Resolution: 1080p - Rays Per Pixel: 16 Seconds < Lower Is Better a . 5.041 |================================================================ b . 5.323 |==================================================================== c . 4.865 |============================================================== Primesieve 12.6 Length: 1e12 Seconds < Lower Is Better a . 1.147 |================================================================ b . 1.215 |==================================================================== c . 1.145 |================================================================ Primesieve 12.6 Length: 1e13 Seconds < Lower Is Better a . 12.83 |==================================================================== b . 12.81 |==================================================================== c . 12.81 |==================================================================== Y-Cruncher 0.8.5 Pi Digits To Calculate: 1B Seconds < Lower Is Better a . 9.057 |==================================================================== b . 9.057 |==================================================================== c . 9.052 |==================================================================== Y-Cruncher 0.8.5 Pi Digits To Calculate: 5B Seconds < Lower Is Better a . 32.81 |==================================================================== b . 32.89 |==================================================================== c . 32.83 |==================================================================== Y-Cruncher 0.8.5 Pi Digits To Calculate: 500M Seconds < Lower Is Better a . 4.607 |=================================================================== b . 4.656 |==================================================================== c . 4.656 |==================================================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 638 |====================================================================== b . 640 |====================================================================== c . 641 |====================================================================== OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 642 |====================================================================== b . 641 |====================================================================== c . 645 |====================================================================== OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 749 |===================================================================== b . 751 |====================================================================== c . 755 |====================================================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 10152 |==================================================================== b . 10163 |==================================================================== c . 10201 |==================================================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 20328 |==================================================================== b . 20294 |==================================================================== c . 20349 |==================================================================== OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 10279 |==================================================================== b . 10233 |==================================================================== c . 10227 |==================================================================== OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 20412 |==================================================================== b . 20522 |==================================================================== c . 20511 |==================================================================== OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 11987 |==================================================================== b . 12038 |==================================================================== c . 11909 |=================================================================== OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 23858 |=================================================================== b . 24050 |==================================================================== c . 23921 |==================================================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 162 |====================================================================== b . 163 |====================================================================== c . 163 |====================================================================== OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 164 |====================================================================== b . 163 |====================================================================== c . 164 |====================================================================== OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 190 |====================================================================== b . 190 |====================================================================== c . 191 |====================================================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 2573 |==================================================================== b . 2575 |==================================================================== c . 2599 |===================================================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 5158 |===================================================================== b . 5143 |===================================================================== c . 5174 |===================================================================== OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 2603 |===================================================================== b . 2585 |==================================================================== c . 2620 |===================================================================== OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 5169 |===================================================================== b . 5196 |===================================================================== c . 5202 |===================================================================== OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 3042 |===================================================================== b . 3035 |===================================================================== c . 3054 |===================================================================== OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better a . 6054 |==================================================================== b . 6085 |===================================================================== c . 6104 |===================================================================== Timed Eigen Compilation 3.4.0 Time To Compile Seconds < Lower Is Better a . 40.54 |==================================================================== b . 40.09 |=================================================================== c . 40.06 |=================================================================== Rustls 0.23.17 Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 handshakes/s > Higher Is Better a . 82349.22 |================================================================= b . 82232.23 |================================================================= c . 82326.54 |================================================================= Rustls 0.23.17 Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 handshakes/s > Higher Is Better a . 399853.90 |=============================================================== b . 403088.18 |================================================================ c . 402383.42 |================================================================ Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 handshakes/s > Higher Is Better a . 2839244.84 |============================================================ b . 2963208.68 |=============================================================== c . 2869856.83 |============================================================= Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 handshakes/s > Higher Is Better a . 2073385.56 |=============================================================== b . 2060813.40 |=============================================================== c . 2035952.96 |============================================================== Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 handshakes/s > Higher Is Better a . 1698216.97 |============================================================== b . 1715553.24 |============================================================== c . 1729925.11 |=============================================================== Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 handshakes/s > Higher Is Better a . 1390278.58 |=============================================================== b . 1365832.45 |============================================================== c . 1392293.46 |=============================================================== OpenSSL 3.3 Algorithm: SHA256 byte/s > Higher Is Better a . 242548530680 |============================================================= b . 242399788540 |============================================================= c . 242005934470 |============================================================= OpenSSL 3.3 Algorithm: SHA512 byte/s > Higher Is Better a . 78840468670 |============================================================== b . 78904969300 |============================================================== c . 78929554520 |============================================================== OpenSSL 3.3 Algorithm: RSA4096 sign/s > Higher Is Better a . 74941.9 |================================================================== b . 75010.2 |================================================================== c . 74959.3 |================================================================== OpenSSL 3.3 Algorithm: RSA4096 verify/s > Higher Is Better a . 2833287.3 |=============================================================== b . 2820653.3 |=============================================================== c . 2877947.2 |================================================================ OpenSSL 3.3 Algorithm: ChaCha20 byte/s > Higher Is Better a . 983205666540 |============================================================= b . 983433981080 |============================================================= c . 981347683260 |============================================================= OpenSSL 3.3 Algorithm: AES-128-GCM byte/s > Higher Is Better a . 1787346309360 |============================================================ b . 1788600410900 |============================================================ c . 1788351156160 |============================================================ OpenSSL 3.3 Algorithm: AES-256-GCM byte/s > Higher Is Better a . 1529363548300 |============================================================ b . 1529285362960 |============================================================ c . 1531952540600 |============================================================ OpenSSL 3.3 Algorithm: ChaCha20-Poly1305 byte/s > Higher Is Better a . 686377188830 |============================================================= b . 685952939270 |============================================================= c . 686536891250 |============================================================= Graph500 3.0 Scale: 26 bfs median_TEPS > Higher Is Better a . 1540820000 |============================================================= b . 1524900000 |============================================================= c . 1580110000 |=============================================================== Graph500 3.0 Scale: 26 bfs max_TEPS > Higher Is Better a . 1653580000 |============================================================ b . 1641600000 |============================================================ c . 1727360000 |=============================================================== Graph500 3.0 Scale: 26 sssp median_TEPS > Higher Is Better a . 615929000 |=============================================================== b . 610704000 |=============================================================== c . 623794000 |================================================================ Graph500 3.0 Scale: 26 sssp max_TEPS > Higher Is Better a . 879749000 |================================================================ b . 842062000 |============================================================= c . 880729000 |================================================================ GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better a . 19.99 |==================================================================== b . 19.70 |=================================================================== c . 19.87 |==================================================================== GROMACS Input: water_GMX50_bare Ns Per Day > Higher Is Better a . 12.69 |==================================================================== b . 12.13 |================================================================= c . 12.29 |================================================================== LiteRT 2024-10-15 Model: DeepLab V3 Microseconds < Lower Is Better a . 52254.8 |====================================== b . 52731.5 |====================================== c . 91444.5 |================================================================== LiteRT 2024-10-15 Model: SqueezeNet Microseconds < Lower Is Better a . 31218.0 |===================================================== b . 30070.9 |=================================================== c . 38557.3 |================================================================== LiteRT 2024-10-15 Model: Inception V4 Microseconds < Lower Is Better a . 162456 |========================================================= b . 189474 |=================================================================== c . 187012 |================================================================== LiteRT 2024-10-15 Model: NASNet Mobile Microseconds < Lower Is Better a . 581416 |=============================================================== b . 615123 |=================================================================== c . 543452 |=========================================================== LiteRT 2024-10-15 Model: Mobilenet Float Microseconds < Lower Is Better a . 20933.9 |====================================================== b . 16633.9 |=========================================== c . 25812.1 |================================================================== LiteRT 2024-10-15 Model: Mobilenet Quant Microseconds < Lower Is Better a . 20120.0 |========================================== b . 18899.6 |======================================= c . 31618.4 |================================================================== LiteRT 2024-10-15 Model: Inception ResNet V2 Microseconds < Lower Is Better a . 254071 |=========================================================== b . 258097 |============================================================ c . 288314 |=================================================================== LiteRT 2024-10-15 Model: Quantized COCO SSD MobileNet v1 Microseconds < Lower Is Better a . 29419.1 |========================================================= b . 27302.5 |===================================================== c . 34124.3 |================================================================== NCNN 20241226 Target: CPU - Model: mobilenet ms < Lower Is Better a . 32.32 |====================================================== b . 37.78 |=============================================================== c . 40.60 |==================================================================== NCNN 20241226 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better a . 22.98 |================================================================= b . 23.98 |==================================================================== c . 23.60 |=================================================================== NCNN 20241226 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better a . 27.96 |=========================================================== b . 28.66 |============================================================= c . 32.02 |==================================================================== NCNN 20241226 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better a . 28.54 |========================================================= b . 34.31 |==================================================================== c . 32.46 |================================================================ NCNN 20241226 Target: CPU - Model: mnasnet ms < Lower Is Better a . 21.21 |======================================================= b . 23.79 |============================================================== c . 26.06 |==================================================================== NCNN 20241226 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better a . 34.25 |=========================================================== b . 39.40 |==================================================================== c . 38.28 |================================================================== NCNN 20241226 Target: CPU - Model: blazeface ms < Lower Is Better a . 15.23 |=========================================================== b . 16.49 |=============================================================== c . 17.70 |==================================================================== NCNN 20241226 Target: CPU - Model: googlenet ms < Lower Is Better a . 38.09 |========================================================== b . 43.26 |================================================================= c . 45.04 |==================================================================== NCNN 20241226 Target: CPU - Model: vgg16 ms < Lower Is Better a . 57.29 |======================================================= b . 67.68 |================================================================= c . 71.29 |==================================================================== NCNN 20241226 Target: CPU - Model: resnet18 ms < Lower Is Better a . 23.91 |========================================================== b . 26.78 |================================================================= c . 27.99 |==================================================================== NCNN 20241226 Target: CPU - Model: alexnet ms < Lower Is Better a . 10.05 |========================================================= b . 11.55 |================================================================== c . 11.91 |==================================================================== NCNN 20241226 Target: CPU - Model: resnet50 ms < Lower Is Better a . 40.59 |========================================================== b . 45.84 |================================================================== c . 47.57 |==================================================================== NCNN 20241226 Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 ms < Lower Is Better a . 32.32 |====================================================== b . 37.78 |=============================================================== c . 40.60 |==================================================================== NCNN 20241226 Target: CPU - Model: yolov4-tiny ms < Lower Is Better a . 41.10 |====================================================== b . 48.37 |=============================================================== c . 52.04 |==================================================================== NCNN 20241226 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better a . 48.87 |======================================================== b . 55.33 |================================================================ c . 58.88 |==================================================================== NCNN 20241226 Target: CPU - Model: regnety_400m ms < Lower Is Better a . 130.33 |============================================================ b . 145.07 |=================================================================== c . 146.13 |=================================================================== NCNN 20241226 Target: CPU - Model: vision_transformer ms < Lower Is Better a . 62.70 |====================================================== b . 75.85 |================================================================== c . 78.66 |==================================================================== NCNN 20241226 Target: CPU - Model: FastestDet ms < Lower Is Better a . 33.63 |====================================================== b . 37.50 |============================================================= c . 42.04 |==================================================================== XNNPACK b7b048 Model: FP32MobileNetV1 us < Lower Is Better a . 24800 |======================================= b . 43522 |==================================================================== c . 24895 |======================================= XNNPACK b7b048 Model: FP32MobileNetV2 us < Lower Is Better a . 33117 |================================================== b . 33453 |================================================== c . 45462 |==================================================================== XNNPACK b7b048 Model: FP32MobileNetV3Large us < Lower Is Better a . 61147 |================================================================= b . 63696 |==================================================================== c . 56805 |============================================================= XNNPACK b7b048 Model: FP32MobileNetV3Small us < Lower Is Better a . 59877 |==================================================================== b . 53472 |============================================================= c . 53286 |============================================================= XNNPACK b7b048 Model: FP16MobileNetV1 us < Lower Is Better a . 20169 |==================================================== b . 21882 |======================================================== c . 26390 |==================================================================== XNNPACK b7b048 Model: FP16MobileNetV2 us < Lower Is Better a . 60203 |================================================================== b . 62409 |==================================================================== c . 59616 |================================================================= XNNPACK b7b048 Model: FP16MobileNetV3Large us < Lower Is Better a . 61636 |==================================================================== b . 57237 |=============================================================== c . 54309 |============================================================ XNNPACK b7b048 Model: FP16MobileNetV3Small us < Lower Is Better a . 48621 |==================================================================== b . 38085 |===================================================== c . 47611 |=================================================================== XNNPACK b7b048 Model: QS8MobileNetV2 us < Lower Is Better a . 48535 |====================================================== b . 46034 |==================================================== c . 60593 |==================================================================== Blender 4.3 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better a . 9.00 |==================================================================== b . 9.02 |==================================================================== c . 9.14 |===================================================================== Blender 4.3 Blend File: Junkshop - Compute: CPU-Only Seconds < Lower Is Better a . 12.30 |=================================================================== b . 12.44 |==================================================================== c . 12.41 |==================================================================== Blender 4.3 Blend File: Classroom - Compute: CPU-Only Seconds < Lower Is Better a . 22.54 |==================================================================== b . 22.59 |==================================================================== c . 22.60 |==================================================================== Blender 4.3 Blend File: Fishy Cat - Compute: CPU-Only Seconds < Lower Is Better a . 11.74 |=================================================================== b . 12.00 |==================================================================== c . 11.92 |==================================================================== Blender 4.3 Blend File: Barbershop - Compute: CPU-Only Seconds < Lower Is Better a . 79.23 |=================================================================== b . 79.31 |=================================================================== c . 79.94 |==================================================================== Blender 4.3 Blend File: Pabellon Barcelona - Compute: CPU-Only Seconds < Lower Is Better a . 26.74 |==================================================================== b . 26.65 |==================================================================== c . 26.64 |==================================================================== OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 95.79 |==================================================================== b . 95.78 |==================================================================== c . 95.91 |==================================================================== OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 499.71 |=================================================================== b . 499.92 |=================================================================== c . 499.76 |=================================================================== OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 1004.23 |================================================================== b . 1002.63 |================================================================== c . 996.74 |================================================================== OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 47.76 |=================================================================== b . 47.84 |==================================================================== c . 48.12 |==================================================================== OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 7461.75 |================================================================== b . 7462.48 |================================================================== c . 7455.49 |================================================================== OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 6.42 |===================================================================== b . 6.41 |===================================================================== c . 6.42 |===================================================================== OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 179.06 |=================================================================== b . 179.29 |=================================================================== c . 179.45 |=================================================================== OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 267.41 |=================================================================== b . 267.41 |=================================================================== c . 267.08 |=================================================================== OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better a . 20737.16 |================================================================= b . 20684.11 |================================================================= c . 20660.92 |================================================================= OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better a . 2.3 |====================================================================== b . 2.3 |====================================================================== c . 2.3 |====================================================================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better a . 3190.93 |================================================================== b . 3188.25 |================================================================== c . 3190.21 |================================================================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better a . 15.03 |==================================================================== b . 15.04 |==================================================================== c . 15.03 |==================================================================== OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 10334.31 |================================================================= b . 10339.33 |================================================================= c . 10331.07 |================================================================= OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 4.62 |===================================================================== b . 4.63 |===================================================================== c . 4.63 |===================================================================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 9365.24 |================================================================== b . 9360.81 |================================================================== c . 9344.75 |================================================================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 20.30 |==================================================================== b . 20.29 |==================================================================== c . 20.34 |==================================================================== OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better a . 31408.22 |================================================================= b . 31395.35 |================================================================= c . 31348.09 |================================================================= OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better a . 6.09 |===================================================================== b . 6.09 |===================================================================== c . 6.10 |===================================================================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better a . 3548.57 |================================================================== b . 3541.66 |================================================================== c . 3540.87 |================================================================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better a . 13.51 |==================================================================== b . 13.54 |==================================================================== c . 13.54 |==================================================================== OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 1004.04 |================================================================== b . 1005.17 |================================================================== c . 998.12 |================================================================== OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 47.76 |==================================================================== b . 47.71 |==================================================================== c . 48.05 |==================================================================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 17881.36 |================================================================= b . 17864.80 |================================================================= c . 17734.15 |================================================================ OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 10.61 |=================================================================== b . 10.61 |=================================================================== c . 10.69 |==================================================================== OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 9438.66 |================================================================== b . 9405.62 |================================================================== c . 9401.19 |================================================================== OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 5.07 |===================================================================== b . 5.09 |===================================================================== c . 5.09 |===================================================================== OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better a . 6669.51 |=============================================================== b . 6771.73 |================================================================ c . 6951.71 |================================================================== OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better a . 25.72 |=================================================================== b . 26.04 |==================================================================== c . 25.39 |================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better a . 4858.25 |================================================================== b . 4855.51 |================================================================== c . 4862.29 |================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better a . 39.29 |==================================================================== b . 39.36 |==================================================================== c . 39.26 |==================================================================== OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better a . 11355.93 |================================================================= b . 11377.20 |================================================================= c . 11360.69 |================================================================= OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better a . 4.21 |===================================================================== b . 4.21 |===================================================================== c . 4.21 |===================================================================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 134020.93 |============================================================== b . 137459.28 |================================================================ c . 136174.80 |=============================================================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 0.56 |==================================================================== b . 0.57 |===================================================================== c . 0.57 |===================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better a . 5096.13 |================================================================== b . 5092.60 |================================================================== c . 5085.52 |================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better a . 37.62 |==================================================================== b . 37.50 |==================================================================== c . 37.54 |==================================================================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 164808.53 |================================================================ b . 158277.32 |============================================================= c . 157712.09 |============================================================= OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 0.36 |=================================================================== b . 0.37 |===================================================================== c . 0.36 |=================================================================== Apache Cassandra 5.0 Test: Writes Op/s > Higher Is Better a . 296920 |=================================================================== b . 283197 |================================================================ c . 267019 |============================================================ Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a . 26.13 |========================================================== b . 30.39 |==================================================================== c . 30.19 |==================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a . 75.67 |================================================================= b . 72.24 |============================================================== c . 78.73 |==================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a . 74.92 |================================================================ b . 79.85 |==================================================================== c . 73.96 |=============================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a . 75.93 |==================================================================== b . 71.43 |================================================================ c . 75.24 |=================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a . 30.83 |==================================================================== b . 31.05 |==================================================================== c . 30.94 |==================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a . 69.99 |================================================================== b . 65.87 |============================================================== c . 72.06 |==================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a . 75.97 |================================================================== b . 78.14 |==================================================================== c . 76.26 |================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a . 76.40 |=================================================================== b . 75.34 |================================================================== c . 77.09 |==================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a . 54.03 |================================================================= b . 54.25 |================================================================= c . 56.60 |==================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a . 158.95 |================================================================ b . 158.65 |=============================================================== c . 167.59 |=================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a . 158.71 |================================================================= b . 159.58 |================================================================= c . 163.84 |=================================================================== Llama.cpp b4397 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a . 160.28 |=================================================================== b . 154.18 |================================================================ c . 155.34 |================================================================= OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU tokens/s > Higher Is Better a . 33.63 |==================================================================== b . 31.80 |================================================================ c . 32.01 |================================================================= OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better a . 46.08 |================================================================= b . 48.41 |==================================================================== c . 47.62 |=================================================================== OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better a . 29.74 |================================================================ b . 31.44 |==================================================================== c . 31.24 |==================================================================== OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU tokens/s > Higher Is Better a . 68.29 |=================================================================== b . 68.45 |=================================================================== c . 69.40 |==================================================================== OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token ms < Lower Is Better a . 17.76 |==================================================================== b . 17.54 |=================================================================== c . 17.56 |=================================================================== OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token ms < Lower Is Better a . 14.64 |==================================================================== b . 14.61 |==================================================================== c . 14.41 |=================================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better a . 50.58 |==================================================================== b . 48.00 |================================================================= c . 49.80 |=================================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better a . 34.43 |=================================================================== b . 35.01 |==================================================================== c . 35.17 |==================================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better a . 19.77 |================================================================= b . 20.84 |==================================================================== c . 20.08 |================================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better a . 57.19 |==================================================================== b . 55.87 |================================================================== c . 56.84 |==================================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better a . 27.52 |=================================================================== b . 27.83 |==================================================================== c . 27.62 |=================================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better a . 17.49 |================================================================== b . 17.90 |==================================================================== c . 17.59 |===================================================================