rpyc jan AMD EPYC 7F32 8-Core testing with a ASRockRack EPYCD8 (P2.40 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite. a: Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 7 x 4 GB DDR4-2666MT/s Micron 9ASF51272PZ-2G6B1, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350 OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768 b: Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 7 x 4 GB DDR4-2666MT/s Micron 9ASF51272PZ-2G6B1, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350 OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768 LeelaChessZero 0.30 Backend: BLAS Nodes Per Second > Higher Is Better a . 130 |==================================================================== b . 133 |====================================================================== LeelaChessZero 0.30 Backend: Eigen Nodes Per Second > Higher Is Better a . 83 |===================================================================== b . 85 |======================================================================= Quicksilver 20230818 Input: CTS2 Figure Of Merit > Higher Is Better a . 5986000 |================================================================== b . 5982000 |================================================================== Quicksilver 20230818 Input: CORAL2 P1 Figure Of Merit > Higher Is Better a . 7364000 |================================================================== b . 7308000 |================================================================= Quicksilver 20230818 Input: CORAL2 P2 Figure Of Merit > Higher Is Better a . 7679000 |================================================================== b . 7662000 |================================================================== CacheBench Test: Read MB/s > Higher Is Better a . 9891.09 |================================================================== b . 9892.74 |================================================================== CacheBench Test: Write MB/s > Higher Is Better a . 55386.26 |================================================================= b . 55484.05 |================================================================= CacheBench Test: Read / Modify / Write MB/s > Higher Is Better a . 57602.72 |================================================================= b . 57618.90 |================================================================= SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 2.949 |==================================================================== b . 2.931 |==================================================================== SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 23.54 |==================================================================== b . 23.35 |=================================================================== SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 78.31 |=================================================================== b . 79.93 |==================================================================== SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 78.88 |================================================================== b . 81.31 |==================================================================== SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 9.956 |==================================================================== b . 9.768 |=================================================================== SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 63.99 |==================================================================== b . 63.70 |==================================================================== SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 255.93 |================================================================ b . 268.08 |=================================================================== SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 316.49 |================================================================ b . 331.50 |=================================================================== Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Seconds < Lower Is Better a . 47.65 |==================================================================== b . 47.20 |=================================================================== Y-Cruncher 0.8.3 Pi Digits To Calculate: 500M Seconds < Lower Is Better a . 22.30 |==================================================================== b . 22.05 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q01 Seconds < Lower Is Better a . 4.10 |===================================================================== b . 4.03 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q02 Seconds < Lower Is Better a . 4.52 |==================================================================== b . 4.60 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q03 Seconds < Lower Is Better a . 3.17 |===================================================================== b . 3.17 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q04 Seconds < Lower Is Better a . 7.47 |================================================================= b . 7.87 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q05 Seconds < Lower Is Better a . 5.70 |=================================================================== b . 5.84 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q06 Seconds < Lower Is Better a . 4.16 |================================================================== b . 4.34 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q07 Seconds < Lower Is Better a . 4.52 |=================================================================== b . 4.63 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q08 Seconds < Lower Is Better a . 4.39 |===================================================================== b . 4.16 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q09 Seconds < Lower Is Better a . 4.29 |===================================================================== b . 4.02 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q10 Seconds < Lower Is Better a . 4.96 |===================================================================== b . 4.99 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q11 Seconds < Lower Is Better a . 6.58 |===================================================================== b . 6.46 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q12 Seconds < Lower Is Better a . 2.16 |===================================================================== b . 2.17 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q13 Seconds < Lower Is Better a . 4.66 |================================================================== b . 4.85 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q14 Seconds < Lower Is Better a . 4.40 |===================================================================== b . 4.38 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q15 Seconds < Lower Is Better a . 4.28 |==================================================================== b . 4.35 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q16 Seconds < Lower Is Better a . 2.59 |=========================================================== b . 3.05 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q17 Seconds < Lower Is Better a . 6.36 |===================================================================== b . 6.18 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q18 Seconds < Lower Is Better a . 5.66 |=============================================================== b . 6.17 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q19 Seconds < Lower Is Better a . 4.19 |===================================================================== b . 4.21 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q20 Seconds < Lower Is Better a . 2.20 |===================================================================== b . 2.15 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q21 Seconds < Lower Is Better a . 3.75 |================================================================== b . 3.91 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q22 Seconds < Lower Is Better a . 4.27 |===================================================================== b . 4.23 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q23 Seconds < Lower Is Better a . 4.11 |===================================================================== b . 4.14 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q24 Seconds < Lower Is Better a . 0.94 |============================================================== b . 1.04 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q25 Seconds < Lower Is Better a . 6.09 |===================================================================== b . 5.82 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q26 Seconds < Lower Is Better a . 4.18 |================================================================== b . 4.36 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q27 Seconds < Lower Is Better a . 4.42 |==================================================================== b . 4.51 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q28 Seconds < Lower Is Better a . 6.76 |===================================================================== b . 6.32 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q29 Seconds < Lower Is Better a . 6.10 |===================================================================== b . 5.98 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q30 Seconds < Lower Is Better a . 3.81 |===================================================================== b . 3.81 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q31 Seconds < Lower Is Better a . 6.63 |================================================================== b . 6.97 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q32 Seconds < Lower Is Better a . 3.82 |==================================================================== b . 3.85 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q33 Seconds < Lower Is Better a . 4.74 |============================================================ b . 5.48 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q34 Seconds < Lower Is Better a . 4.29 |===================================================================== b . 4.21 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q35 Seconds < Lower Is Better a . 5.13 |===================================================================== b . 5.03 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q36 Seconds < Lower Is Better a . 4.13 |=================================================================== b . 4.25 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q37 Seconds < Lower Is Better a . 2.50 |==================================================================== b . 2.53 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q38 Seconds < Lower Is Better a . 4.94 |===================================================================== b . 4.84 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q39 Seconds < Lower Is Better a . 1.19 |========================================================= b . 1.43 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q40 Seconds < Lower Is Better a . 3.98 |============================================================== b . 4.45 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q41 Seconds < Lower Is Better a . 2.71 |==================================================================== b . 2.74 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q42 Seconds < Lower Is Better a . 3.01 |================================================================ b . 3.24 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q43 Seconds < Lower Is Better a . 3.34 |==================================================================== b . 3.39 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q44 Seconds < Lower Is Better a . 4.20 |===================================================================== b . 4.07 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q45 Seconds < Lower Is Better a . 3.83 |=============================================================== b . 4.19 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q46 Seconds < Lower Is Better a . 4.12 |==================================================================== b . 4.21 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q47 Seconds < Lower Is Better a . 6.26 |===================================================================== b . 6.14 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q48 Seconds < Lower Is Better a . 4.29 |=================================================================== b . 4.41 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q49 Seconds < Lower Is Better a . 5.36 |==================================================================== b . 5.45 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q50 Seconds < Lower Is Better a . 4.25 |=================================================================== b . 4.37 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q51 Seconds < Lower Is Better a . 6.63 |================================================================== b . 6.95 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q52 Seconds < Lower Is Better a . 3.28 |================================================================== b . 3.44 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q53 Seconds < Lower Is Better a . 3.50 |================================================================ b . 3.78 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q54 Seconds < Lower Is Better a . 5.15 |=================================================================== b . 5.29 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q55 Seconds < Lower Is Better a . 2.91 |================================================================ b . 3.12 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q56 Seconds < Lower Is Better a . 5.09 |===================================================================== b . 4.66 |=============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q57 Seconds < Lower Is Better a . 5.04 |===================================================================== b . 5.07 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q58 Seconds < Lower Is Better a . 4.89 |=================================================================== b . 5.03 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q59 Seconds < Lower Is Better a . 4.41 |================================================================== b . 4.58 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q60 Seconds < Lower Is Better a . 5.28 |===================================================================== b . 4.97 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q61 Seconds < Lower Is Better a . 2.77 |==================================================================== b . 2.82 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q62 Seconds < Lower Is Better a . 3.85 |===================================================================== b . 3.86 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q63 Seconds < Lower Is Better a . 3.71 |===================================================================== b . 3.49 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q64 Seconds < Lower Is Better a . 7.63 |=================================================================== b . 7.83 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q65 Seconds < Lower Is Better a . 4.62 |============================================================== b . 5.15 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q66 Seconds < Lower Is Better a . 5.89 |===================================================================== b . 5.72 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q67 Seconds < Lower Is Better a . 5.79 |===================================================================== b . 5.73 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q68 Seconds < Lower Is Better a . 4.40 |=================================================================== b . 4.52 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q69 Seconds < Lower Is Better a . 4.78 |================================================================== b . 5.00 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q70 Seconds < Lower Is Better a . 4.60 |===================================================================== b . 4.56 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q71 Seconds < Lower Is Better a . 4.19 |===================================================================== b . 4.18 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q72 Seconds < Lower Is Better a . 8.48 |===================================================================== b . 8.35 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q73 Seconds < Lower Is Better a . 4.31 |===================================================================== b . 3.85 |============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q74 Seconds < Lower Is Better a . 5.8 |==================================================================== b . 6.0 |====================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q75 Seconds < Lower Is Better a . 7.88 |===================================================================== b . 7.12 |============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q76 Seconds < Lower Is Better a . 4.57 |===================================================================== b . 4.38 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q77 Seconds < Lower Is Better a . 5.13 |===================================================================== b . 5.10 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q78 Seconds < Lower Is Better a . 7.69 |===================================================================== b . 7.24 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q79 Seconds < Lower Is Better a . 3.95 |============================================================= b . 4.44 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q80 Seconds < Lower Is Better a . 7.42 |===================================================================== b . 7.04 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q81 Seconds < Lower Is Better a . 3.72 |==================================================================== b . 3.78 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q82 Seconds < Lower Is Better a . 5.05 |===================================================================== b . 4.57 |============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q83 Seconds < Lower Is Better a . 3.94 |==================================================================== b . 4.01 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q84 Seconds < Lower Is Better a . 3.32 |===================================================================== b . 3.33 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q85 Seconds < Lower Is Better a . 5.73 |===================================================================== b . 5.57 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q86 Seconds < Lower Is Better a . 3.70 |=================================================================== b . 3.81 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q87 Seconds < Lower Is Better a . 4.99 |================================================================== b . 5.21 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q88 Seconds < Lower Is Better a . 6.61 |=============================================================== b . 7.21 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q89 Seconds < Lower Is Better a . 4.05 |===================================================================== b . 3.98 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q90 Seconds < Lower Is Better a . 3.87 |===================================================================== b . 3.78 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q91 Seconds < Lower Is Better a . 3.52 |==================================================================== b . 3.57 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q92 Seconds < Lower Is Better a . 3.90 |===================================================================== b . 3.92 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q93 Seconds < Lower Is Better a . 3.75 |===================================================================== b . 3.73 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q94 Seconds < Lower Is Better a . 2.78 |=================================================================== b . 2.88 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q95 Seconds < Lower Is Better a . 3.60 |==================================================================== b . 3.67 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q96 Seconds < Lower Is Better a . 2.81 |=================================================================== b . 2.89 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q97 Seconds < Lower Is Better a . 5.18 |=================================================================== b . 5.30 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q98 Seconds < Lower Is Better a . 2.20 |===================================================================== b . 2.09 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 1 - Q99 Seconds < Lower Is Better a . 3.66 |================================================================= b . 3.88 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q01 Seconds < Lower Is Better a . 5.60 |===================================================================== b . 5.36 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q02 Seconds < Lower Is Better a . 5.03 |=============================================================== b . 5.48 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q03 Seconds < Lower Is Better a . 3.93 |=============================================================== b . 4.32 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q04 Seconds < Lower Is Better a . 19.18 |==================================================================== b . 19.24 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q05 Seconds < Lower Is Better a . 9.47 |===================================================================== b . 9.43 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q06 Seconds < Lower Is Better a . 7.98 |================================================================= b . 8.52 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q07 Seconds < Lower Is Better a . 5.59 |=================================================================== b . 5.79 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q08 Seconds < Lower Is Better a . 5.60 |===================================================================== b . 5.62 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q09 Seconds < Lower Is Better a . 4.97 |================================================================= b . 5.29 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q10 Seconds < Lower Is Better a . 7.22 |===================================================================== b . 6.95 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q11 Seconds < Lower Is Better a . 14.91 |==================================================================== b . 14.34 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q12 Seconds < Lower Is Better a . 2.36 |===================================================================== b . 2.36 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q13 Seconds < Lower Is Better a . 5.85 |===================================================================== b . 5.50 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q14 Seconds < Lower Is Better a . 8.92 |===================================================================== b . 8.34 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q15 Seconds < Lower Is Better a . 5.20 |================================================================= b . 5.49 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q17 Seconds < Lower Is Better a . 14.20 |==================================================================== b . 14.18 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q18 Seconds < Lower Is Better a . 6.46 |=================================================================== b . 6.64 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q19 Seconds < Lower Is Better a . 5.85 |===================================================================== b . 5.73 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q20 Seconds < Lower Is Better a . 2.26 |===================================================================== b . 2.26 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q21 Seconds < Lower Is Better a . 5.25 |================================================================== b . 5.49 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q22 Seconds < Lower Is Better a . 11.93 |=================================================================== b . 12.19 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q23 Seconds < Lower Is Better a . 15.49 |==================================================================== b . 15.13 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q24 Seconds < Lower Is Better a . 6.34 |===================================================================== b . 6.26 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q25 Seconds < Lower Is Better a . 14.15 |=================================================================== b . 14.41 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q26 Seconds < Lower Is Better a . 5.63 |===================================================================== b . 5.06 |============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q27 Seconds < Lower Is Better a . 5.85 |============================================================== b . 6.49 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q28 Seconds < Lower Is Better a . 8.38 |===================================================================== b . 8.03 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q29 Seconds < Lower Is Better a . 14.25 |=================================================================== b . 14.43 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q30 Seconds < Lower Is Better a . 5.80 |===================================================================== b . 5.81 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q31 Seconds < Lower Is Better a . 10.19 |==================================================================== b . 9.24 |============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q32 Seconds < Lower Is Better a . 4.28 |================================================================= b . 4.55 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q33 Seconds < Lower Is Better a . 7.13 |===================================================================== b . 5.91 |========================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q34 Seconds < Lower Is Better a . 6.49 |===================================================================== b . 6.11 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q35 Seconds < Lower Is Better a . 7.68 |===================================================================== b . 7.50 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q36 Seconds < Lower Is Better a . 4.93 |=============================================================== b . 5.40 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q37 Seconds < Lower Is Better a . 5.80 |=================================================================== b . 6.01 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q38 Seconds < Lower Is Better a . 8.95 |===================================================================== b . 7.94 |============================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q39 Seconds < Lower Is Better a . 3.18 |=================================================================== b . 3.26 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q40 Seconds < Lower Is Better a . 8.34 |===================================================================== b . 7.90 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q41 Seconds < Lower Is Better a . 3.23 |===================================================================== b . 3.13 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q42 Seconds < Lower Is Better a . 3.85 |================================================================ b . 4.16 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q43 Seconds < Lower Is Better a . 4.26 |===================================================================== b . 4.28 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q44 Seconds < Lower Is Better a . 2.78 |===================================================================== b . 2.65 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q45 Seconds < Lower Is Better a . 5.60 |===================================================================== b . 5.47 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q46 Seconds < Lower Is Better a . 5.34 |=========================================================== b . 6.29 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q47 Seconds < Lower Is Better a . 8.67 |===================================================================== b . 8.40 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q48 Seconds < Lower Is Better a . 4.91 |===================================================================== b . 4.18 |=========================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q49 Seconds < Lower Is Better a . 8.40 |===================================================================== b . 8.15 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q50 Seconds < Lower Is Better a . 9.77 |===================================================================== b . 9.78 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q51 Seconds < Lower Is Better a . 11.32 |==================================================================== b . 10.93 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q52 Seconds < Lower Is Better a . 4.22 |=================================================================== b . 4.32 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q53 Seconds < Lower Is Better a . 4.21 |================================================================== b . 4.37 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q54 Seconds < Lower Is Better a . 7.25 |=================================================================== b . 7.46 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q55 Seconds < Lower Is Better a . 3.78 |================================================================ b . 4.07 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q56 Seconds < Lower Is Better a . 5.99 |================================================================== b . 6.23 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q57 Seconds < Lower Is Better a . 7.71 |===================================================================== b . 7.27 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q58 Seconds < Lower Is Better a . 6.22 |===================================================================== b . 6.25 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q59 Seconds < Lower Is Better a . 5.86 |===================================================================== b . 5.74 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q60 Seconds < Lower Is Better a . 7.47 |===================================================================== b . 7.00 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q61 Seconds < Lower Is Better a . 2.96 |==================================================================== b . 3.01 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q62 Seconds < Lower Is Better a . 4.2 |====================================================================== b . 4.1 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q63 Seconds < Lower Is Better a . 4.85 |================================================================= b . 5.18 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q64 Seconds < Lower Is Better a . 21.11 |==================================================================== b . 20.79 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q65 Seconds < Lower Is Better a . 8.00 |===================================================================== b . 7.13 |============================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q66 Seconds < Lower Is Better a . 5.99 |================================================================== b . 6.22 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q67 Seconds < Lower Is Better a . 12.52 |================================================================= b . 13.02 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q68 Seconds < Lower Is Better a . 5.89 |================================================================= b . 6.27 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q69 Seconds < Lower Is Better a . 6.63 |================================================================== b . 6.91 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q70 Seconds < Lower Is Better a . 5.29 |===================================================================== b . 5.21 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q71 Seconds < Lower Is Better a . 5.73 |===================================================================== b . 5.57 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q72 Seconds < Lower Is Better a . 39.02 |==================================================================== b . 39.13 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q73 Seconds < Lower Is Better a . 5.49 |=============================================================== b . 6.02 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q74 Seconds < Lower Is Better a . 9.42 |===================================================================== b . 9.48 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q75 Seconds < Lower Is Better a . 13.69 |================================================================== b . 14.00 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q76 Seconds < Lower Is Better a . 6.10 |===================================================================== b . 5.59 |=============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q77 Seconds < Lower Is Better a . 7.08 |================================================================= b . 7.56 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q78 Seconds < Lower Is Better a . 19.55 |==================================================================== b . 19.54 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q79 Seconds < Lower Is Better a . 5.38 |===================================================================== b . 5.01 |================================================================ Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q80 Seconds < Lower Is Better a . 17.99 |==================================================================== b . 17.99 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q81 Seconds < Lower Is Better a . 5.63 |===================================================================== b . 5.65 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q82 Seconds < Lower Is Better a . 6.45 |=================================================================== b . 6.66 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q83 Seconds < Lower Is Better a . 5.39 |===================================================================== b . 5.27 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q84 Seconds < Lower Is Better a . 5.16 |===================================================================== b . 5.09 |==================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q85 Seconds < Lower Is Better a . 8.18 |===================================================================== b . 7.80 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q86 Seconds < Lower Is Better a . 4.00 |===================================================================== b . 3.87 |=================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q87 Seconds < Lower Is Better a . 8.37 |===================================================================== b . 8.02 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q88 Seconds < Lower Is Better a . 8.63 |===================================================================== b . 8.16 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q89 Seconds < Lower Is Better a . 4.99 |===================================================================== b . 4.78 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q90 Seconds < Lower Is Better a . 4.03 |===================================================================== b . 3.20 |======================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q91 Seconds < Lower Is Better a . 4.94 |===================================================================== b . 4.93 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q92 Seconds < Lower Is Better a . 4.16 |=============================================================== b . 4.53 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q93 Seconds < Lower Is Better a . 11.76 |==================================================================== b . 11.31 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q94 Seconds < Lower Is Better a . 4.49 |===================================================================== b . 4.48 |===================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q95 Seconds < Lower Is Better a . 4.68 |===================================================================== b . 4.51 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q96 Seconds < Lower Is Better a . 3.23 |===================================================================== b . 3.04 |================================================================= Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q97 Seconds < Lower Is Better a . 8.04 |===================================================================== b . 7.22 |============================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q98 Seconds < Lower Is Better a . 2.34 |===================================================================== b . 2.24 |================================================================== Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q99 Seconds < Lower Is Better a . 4.43 |===================================================================== b . 3.99 |============================================================== PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 batches/sec > Higher Is Better a . 26.58 |================================================================= b . 27.92 |==================================================================== PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 batches/sec > Higher Is Better a . 10.83 |================================================================ b . 11.50 |==================================================================== PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 batches/sec > Higher Is Better a . 20.05 |==================================================================== b . 19.48 |================================================================== PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 batches/sec > Higher Is Better a . 7.44 |=============================================================== b . 8.21 |===================================================================== PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l batches/sec > Higher Is Better a . 5.91 |=================================================================== b . 6.11 |===================================================================== PyTorch 2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l batches/sec > Higher Is Better a . 4.19 |================================================================= b . 4.48 |===================================================================== TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: VGG-16 images/sec > Higher Is Better a . 2.59 |===================================================================== b . 2.13 |========================================================= TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: AlexNet images/sec > Higher Is Better a . 8.88 |===================================================================== b . 7.23 |======================================================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: VGG-16 images/sec > Higher Is Better a . 4.69 |===================================================================== b . 4.23 |============================================================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec > Higher Is Better a . 59.35 |==================================================================== b . 51.44 |=========================================================== TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: GoogLeNet images/sec > Higher Is Better a . 9.89 |===================================================================== b . 9.44 |================================================================== TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: ResNet-50 images/sec > Higher Is Better a . 6.38 |==================================================================== b . 6.47 |===================================================================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec > Higher Is Better a . 35.56 |==================================================================== b . 33.16 |=============================================================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec > Higher Is Better a . 11.52 |==================================================================== b . 10.04 |=========================================================== Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 7.7676 |=================================================================== b . 7.7424 |=================================================================== Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 512.19 |=================================================================== b . 515.22 |=================================================================== Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 124.67 |================================================================== b . 127.17 |=================================================================== Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 32.06 |==================================================================== b . 31.43 |=================================================================== Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 75.76 |==================================================================== b . 74.49 |=================================================================== Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 52.73 |=================================================================== b . 53.67 |==================================================================== Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 399.72 |=================================================================== b . 396.22 |================================================================== Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 9.9773 |================================================================= b . 10.0658 |================================================================== Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 39.64 |==================================================================== b . 39.44 |==================================================================== Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 100.78 |=================================================================== b . 101.34 |=================================================================== Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 9.1492 |================================================================== b . 9.2258 |=================================================================== Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 434.38 |=================================================================== b . 433.02 |=================================================================== Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 76.46 |==================================================================== b . 76.77 |==================================================================== Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 52.25 |==================================================================== b . 52.08 |==================================================================== Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 40.15 |==================================================================== b . 40.07 |==================================================================== Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 99.53 |==================================================================== b . 99.73 |==================================================================== Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 59.07 |==================================================================== b . 58.90 |==================================================================== Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 67.63 |==================================================================== b . 67.84 |==================================================================== Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 8.3040 |=================================================================== b . 8.3172 |=================================================================== Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 480.23 |=================================================================== b . 478.92 |=================================================================== Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 56.13 |=================================================================== b . 56.67 |==================================================================== Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 71.21 |==================================================================== b . 70.51 |=================================================================== Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 7.8660 |=================================================================== b . 7.8507 |=================================================================== Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 505.16 |================================================================== b . 509.34 |=================================================================== Speedb 2.7 Test: Random Fill Op/s > Higher Is Better a . 233324 |================================================================= b . 239360 |=================================================================== Speedb 2.7 Test: Random Read Op/s > Higher Is Better a . 34248146 |================================================================= b . 34244004 |================================================================= Speedb 2.7 Test: Update Random Op/s > Higher Is Better a . 215940 |=================================================================== b . 216433 |=================================================================== Speedb 2.7 Test: Sequential Fill Op/s > Higher Is Better a . 275849 |=================================================================== b . 267223 |================================================================= Speedb 2.7 Test: Random Fill Sync Op/s > Higher Is Better a . 3082 |===================================================================== b . 3026 |==================================================================== Speedb 2.7 Test: Read While Writing Op/s > Higher Is Better a . 2257890 |================================================================== b . 2104380 |============================================================== Speedb 2.7 Test: Read Random Write Random Op/s > Higher Is Better a . 1011750 |================================================================== b . 978572 |================================================================ Llama.cpp b1808 Model: llama-2-7b.Q4_0.gguf Tokens Per Second > Higher Is Better a . 11.32 |============================================================= b . 12.67 |==================================================================== Llama.cpp b1808 Model: llama-2-13b.Q4_0.gguf Tokens Per Second > Higher Is Better a . 5.16 |======================================================== b . 6.34 |=====================================================================