spark tr AMD Ryzen Threadripper 2970WX 24-Core testing with a Gigabyte X399 AORUS Gaming 7 (F13a BIOS) and Sapphire AMD Radeon RX 560 4GB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: AMD Ryzen Threadripper 2970WX 24-Core @ 3.00GHz (24 Cores / 48 Threads), Motherboard: Gigabyte X399 AORUS Gaming 7 (F13a BIOS), Chipset: AMD 17h, Memory: 32GB, Disk: Samsung SSD 970 EVO 250GB + 120GB Corsair Force MP500, Graphics: Sapphire AMD Radeon RX 560 4GB (1300/1750MHz), Audio: Realtek ALC1220, Monitor: DELL S2409W, Network: Qualcomm Atheros Killer E2500 + 2 x QLogic cLOM8214 1/10GbE + Intel 8265 / 8275 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 B: Processor: AMD Ryzen Threadripper 2970WX 24-Core @ 3.00GHz (24 Cores / 48 Threads), Motherboard: Gigabyte X399 AORUS Gaming 7 (F13a BIOS), Chipset: AMD 17h, Memory: 32GB, Disk: Samsung SSD 970 EVO 250GB + 120GB Corsair Force MP500, Graphics: Sapphire AMD Radeon RX 560 4GB (1300/1750MHz), Audio: Realtek ALC1220, Monitor: DELL S2409W, Network: Qualcomm Atheros Killer E2500 + 2 x QLogic cLOM8214 1/10GbE + Intel 8265 / 8275 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 C: Processor: AMD Ryzen Threadripper 2970WX 24-Core @ 3.00GHz (24 Cores / 48 Threads), Motherboard: Gigabyte X399 AORUS Gaming 7 (F13a BIOS), Chipset: AMD 17h, Memory: 32GB, Disk: Samsung SSD 970 EVO 250GB + 120GB Corsair Force MP500, Graphics: Sapphire AMD Radeon RX 560 4GB (1300/1750MHz), Audio: Realtek ALC1220, Monitor: DELL S2409W, Network: Qualcomm Atheros Killer E2500 + 2 x QLogic cLOM8214 1/10GbE + Intel 8265 / 8275 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 Unvanquished 0.53 Resolution: 1920 x 1080 - Effects Quality: High Frames Per Second > Higher Is Better A . 205.7 |============================================================= B . 229.7 |==================================================================== C . 207.0 |============================================================= Unvanquished 0.53 Resolution: 1920 x 1080 - Effects Quality: Ultra Frames Per Second > Higher Is Better A . 205.2 |================================================================= B . 214.2 |==================================================================== C . 202.2 |================================================================ Unvanquished 0.53 Resolution: 1920 x 1080 - Effects Quality: Medium Frames Per Second > Higher Is Better A . 208.9 |============================================================= B . 231.5 |==================================================================== C . 210.6 |============================================================== SVT-AV1 1.2 Encoder Mode: Preset 4 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 1.396 |=================================================================== B . 1.421 |==================================================================== C . 1.403 |=================================================================== SVT-AV1 1.2 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 33.37 |==================================================================== B . 30.07 |============================================================= C . 28.74 |=========================================================== SVT-AV1 1.2 Encoder Mode: Preset 10 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 50.50 |=================================================================== B . 46.28 |============================================================== C . 51.17 |==================================================================== SVT-AV1 1.2 Encoder Mode: Preset 12 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 70.46 |==================================================================== B . 60.97 |=========================================================== C . 64.98 |=============================================================== SVT-AV1 1.2 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 3.499 |==================================================================== B . 3.509 |==================================================================== C . 3.461 |=================================================================== SVT-AV1 1.2 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 68.27 |==================================================================== B . 68.57 |==================================================================== C . 68.34 |==================================================================== SVT-AV1 1.2 Encoder Mode: Preset 10 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 138.08 |=================================================================== B . 136.40 |================================================================== C . 133.51 |================================================================= SVT-AV1 1.2 Encoder Mode: Preset 12 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 201.46 |================================================================== B . 203.29 |=================================================================== C . 199.10 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 5.015148790 |========================================================== B . 5.337667242 |============================================================== C . 5.290000000 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 79.65 |==================================================================== B . 79.04 |=================================================================== C . 78.24 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.729159322 |============================================================== B . 5.530000000 |============================================================ C . 5.420000000 |=========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 6.91 |=================================================================== B . 6.74 |================================================================== C . 7.07 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 3.07 |================================================================= B . 3.12 |================================================================== C . 3.27 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 3.01 |===================================================================== B . 2.71 |============================================================== C . 2.94 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 2.07 |===================================================================== B . 1.85 |============================================================== C . 1.99 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 4.92 |=============================================================== B . 4.80 |============================================================= C . 5.39 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 80.75 |==================================================================== B . 79.88 |=================================================================== C . 79.32 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.604129867 |============================================================ B . 5.750000000 |============================================================== C . 5.580000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 6.29 |=================================================================== B . 6.52 |===================================================================== C . 6.18 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 3.61 |===================================================================== B . 3.24 |============================================================== C . 3.56 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 2.69 |================================================================ B . 2.89 |===================================================================== C . 2.68 |================================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 2.12 |======================================================= B . 2.64 |===================================================================== C . 1.85 |================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 5.12 |================================================================ B . 5.50 |===================================================================== C . 5.33 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.73 |==================================================================== B . 81.01 |=================================================================== C . 79.95 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.70 |===================================================================== B . 5.69 |===================================================================== C . 5.62 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 6.23 |==================================================================== B . 6.36 |===================================================================== C . 6.34 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 3.553966492 |============================================================== B . 3.220000000 |======================================================== C . 3.440000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 3.01708252 |=============================================================== B . 2.98000000 |============================================================== C . 2.99000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 2.24 |=============================================================== B . 2.27 |================================================================ C . 2.44 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 5.75 |===================================================================== B . 5.59 |=================================================================== C . 5.62 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.57 |==================================================================== B . 81.25 |==================================================================== C . 80.22 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.775270033 |============================================================== B . 5.640000000 |============================================================= C . 5.550000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 6.962357463 |============================================================ B . 7.190000000 |============================================================== C . 6.920000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 4.015340703 |============================================================== B . 3.630000000 |======================================================== C . 3.810000000 |=========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 3.74 |==================================================================== B . 3.61 |================================================================= C . 3.81 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 2.670000000 |============================================== B . 3.610717263 |============================================================== C . 3.390000000 |========================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.56 |================================================================== B . 15.01 |==================================================================== C . 15.10 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 82.28 |==================================================================== B . 81.42 |=================================================================== C . 81.07 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.64 |===================================================================== B . 5.65 |===================================================================== C . 5.64 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 10.60 |================================================================= B . 10.32 |=============================================================== C . 11.08 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 10.24 |==================================================================== B . 10.29 |==================================================================== C . 10.30 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 10.79 |=============================================================== B . 11.59 |==================================================================== C . 10.68 |=============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 10.58 |=============================================================== B . 10.84 |================================================================ C . 11.48 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.63 |==================================================================== B . 14.59 |==================================================================== C . 14.22 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.82 |==================================================================== B . 81.40 |==================================================================== C . 81.40 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.70 |==================================================================== B . 5.61 |=================================================================== C . 5.75 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 10.307070771 |============================================================= B . 10.310000000 |============================================================= C . 9.860000000 |========================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 9.75 |===================================================================== B . 9.70 |==================================================================== C . 9.81 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 10.74 |==================================================================== B . 10.35 |================================================================== C . 10.18 |================================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 9.542906703 |============================================================== B . 8.930000000 |========================================================== C . 9.180000000 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 27.49 |==================================================================== B . 25.78 |================================================================ C . 27.05 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.85 |==================================================================== B . 81.49 |==================================================================== C . 81.53 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.77 |===================================================================== B . 5.65 |==================================================================== C . 5.72 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 14.23 |================================================================= B . 14.56 |================================================================== C . 14.96 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 18.29 |==================================================================== B . 17.31 |================================================================ C . 17.65 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 20.33 |================================================================ B . 19.23 |============================================================= C . 21.58 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 19.19 |==================================================================== B . 18.95 |=================================================================== C . 18.68 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 28.85 |==================================================================== B . 27.61 |================================================================= C . 26.46 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 82.00 |==================================================================== B . 82.12 |==================================================================== C . 81.77 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.68 |=================================================================== B . 5.80 |==================================================================== C . 5.88 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 14.41 |============================================================== B . 15.27 |================================================================== C . 15.84 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 18.23 |=============================================================== B . 19.74 |==================================================================== C . 17.81 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 21.21 |==================================================================== B . 20.16 |================================================================= C . 19.62 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 20.05 |================================================================= B . 20.83 |==================================================================== C . 19.67 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 49.62 |==================================================================== B . 47.05 |================================================================ C . 49.43 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.83 |==================================================================== B . 81.89 |==================================================================== C . 81.93 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.780000000 |============================================================== B . 5.559199886 |============================================================ C . 5.600000000 |============================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 35.00 |================================================================== B . 36.29 |==================================================================== C . 35.13 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 40.49 |==================================================================== B . 34.03 |========================================================= C . 33.67 |========================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 45.90 |==================================================================== B . 38.67 |========================================================= C . 37.70 |======================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 44.44 |==================================================================== B . 38.75 |=========================================================== C . 39.42 |============================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 51.32 |================================================================== B . 52.68 |==================================================================== C . 50.16 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.85 |==================================================================== B . 81.95 |==================================================================== C . 81.27 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.697245586 |============================================================ B . 5.840000000 |============================================================== C . 5.600000000 |=========================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 35.61 |=================================================================== B . 36.18 |==================================================================== C . 34.95 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 38.59 |==================================================================== B . 32.67 |========================================================== C . 33.48 |=========================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 47.93 |==================================================================== B . 37.82 |====================================================== C . 37.90 |====================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 40.35 |==================================================================== B . 39.24 |================================================================== C . 39.98 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.59 |=================================================================== B . 14.33 |================================================================== C . 14.84 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.72 |==================================================================== B . 81.89 |==================================================================== C . 81.69 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.686811862 |============================================================= B . 5.770000000 |============================================================== C . 5.610000000 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 10.416766488 |============================================================= B . 10.150000000 |=========================================================== C . 9.950000000 |========================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 10.50 |================================================================== B . 10.34 |================================================================= C . 10.88 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 12.62 |==================================================================== B . 11.45 |============================================================== C . 11.35 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 10.561349589 |============================================================= B . 10.230000000 |=========================================================== C . 9.940000000 |========================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.87 |=================================================================== B . 15.09 |==================================================================== C . 15.00 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 82.61 |==================================================================== B . 82.13 |==================================================================== C . 81.27 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.77 |===================================================================== B . 5.59 |=================================================================== C . 5.79 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 11.02 |================================================================== B . 11.03 |================================================================== C . 11.37 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 10.29 |=================================================================== B . 10.36 |==================================================================== C . 10.42 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 11.72 |==================================================================== B . 11.66 |=================================================================== C . 11.75 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 11.30 |=================================================================== B . 11.37 |==================================================================== C . 11.44 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 24.79 |================================================================= B . 25.52 |================================================================== C . 26.10 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 83.16 |==================================================================== B . 82.83 |==================================================================== C . 81.56 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.94 |===================================================================== B . 5.75 |=================================================================== C . 5.84 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 14.20 |=================================================================== B . 14.34 |==================================================================== C . 13.58 |================================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 17.12 |=============================================================== B . 18.53 |==================================================================== C . 18.21 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 19.85 |================================================================= B . 20.65 |==================================================================== C . 20.38 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 18.67 |==================================================================== B . 18.55 |==================================================================== C . 18.16 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 24.43 |=============================================================== B . 26.55 |==================================================================== C . 25.30 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 82.83 |==================================================================== B . 81.48 |=================================================================== C . 82.03 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.75 |==================================================================== B . 5.77 |==================================================================== C . 5.83 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 15.13 |==================================================================== B . 13.71 |============================================================== C . 14.06 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 18.25 |==================================================================== B . 17.68 |================================================================== C . 17.32 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 19.92 |==================================================================== B . 19.67 |=================================================================== C . 19.98 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 19.81 |==================================================================== B . 19.08 |================================================================= C . 19.12 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 47.52 |================================================================= B . 49.52 |==================================================================== C . 49.88 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 82.95 |==================================================================== B . 81.89 |=================================================================== C . 82.18 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.710000000 |============================================================== B . 5.700000000 |============================================================= C . 5.750968024 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 35.77 |==================================================================== B . 36.03 |==================================================================== C . 34.61 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 35.92 |==================================================================== B . 34.13 |================================================================= C . 35.01 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 42.35 |==================================================================== B . 41.30 |================================================================== C . 39.97 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 38.98 |==================================================================== B . 38.55 |=================================================================== C . 36.74 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 47.67 |==================================================================== B . 48.02 |==================================================================== C . 46.21 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 82.56 |==================================================================== B . 82.97 |==================================================================== C . 81.92 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.69 |=================================================================== B . 5.81 |==================================================================== C . 5.88 |===================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 33.70 |================================================================== B . 32.48 |================================================================ C . 34.53 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 31.65 |==================================================================== B . 31.66 |==================================================================== C . 31.83 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 38.93 |==================================================================== B . 37.93 |================================================================== C . 37.96 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 37.36 |==================================================================== B . 33.48 |============================================================= C . 35.24 |================================================================