3990X spark AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 3.44108896 |=============================================================== B . 2.61000000 |================================================ C . 2.82000000 |==================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 2.513151011 |============================================================== B . 2.000000000 |================================================= C . 2.000000000 |================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 3.113442336 |==================================================== B . 3.687104262 |============================================================== C . 3.090000000 |==================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.483052817 |===================================================== B . 2.680850447 |========================================================= C . 2.920000000 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.67000000 |======================================================== B . 2.56858027 |====================================================== C . 3.01000000 |=============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.590000000 |===================================================== B . 3.012985716 |============================================================== C . 2.930000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 2.937488354 |======================================================= B . 3.340000000 |============================================================== C . 3.070000000 |========================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 31.59 |==================================================================== B . 28.51 |============================================================= C . 27.83 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.60 |============================================================= B . 2.73 |================================================================ C . 2.95 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 2.519010205 |========================================================== B . 2.394675560 |======================================================= C . 2.700000000 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 31.44 |================================================================== B . 28.86 |============================================================= C . 32.29 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 2.387009284 |============================================================== B . 2.150000000 |======================================================== C . 2.330000000 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.68943648 |========================================================= B . 2.85000000 |============================================================ C . 2.98000000 |=============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 5.933072529 |========================================================= B . 6.300000000 |============================================================ C . 6.510000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 3.759185306 |============================================================ B . 3.520000000 |========================================================= C . 3.859701456 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 4.280670733 |========================================================= B . 4.610000000 |============================================================= C . 4.680000000 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 7.532539716 |========================================================= B . 7.804257066 |=========================================================== C . 8.220000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 1.753881637 |============================================================== B . 1.618939771 |========================================================= C . 1.760000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.694834358 |============================================================== B . 2.640000000 |============================================================= C . 2.480000000 |========================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 6.767080689 |========================================================= B . 7.347205305 |============================================================== C . 6.930000000 |========================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 13.37 |=============================================================== B . 14.50 |==================================================================== C . 14.05 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 15.51 |=============================================================== B . 16.79 |==================================================================== C . 16.48 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.543826452 |========================================================= B . 2.560000000 |========================================================== C . 2.750000000 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 16.15 |=============================================================== B . 17.34 |==================================================================== C . 16.09 |=============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 6.82 |================================================================ B . 7.35 |===================================================================== C . 7.06 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.65 |================================================================= B . 2.61 |================================================================ C . 2.81 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 6.99 |================================================================ B . 7.05 |================================================================= C . 7.52 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 7.24 |===================================================================== B . 7.25 |===================================================================== C . 6.74 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.670000000 |========================================================== B . 2.870000000 |============================================================== C . 2.686635946 |========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 4.563995288 |========================================================== B . 4.816485627 |============================================================= C . 4.900000000 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 12.22 |================================================================= B . 12.79 |==================================================================== C . 11.94 |=============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.740000000 |========================================================== B . 2.858828635 |============================================================ C . 2.930000000 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 11.65 |==================================================================== B . 11.35 |================================================================== C . 10.92 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 30.73 |================================================================ B . 31.61 |================================================================== C . 32.79 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 25.33 |==================================================================== B . 23.81 |================================================================ C . 24.28 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.651130459 |========================================================== B . 2.700000000 |=========================================================== C . 2.820000000 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.548499025 |========================================================== B . 2.680000000 |============================================================= C . 2.710000000 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 14.48 |==================================================================== B . 14.33 |=================================================================== C . 13.63 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 22.81 |================================================================= B . 22.58 |================================================================ C . 23.97 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 36.25 |================================================================ B . 38.47 |==================================================================== C . 37.05 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 6.50 |================================================================= B . 6.89 |===================================================================== C . 6.54 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 10.32 |================================================================ B . 10.92 |==================================================================== C . 10.47 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 8.139453773 |============================================================= B . 7.850000000 |=========================================================== C . 8.310000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.5146504 |============================================================= B . 2.5400000 |============================================================= C . 2.6600000 |================================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 8.61 |===================================================================== B . 8.15 |================================================================= C . 8.39 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 11.67 |================================================================ B . 12.32 |==================================================================== C . 11.95 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 14.38 |==================================================================== B . 13.69 |================================================================= C . 13.63 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.66 |=================================================================== B . 2.60 |================================================================= C . 2.74 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 4.805359865 |============================================================== B . 4.730000000 |============================================================= C . 4.560000000 |=========================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.500858068 |=========================================================== B . 2.590000000 |============================================================= C . 2.630000000 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 13.06 |================================================================= B . 13.24 |================================================================== C . 13.73 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 10.39 |================================================================= B . 10.91 |==================================================================== C . 10.74 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 6.817877262 |=========================================================== B . 6.780000000 |=========================================================== C . 7.120000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 2.485822670 |=========================================================== B . 2.610000000 |============================================================== C . 2.609953223 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 7.494374775 |============================================================== B . 7.140000000 |=========================================================== C . 7.400000000 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 3.063892567 |=========================================================== B . 3.210000000 |============================================================== C . 3.210000000 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 39.37 |================================================================= B . 41.23 |==================================================================== C . 39.45 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 37.75 |================================================================= B . 39.54 |==================================================================== C . 39.16 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 14.31 |=================================================================== B . 13.92 |================================================================= C . 14.57 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 12.25 |================================================================== B . 12.64 |==================================================================== C . 12.09 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 37.77 |================================================================= B . 39.47 |==================================================================== C . 38.03 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 37.53 |================================================================= B . 39.17 |==================================================================== C . 37.79 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 23.45 |================================================================= B . 24.48 |==================================================================== C . 24.18 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 20.81 |==================================================================== B . 20.78 |==================================================================== C . 19.96 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 12.17 |================================================================== B . 12.59 |==================================================================== C . 12.08 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 2.87 |================================================================== B . 2.89 |=================================================================== C . 2.99 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 9.436098217 |============================================================== B . 9.500000000 |============================================================== C . 9.130000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 3.213155782 |============================================================= B . 3.115619915 |============================================================ C . 3.240000000 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 20.56 |================================================================== B . 20.25 |================================================================= C . 21.05 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 10.95 |================================================================= B . 11.38 |==================================================================== C . 11.07 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 25.00 |================================================================= B . 24.99 |================================================================= C . 25.96 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 12.30 |================================================================= B . 12.75 |==================================================================== C . 12.77 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 7.716858121 |============================================================= B . 7.890000000 |============================================================== C . 7.600000000 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 7.53074451 |=============================================================== B . 7.26000000 |============================================================= C . 7.31000000 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 12.44 |==================================================================== B . 12.00 |================================================================== C . 12.12 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 10.37 |================================================================== B . 10.73 |==================================================================== C . 10.70 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 25.02 |==================================================================== B . 24.17 |================================================================== C . 24.30 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 35.97 |================================================================== B . 36.46 |=================================================================== C . 37.21 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 39.01 |================================================================== B . 40.34 |==================================================================== C . 39.76 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 37.35 |================================================================== B . 38.62 |==================================================================== C . 38.37 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 19.54 |==================================================================== B . 19.00 |================================================================== C . 19.64 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 37.99 |=================================================================== B . 38.79 |==================================================================== C . 37.59 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 17.26 |==================================================================== B . 16.92 |=================================================================== C . 16.74 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 38.85 |=================================================================== B . 39.60 |==================================================================== C . 38.40 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 24.07 |==================================================================== B . 23.89 |=================================================================== C . 23.37 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 37.31 |================================================================== B . 38.40 |==================================================================== C . 38.02 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 38.04 |================================================================== B . 39.11 |==================================================================== C . 38.96 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 21.20 |================================================================== B . 21.74 |==================================================================== C . 21.79 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 38.69 |================================================================== B . 39.76 |==================================================================== C . 38.87 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 38.27 |================================================================== B . 39.26 |==================================================================== C . 39.04 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 7.203962219 |============================================================== B . 7.032123257 |============================================================= C . 7.110000000 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 40.72 |==================================================================== B . 39.84 |=================================================================== C . 40.01 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 35.96 |=================================================================== B . 36.37 |==================================================================== C . 35.66 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 5.013305259 |============================================================= B . 5.112937033 |============================================================== C . 5.030000000 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 20.41 |=================================================================== B . 20.80 |==================================================================== C . 20.49 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 3.250958149 |============================================================== B . 3.240000000 |============================================================== C . 3.190000000 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 12.03 |=================================================================== B . 12.26 |==================================================================== C . 12.24 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 12.68 |=================================================================== B . 12.91 |==================================================================== C . 12.89 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 23.86 |==================================================================== B . 23.60 |=================================================================== C . 23.45 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 36.66 |=================================================================== B . 37.30 |==================================================================== C . 37.06 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 37.14 |==================================================================== B . 36.60 |=================================================================== C . 36.52 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 21.87 |==================================================================== B . 21.93 |==================================================================== C . 21.59 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 39.43 |=================================================================== B . 40.03 |==================================================================== C . 39.67 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 23.97 |=================================================================== B . 24.32 |==================================================================== C . 23.99 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 12.31 |=================================================================== B . 12.41 |==================================================================== C . 12.49 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 22.29 |=================================================================== B . 22.61 |==================================================================== C . 22.50 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 10.39 |==================================================================== B . 10.27 |=================================================================== C . 10.24 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 21.82 |==================================================================== B . 21.61 |=================================================================== C . 21.52 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 6.990199363 |============================================================== B . 6.970000000 |============================================================== C . 6.922055383 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 5.839089057 |============================================================== B . 5.790000000 |============================================================= C . 5.840000000 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 21.03 |==================================================================== B . 21.11 |==================================================================== C . 20.98 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 39.94 |==================================================================== B . 39.77 |==================================================================== C . 39.70 |====================================================================