spark 12900K Intel Intel Core i9-12900K testing with a ASUS ROG STRIX Z690-E GAMING WIFI (1601 BIOS) and AMD Radeon RX 6800 XT 16GB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: Intel Core i9-12900K @ 5.20GHz (16 Cores / 24 Threads), Motherboard: ASUS ROG STRIX Z690-E GAMING WIFI (1601 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: Intel Alder Lake-S HD Audio, Monitor: ASUS VP28U, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 22.04, Kernel: 5.19.0-051900-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.3.0-devel (git-42a52a8 2022-08-04 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.47), Vulkan: 1.3.219, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: Intel Core i9-12900K @ 5.20GHz (16 Cores / 24 Threads), Motherboard: ASUS ROG STRIX Z690-E GAMING WIFI (1601 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: Intel Alder Lake-S HD Audio, Monitor: ASUS VP28U, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 22.04, Kernel: 5.19.0-051900-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.3.0-devel (git-42a52a8 2022-08-04 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.47), Vulkan: 1.3.219, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: Intel Core i9-12900K @ 5.20GHz (16 Cores / 24 Threads), Motherboard: ASUS ROG STRIX Z690-E GAMING WIFI (1601 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: Intel Alder Lake-S HD Audio, Monitor: ASUS VP28U, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 22.04, Kernel: 5.19.0-051900-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.3.0-devel (git-42a52a8 2022-08-04 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.47), Vulkan: 1.3.219, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 D: Processor: Intel Core i9-12900K @ 5.20GHz (16 Cores / 24 Threads), Motherboard: ASUS ROG STRIX Z690-E GAMING WIFI (1601 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: Intel Alder Lake-S HD Audio, Monitor: ASUS VP28U, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 22.04, Kernel: 5.19.0-051900-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.3.0-devel (git-42a52a8 2022-08-04 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.47), Vulkan: 1.3.219, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 2.12 |================================================================== B . 2.21 |===================================================================== C . 2.21 |===================================================================== D . 2.22 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 81.45 |=================================================================== B . 82.77 |==================================================================== C . 82.47 |==================================================================== D . 82.97 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.04 |==================================================================== B . 5.01 |==================================================================== C . 5.10 |===================================================================== D . 5.10 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 2.71 |==================================================================== B . 2.74 |===================================================================== C . 2.76 |===================================================================== D . 2.72 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 1.25 |===================================================================== B . 1.22 |=================================================================== C . 1.25 |===================================================================== D . 1.24 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 0.97 |================================================================ B . 1.05 |===================================================================== C . 0.98 |================================================================ D . 1.02 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 0.82 |============================================================== B . 0.84 |=============================================================== C . 0.86 |================================================================= D . 0.92 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 2.29 |==================================================================== B . 2.26 |=================================================================== C . 2.32 |===================================================================== D . 2.30 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 84.80 |==================================================================== B . 84.41 |==================================================================== C . 85.01 |==================================================================== D . 84.44 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.070000000 |============================================================== B . 4.763385925 |========================================================== C . 4.710000000 |========================================================= D . 5.100000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 2.79 |===================================================================== B . 2.75 |==================================================================== C . 2.81 |===================================================================== D . 2.77 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 1.31 |================================================================== B . 1.36 |===================================================================== C . 1.34 |==================================================================== D . 1.36 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 1.010000000 |============================================================ B . 1.000558709 |=========================================================== C . 1.050000000 |============================================================== D . 1.020000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 0.88 |=================================================================== B . 0.91 |===================================================================== C . 0.89 |=================================================================== D . 0.91 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 2.56 |==================================================================== B . 2.48 |================================================================== C . 2.58 |===================================================================== D . 2.38 |================================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 84.36 |=================================================================== B . 85.47 |==================================================================== C . 84.46 |=================================================================== D . 85.81 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 4.59 |================================================================ B . 4.96 |===================================================================== C . 4.94 |===================================================================== D . 4.50 |=============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 2.94 |==================================================================== B . 2.92 |==================================================================== C . 2.98 |===================================================================== D . 2.96 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 1.45 |===================================================================== B . 1.42 |==================================================================== C . 1.38 |================================================================== D . 1.43 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 1.22 |================================================================== B . 1.27 |==================================================================== C . 1.28 |===================================================================== D . 1.20 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 1.49 |===================================================================== B . 1.12 |==================================================== C . 0.99 |============================================== D . 1.04 |================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 2.63 |==================================================================== B . 0.53 |============== C . 2.65 |===================================================================== D . 2.54 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 84.51 |================================================================== B . 85.68 |=================================================================== C . 85.77 |=================================================================== D . 86.59 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 4.75 |================================================================ B . 5.13 |===================================================================== C . 5.02 |==================================================================== D . 5.06 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 3.21 |===================================================================== B . 0.67 |============== C . 3.05 |================================================================== D . 3.14 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 1.63 |===================================================================== B . 1.16 |================================================= C . 1.59 |=================================================================== D . 1.62 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 1.54 |===================================================================== B . 0.11 |===== C . 1.54 |===================================================================== D . 1.52 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 1.28 |================================================================== B . 0.05 |=== C . 1.33 |===================================================================== D . 1.31 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 8.16 |================================================================== B . 8.59 |===================================================================== C . 8.00 |================================================================ D . 7.97 |================================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 85.75 |==================================================================== B . 85.31 |=================================================================== C . 86.35 |==================================================================== D . 86.07 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.08 |===================================================================== B . 5.03 |==================================================================== C . 4.78 |================================================================= D . 5.07 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 4.98 |================================================================== B . 4.99 |================================================================== C . 5.04 |=================================================================== D . 5.19 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 5.40 |===================================================================== B . 5.25 |=================================================================== C . 5.39 |===================================================================== D . 5.11 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 6.130000000 |========================================================== B . 6.523776991 |============================================================== C . 6.330000000 |============================================================ D . 6.020000000 |========================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 6.28 |=============================================================== B . 6.85 |===================================================================== C . 6.55 |================================================================== D . 6.45 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 7.40 |==================================================================== B . 7.46 |==================================================================== C . 7.42 |==================================================================== D . 7.56 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 87.28 |==================================================================== B . 86.09 |=================================================================== C . 85.04 |================================================================== D . 85.68 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.08 |===================================================================== B . 5.03 |==================================================================== C . 4.96 |=================================================================== D . 5.11 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 4.65 |===================================================================== B . 4.43 |================================================================== C . 4.63 |===================================================================== D . 4.50 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 5.10 |===================================================================== B . 4.81 |================================================================= C . 4.96 |=================================================================== D . 4.96 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 6.21 |===================================================================== B . 5.79 |================================================================ C . 5.58 |============================================================== D . 6.17 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 5.82 |==================================================================== B . 5.85 |==================================================================== C . 5.49 |================================================================ D . 5.90 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.33 |================================================================= B . 14.55 |================================================================== C . 14.37 |================================================================= D . 15.04 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 85.14 |==================================================================== B . 85.48 |==================================================================== C . 84.84 |=================================================================== D . 85.09 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.02 |===================================================================== B . 4.70 |================================================================ C . 4.80 |================================================================== D . 5.03 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 7.65 |===================================================================== B . 7.66 |===================================================================== C . 7.61 |===================================================================== D . 7.65 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 10.098177409 |============================================================ B . 10.200000000 |============================================================= C . 10.070000000 |============================================================ D . 9.950000000 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 12.67 |==================================================================== B . 11.89 |================================================================ C . 12.25 |================================================================== D . 11.58 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 12.40 |=================================================================== B . 12.64 |==================================================================== C . 12.51 |=================================================================== D . 12.43 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.21 |=============================================================== B . 15.29 |==================================================================== C . 14.34 |================================================================ D . 14.17 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 85.69 |==================================================================== B . 85.09 |==================================================================== C . 85.02 |=================================================================== D . 85.14 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.03 |===================================================================== B . 4.97 |==================================================================== C . 4.48 |============================================================= D . 4.94 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 7.74 |==================================================================== B . 7.84 |===================================================================== C . 7.52 |================================================================== D . 7.41 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 9.88 |=================================================================== B . 9.62 |================================================================= C . 10.05 |==================================================================== D . 9.52 |================================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 11.80 |==================================================================== B . 11.85 |==================================================================== C . 11.43 |================================================================== D . 11.75 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 12.24 |=================================================================== B . 12.32 |=================================================================== C . 12.49 |==================================================================== D . 12.03 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 27.24 |==================================================================== B . 27.10 |==================================================================== C . 27.10 |==================================================================== D . 27.11 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 84.93 |=================================================================== B . 85.67 |==================================================================== C . 84.93 |=================================================================== D . 85.22 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 4.67 |=============================================================== B . 5.04 |==================================================================== C . 4.72 |================================================================ D . 5.08 |===================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 19.14 |==================================================================== B . 18.84 |=================================================================== C . 18.76 |=================================================================== D . 18.87 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 19.24 |==================================================================== B . 19.30 |==================================================================== C . 19.27 |==================================================================== D . 19.16 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 23.04 |=================================================================== B . 23.13 |=================================================================== C . 22.91 |================================================================== D . 23.55 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 23.81 |=================================================================== B . 24.26 |==================================================================== C . 24.27 |==================================================================== D . 23.71 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 25.26 |==================================================================== B . 24.36 |================================================================== C . 24.30 |================================================================= D . 24.31 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 84.63 |==================================================================== B . 85.03 |==================================================================== C . 85.02 |==================================================================== D . 85.13 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 4.94 |=================================================================== B . 5.05 |==================================================================== C . 4.70 |================================================================ D . 5.09 |===================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 17.12 |==================================================================== B . 16.84 |=================================================================== C . 16.99 |=================================================================== D . 16.67 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 18.48 |==================================================================== B . 18.16 |================================================================== C . 18.60 |==================================================================== D . 18.28 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 21.14 |================================================================== B . 20.69 |================================================================= C . 21.78 |==================================================================== D . 21.55 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 21.25 |=================================================================== B . 21.19 |=================================================================== C . 21.30 |=================================================================== D . 21.62 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 7.73 |===================================================================== B . 7.77 |===================================================================== C . 7.78 |===================================================================== D . 7.65 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 86.28 |==================================================================== B . 86.02 |==================================================================== C . 85.82 |==================================================================== D . 84.81 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.060000000 |============================================================== B . 5.080638849 |============================================================== C . 4.980000000 |============================================================= D . 4.720000000 |========================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 4.96 |==================================================================== B . 4.92 |=================================================================== C . 5.00 |==================================================================== D . 5.07 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 5.06 |=================================================================== B . 5.02 |================================================================== C . 5.23 |===================================================================== D . 5.16 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 5.97 |===================================================================== B . 5.68 |================================================================== C . 5.74 |================================================================== D . 5.79 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 5.62 |===================================================================== B . 5.33 |================================================================= C . 5.35 |================================================================== D . 5.39 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 7.84 |==================================================================== B . 7.80 |==================================================================== C . 7.69 |=================================================================== D . 7.97 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 86.82 |==================================================================== B . 85.28 |=================================================================== C . 86.04 |=================================================================== D . 85.51 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.09 |===================================================================== B . 4.66 |=============================================================== C . 5.03 |==================================================================== D . 4.92 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 5.00 |===================================================================== B . 4.97 |==================================================================== C . 4.98 |==================================================================== D . 5.03 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 5.19 |================================================================== B . 5.17 |================================================================== C . 5.39 |===================================================================== D . 5.21 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 6.08 |================================================================== B . 6.12 |=================================================================== C . 6.32 |===================================================================== D . 6.17 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 6.07 |===================================================================== B . 5.95 |==================================================================== C . 6.05 |===================================================================== D . 6.02 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 13.43 |==================================================================== B . 13.24 |=================================================================== C . 13.12 |================================================================== D . 13.28 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 84.83 |==================================================================== B . 85.35 |==================================================================== C . 84.81 |==================================================================== D . 85.07 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.00 |==================================================================== B . 5.07 |===================================================================== C . 4.99 |==================================================================== D . 4.99 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 6.80 |================================================================== B . 6.95 |==================================================================== C . 7.06 |===================================================================== D . 6.82 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 9.46 |==================================================================== B . 9.21 |================================================================== C . 9.47 |==================================================================== D . 9.57 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 11.37 |==================================================================== B . 11.15 |=================================================================== C . 11.07 |================================================================== D . 10.99 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 10.55 |============================================================= B . 11.72 |==================================================================== C . 10.74 |============================================================== D . 10.60 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 0.54000000 |== B . 13.68000000 |============================================================== C . 13.70550217 |============================================================== D . 13.68000000 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 85.12 |==================================================================== B . 84.89 |==================================================================== C . 85.13 |==================================================================== D . 85.35 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 4.82 |================================================================== B . 4.93 |==================================================================== C . 5.03 |===================================================================== D . 4.97 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 0.69 |====== B . 7.36 |===================================================================== B . 7.32 |===================================================================== C . 7.31 |===================================================================== D . 7.14 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 1.16 |======== B . 9.79 |===================================================================== C . 9.57 |=================================================================== D . 9.39 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 0.11 |= B . 11.83 |=================================================================== B . 11.96 |==================================================================== C . 11.67 |================================================================== D . 11.16 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 0.06 | B . 11.72 |==================================================================== B . 11.60 |=================================================================== C . 11.80 |==================================================================== D . 10.75 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 24.94 |=================================================================== B . 24.97 |=================================================================== C . 24.97 |=================================================================== D . 25.16 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 85.27 |=================================================================== B . 86.57 |==================================================================== C . 85.71 |=================================================================== D . 84.79 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 5.01 |==================================================================== B . 5.06 |===================================================================== C . 4.69 |================================================================ D . 4.80 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 15.40 |================================================================== B . 15.78 |==================================================================== C . 15.24 |================================================================== D . 15.58 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 18.68 |==================================================================== B . 18.13 |================================================================== C . 18.08 |================================================================== D . 17.87 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 21.88 |=================================================================== B . 21.87 |=================================================================== C . 21.26 |================================================================= D . 22.14 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 22.41 |==================================================================== B . 22.35 |==================================================================== C . 22.00 |=================================================================== D . 22.38 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 24.79 |================================================================== B . 24.71 |================================================================== C . 24.70 |================================================================== D . 25.58 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 85.35 |=================================================================== B . 84.85 |================================================================== C . 85.55 |=================================================================== D . 86.84 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 4.99 |==================================================================== B . 4.92 |=================================================================== C . 4.89 |=================================================================== D . 5.04 |===================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 14.77 |=========================================================== B . 14.72 |=========================================================== C . 16.90 |==================================================================== D . 15.25 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 18.42 |=================================================================== B . 17.55 |================================================================ C . 18.56 |==================================================================== D . 18.33 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 21.83 |================================================================== B . 22.01 |=================================================================== C . 22.09 |=================================================================== D . 22.33 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 21.99 |==================================================================== B . 21.94 |==================================================================== C . 21.98 |==================================================================== D . 21.93 |====================================================================