apache spark 5800X3D AMD Ryzen 7 5800X3D 8-Core testing with a ASUS ROG CROSSHAIR VIII HERO (4201 BIOS) and Gigabyte AMD Radeon RX 6600 8GB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (4201 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: Gigabyte AMD Radeon RX 6600 8GB (2750/875MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-drm-next-28july (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-c6ded153d1) (LLVM 12.0.0 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (4201 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: Gigabyte AMD Radeon RX 6600 8GB (2750/875MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-drm-next-28july (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-c6ded153d1) (LLVM 12.0.0 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (4201 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: Gigabyte AMD Radeon RX 6600 8GB (2750/875MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-drm-next-28july (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-c6ded153d1) (LLVM 12.0.0 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 2.91 |===================================================================== B . 2.88 |==================================================================== C . 2.84 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 149.35 |=================================================================== B . 148.74 |=================================================================== C . 146.52 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.67 |===================================================================== B . 8.61 |===================================================================== C . 8.52 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 2.89 |===================================================================== B . 2.88 |===================================================================== C . 2.88 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 1.90 |=================================================================== B . 1.93 |==================================================================== C . 1.96 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 1.45 |===================================================================== B . 1.40 |=================================================================== C . 1.44 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 1.31 |================================================================== B . 1.36 |===================================================================== C . 1.30 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 3.06 |===================================================================== B . 3.02 |==================================================================== C . 3.03 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 150.18 |=================================================================== B . 149.13 |=================================================================== C . 148.57 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.69 |===================================================================== B . 8.67 |===================================================================== C . 8.55 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 3.15 |================================================================== B . 3.20 |==================================================================== C . 3.27 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 1.99 |==================================================================== B . 1.99 |==================================================================== C . 2.02 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 1.63 |===================================================================== B . 1.63 |===================================================================== C . 1.62 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 1.48 |===================================================================== B . 1.45 |==================================================================== C . 1.38 |================================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 3.17 |===================================================================== B . 3.19 |===================================================================== C . 3.14 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 150.41 |=================================================================== B . 149.52 |=================================================================== C . 149.53 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.68 |===================================================================== B . 8.61 |==================================================================== C . 8.59 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 3.42 |===================================================================== B . 3.43 |===================================================================== C . 3.36 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 2.20 |===================================================================== B . 2.20 |===================================================================== C . 2.16 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 1.92 |===================================================================== B . 1.84 |================================================================== C . 1.76 |=============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 1.58 |=============================================================== B . 1.66 |================================================================== C . 1.74 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 3.46 |===================================================================== B . 3.47 |===================================================================== C . 3.48 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 150.03 |=================================================================== B . 148.58 |================================================================== C . 149.72 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.68 |===================================================================== B . 8.61 |==================================================================== C . 8.63 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 3.74 |=================================================================== B . 3.84 |===================================================================== C . 3.79 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 2.50 |==================================================================== B . 2.46 |=================================================================== C . 2.54 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 2.32 |================================================================ B . 2.36 |================================================================= C . 2.50 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 2.02 |==================================================================== B . 2.05 |===================================================================== C . 1.94 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.54 |==================================================================== B . 14.60 |==================================================================== C . 14.47 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 149.76 |=================================================================== B . 149.56 |=================================================================== C . 149.07 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.66 |===================================================================== B . 8.66 |===================================================================== C . 8.64 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 6.60 |===================================================================== B . 6.64 |===================================================================== C . 6.55 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 9.16 |===================================================================== B . 9.15 |===================================================================== C . 8.95 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 11.34 |==================================================================== B . 11.01 |================================================================== C . 10.93 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 11.57 |==================================================================== B . 11.28 |================================================================== C . 11.54 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 13.94 |=================================================================== B . 13.97 |==================================================================== C . 14.07 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 148.98 |=================================================================== B . 148.92 |=================================================================== C . 148.06 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.69 |===================================================================== B . 8.68 |===================================================================== C . 8.67 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 6.75 |==================================================================== B . 6.82 |===================================================================== C . 6.66 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 8.94 |==================================================================== B . 9.03 |===================================================================== C . 8.83 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 10.32 |=================================================================== B . 10.48 |==================================================================== C . 10.14 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 10.59 |==================================================================== B . 10.11 |================================================================= C . 10.24 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 27.22 |==================================================================== B . 27.24 |==================================================================== C . 27.29 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 149.36 |=================================================================== B . 148.79 |=================================================================== C . 149.25 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.67 |===================================================================== B . 8.59 |==================================================================== C . 8.71 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 10.65 |==================================================================== B . 10.50 |=================================================================== C . 10.60 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 17.91 |=================================================================== B . 17.81 |=================================================================== C . 18.05 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 21.82 |=================================================================== B . 22.08 |==================================================================== C . 22.09 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 22.08 |================================================================== B . 22.27 |=================================================================== C . 22.65 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 25.77 |=================================================================== B . 25.98 |==================================================================== C . 25.62 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 148.22 |=================================================================== B . 149.14 |=================================================================== C . 148.94 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.60 |===================================================================== B . 8.60 |===================================================================== C . 8.57 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 10.12 |==================================================================== B . 10.05 |==================================================================== C . 10.04 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 16.94 |================================================================== B . 17.02 |================================================================== C . 17.49 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 20.04 |================================================================ B . 19.77 |=============================================================== C . 21.21 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 20.35 |==================================================================== B . 20.05 |=================================================================== C . 19.94 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 49.41 |==================================================================== B . 49.28 |==================================================================== C . 49.53 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 149.23 |=================================================================== B . 148.60 |=================================================================== C . 149.61 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.63 |===================================================================== B . 8.63 |===================================================================== C . 8.65 |===================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 27.36 |==================================================================== B . 27.28 |==================================================================== C . 27.38 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 33.93 |================================================================== B . 34.41 |=================================================================== C . 34.74 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 40.00 |================================================================= B . 39.87 |================================================================= C . 41.98 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 40.78 |==================================================================== B . 40.14 |=================================================================== C . 39.62 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 50.13 |==================================================================== B . 49.86 |==================================================================== C . 48.84 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 151.33 |=================================================================== B . 149.13 |================================================================== C . 147.72 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.59 |===================================================================== B . 8.61 |===================================================================== C . 8.58 |===================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 23.97 |==================================================================== B . 23.49 |=================================================================== C . 23.04 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 33.55 |=================================================================== B . 33.85 |=================================================================== C . 34.11 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 39.55 |=================================================================== B . 40.14 |==================================================================== C . 40.17 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 40.32 |=================================================================== B . 40.76 |==================================================================== C . 40.29 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 13.97 |==================================================================== B . 13.89 |=================================================================== C . 14.07 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 148.55 |=================================================================== B . 148.53 |=================================================================== C . 148.99 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.49 |==================================================================== B . 8.54 |==================================================================== C . 8.61 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 6.89 |===================================================================== B . 6.77 |==================================================================== C . 6.86 |===================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 9.05 |===================================================================== B . 9.01 |===================================================================== C . 8.90 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 10.79 |=================================================================== B . 11.02 |==================================================================== C . 10.51 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 10.65 |==================================================================== B . 10.60 |==================================================================== C . 10.08 |================================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 14.15 |==================================================================== B . 14.12 |==================================================================== C . 14.14 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 148.55 |================================================================== B . 149.18 |=================================================================== C . 150.28 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.580000000 |============================================================= B . 8.570000000 |============================================================= C . 8.687892725 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 7.03 |==================================================================== B . 7.14 |===================================================================== C . 7.04 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 9.34 |===================================================================== B . 9.22 |==================================================================== C . 9.24 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 11.20 |================================================================= B . 11.21 |================================================================= C . 11.66 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 10.60 |==================================================================== B . 10.56 |==================================================================== C . 10.41 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 25.55 |==================================================================== B . 25.53 |==================================================================== C . 25.60 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 149.23 |=================================================================== B . 147.91 |================================================================== C . 149.29 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.62 |===================================================================== B . 8.58 |===================================================================== C . 8.54 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 10.25 |==================================================================== B . 10.16 |=================================================================== C . 10.03 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 17.03 |==================================================================== B . 17.09 |==================================================================== C . 17.01 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 19.97 |================================================================== B . 20.33 |=================================================================== C . 20.49 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 19.87 |================================================================ B . 20.66 |=================================================================== C . 21.08 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 25.70 |==================================================================== B . 25.76 |==================================================================== C . 25.72 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 148.85 |=================================================================== B . 148.30 |================================================================== C . 149.85 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.64 |===================================================================== B . 8.60 |===================================================================== C . 8.59 |===================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 10.25 |=================================================================== B . 10.32 |=================================================================== C . 10.41 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 17.52 |=================================================================== B . 17.81 |==================================================================== C . 17.44 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 20.79 |==================================================================== B . 20.72 |==================================================================== C . 20.50 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 20.01 |==================================================================== B . 19.87 |==================================================================== C . 19.31 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 49.63 |==================================================================== B . 49.95 |==================================================================== C . 49.84 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 149.45 |================================================================== B . 148.66 |================================================================== C . 151.94 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.61 |===================================================================== B . 8.62 |===================================================================== C . 8.56 |===================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 22.89 |=================================================================== B . 23.24 |==================================================================== C . 23.18 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 34.50 |==================================================================== B . 34.09 |=================================================================== C . 34.62 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 39.60 |================================================================== B . 40.50 |==================================================================== C . 39.90 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 40.99 |==================================================================== B . 41.01 |==================================================================== C . 41.20 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 50.33 |=================================================================== B . 51.35 |==================================================================== C . 50.12 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 148.60 |=================================================================== B . 148.50 |=================================================================== C . 147.98 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 8.59 |===================================================================== B . 8.57 |===================================================================== C . 8.50 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 23.26 |==================================================================== B . 22.94 |=================================================================== C . 23.17 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 34.56 |==================================================================== B . 33.98 |=================================================================== C . 33.96 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 40.60 |==================================================================== B . 39.58 |================================================================== C . 39.85 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 41.55 |==================================================================== B . 40.71 |=================================================================== C . 41.18 |===================================================================