apache spark icelake Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 16GB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1200 B: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1200 C: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1200 Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 6.049590741 |=========================================================== B . 6.340000000 |============================================================== C . 6.300000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 656.98 |========================================================== B . 756.27 |=================================================================== C . 714.63 |=============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 35.82 |================================================================ B . 37.98 |==================================================================== C . 38.10 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 5.005407545 |============================================================== B . 4.790000000 |=========================================================== C . 4.830000000 |============================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 5.342907891 |============================================================== B . 5.090000000 |=========================================================== C . 5.030000000 |========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 3.701479768 |============================================================== B . 3.427888708 |========================================================= C . 3.690000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 3.032268713 |======================================================= B . 2.870000000 |==================================================== C . 3.440000000 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 9.13 |================================================================== B . 9.55 |===================================================================== C . 8.67 |=============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 780.34 |================================================================ B . 817.02 |=================================================================== C . 796.49 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 37.30 |================================================================= B . 38.75 |==================================================================== C . 38.22 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 5.91 |==================================================== B . 7.82 |===================================================================== C . 7.81 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 8.03 |================================================================ B . 8.62 |===================================================================== C . 8.47 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 6.12 |===================================================================== B . 6.11 |===================================================================== C . 5.77 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 6.286490085 |============================================================== B . 5.660000000 |======================================================== C . 4.840000000 |================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 9.44831342 |============================================================ B . 9.96000000 |=============================================================== C . 9.65000000 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 805.22 |================================================================= B . 833.80 |=================================================================== C . 798.74 |================================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 37.88 |=================================================================== B . 38.39 |==================================================================== C . 36.68 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 8.62 |=================================================================== B . 8.88 |===================================================================== C . 8.93 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 9.26 |================================================================== B . 9.67 |===================================================================== C . 9.09 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 6.501183247 |==================================================== B . 7.700000000 |============================================================== C . 6.540000000 |===================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 5.50 |================================================================= B . 5.88 |===================================================================== C . 4.95 |========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 10.79 |=========================================================== B . 12.54 |==================================================================== C . 10.54 |========================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 797.26 |================================================================= B . 820.19 |=================================================================== C . 795.78 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 37.98 |=================================================================== B . 38.36 |==================================================================== C . 38.21 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 9.736214644 |======================================================= B . 10.710000000 |============================================================= C . 9.900000000 |======================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 9.770000000 |======================================================= B . 10.770249391 |============================================================= C . 9.620000000 |====================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 8.35 |============================================================= B . 9.47 |===================================================================== C . 8.88 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 7.37 |================================================================ B . 7.98 |===================================================================== C . 6.97 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 44.59 |=================================================================== B . 45.27 |==================================================================== C . 42.39 |================================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 819.85 |=================================================================== B . 823.83 |=================================================================== C . 805.05 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 38.82 |==================================================================== B . 38.18 |=================================================================== C . 38.14 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 20.77 |================================================================= B . 21.60 |==================================================================== C . 20.75 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 36.92 |==================================================================== B . 34.44 |=============================================================== C . 34.12 |=============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 41.40 |=================================================================== B . 42.26 |==================================================================== C . 38.62 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 37.88 |=================================================================== B . 38.23 |==================================================================== C . 37.43 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 44.79 |==================================================================== B . 42.73 |================================================================= C . 41.92 |================================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 834.22 |=================================================================== B . 815.97 |================================================================== C . 805.28 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 39.22 |==================================================================== B . 38.72 |=================================================================== C . 37.79 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 21.69 |================================================================= B . 22.74 |==================================================================== C . 21.78 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 35.84 |==================================================================== B . 35.60 |==================================================================== C . 33.73 |================================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 40.50 |==================================================================== B . 39.91 |=================================================================== C . 37.04 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 37.48 |==================================================================== B . 37.29 |==================================================================== C . 34.48 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 80.94 |==================================================================== B . 80.93 |==================================================================== C . 77.38 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 817.00 |=================================================================== B . 822.65 |=================================================================== C . 802.03 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 38.61 |==================================================================== B . 38.21 |=================================================================== C . 37.82 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 36.49 |==================================================================== B . 33.69 |=============================================================== C . 33.20 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 69.11 |==================================================================== B . 68.17 |=================================================================== C . 61.60 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 75.94 |==================================================================== B . 74.64 |=================================================================== C . 74.85 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 73.59 |==================================================================== B . 73.36 |==================================================================== C . 68.51 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 84.60 |==================================================================== B . 74.36 |============================================================ C . 76.50 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 851.47 |=================================================================== B . 784.91 |============================================================== C . 803.02 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 39.41 |==================================================================== B . 37.73 |================================================================= C . 38.21 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 36.96 |==================================================================== B . 35.67 |================================================================== C . 33.63 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 69.75 |==================================================================== B . 66.42 |================================================================= C . 62.45 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 78.51 |=================================================================== B . 79.67 |==================================================================== C . 72.20 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 74.45 |==================================================================== B . 66.80 |============================================================= C . 68.02 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 163.58 |=================================================================== B . 147.43 |============================================================ C . 149.26 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A . 839.48 |=================================================================== B . 801.09 |================================================================ C . 801.21 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 39.10 |==================================================================== B . 37.64 |================================================================= C . 37.76 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A . 89.62 |==================================================================== B . 78.29 |=========================================================== C . 79.63 |============================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A . 133.26 |=================================================================== B . 120.41 |============================================================= C . 120.32 |============================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A . 161.40 |=================================================================== B . 150.73 |=============================================================== C . 146.82 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 150.51 |=================================================================== B . 138.77 |============================================================== C . 137.47 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 159.55 |=================================================================== B . 142.60 |============================================================ C . 146.31 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A . 832.46 |=================================================================== B . 801.08 |================================================================ C . 797.58 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 38.75 |==================================================================== B . 38.03 |=================================================================== C . 37.88 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A . 85.77 |==================================================================== B . 74.43 |=========================================================== C . 76.05 |============================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A . 131.35 |=================================================================== B . 118.72 |============================================================= C . 119.48 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A . 158.85 |=================================================================== B . 152.51 |================================================================ C . 144.38 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 145.28 |=================================================================== B . 134.98 |============================================================== C . 133.54 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 46.37 |==================================================================== B . 40.59 |============================================================ C . 41.86 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 819.96 |=================================================================== B . 804.48 |================================================================== C . 793.88 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 39.34 |==================================================================== B . 38.39 |================================================================== C . 37.79 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 24.58 |==================================================================== B . 20.09 |======================================================== C . 21.86 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 35.36 |==================================================================== B . 34.11 |================================================================== C . 32.92 |=============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 41.61 |==================================================================== B . 38.36 |=============================================================== C . 38.11 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 38.13 |==================================================================== B . 35.88 |================================================================ C . 35.39 |=============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 47.27 |==================================================================== B . 42.42 |============================================================= C . 43.04 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 822.14 |=================================================================== B . 801.78 |================================================================= C . 794.37 |================================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 38.27 |==================================================================== B . 37.69 |=================================================================== C . 37.82 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 25.22 |==================================================================== B . 22.84 |============================================================== C . 23.23 |=============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 38.74 |==================================================================== B . 34.76 |============================================================= C . 34.82 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 43.56 |==================================================================== B . 39.72 |============================================================== C . 39.78 |============================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 37.43 |================================================================= B . 38.92 |==================================================================== C . 36.71 |================================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 81.26 |==================================================================== B . 77.57 |================================================================= C . 77.58 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 818.24 |=================================================================== B . 802.19 |================================================================== C . 791.66 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 38.68 |==================================================================== B . 36.55 |================================================================ C . 35.51 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 36.50 |==================================================================== B . 34.60 |================================================================ C . 35.28 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 62.96 |================================================================ B . 66.79 |==================================================================== C . 65.69 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 77.89 |==================================================================== B . 72.88 |================================================================ C . 72.36 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 75.45 |==================================================================== B . 68.66 |============================================================== C . 68.57 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 84.81 |==================================================================== B . 79.12 |=============================================================== C . 78.19 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 852.97 |=================================================================== B . 803.54 |=============================================================== C . 792.71 |============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 39.01 |==================================================================== B . 37.70 |================================================================== C . 38.03 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 39.06 |==================================================================== B . 35.03 |============================================================= C . 37.38 |================================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 67.94 |==================================================================== B . 63.23 |=============================================================== C . 61.39 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 79.92 |==================================================================== B . 74.51 |=============================================================== C . 74.35 |=============================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 73.69 |==================================================================== B . 69.81 |================================================================ C . 69.94 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 158.15 |=================================================================== B . 147.60 |=============================================================== C . 145.94 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 825.83 |=================================================================== B . 807.06 |================================================================= C . 805.40 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 38.74 |==================================================================== B . 37.79 |================================================================== C . 37.76 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A . 81.85 |==================================================================== B . 77.14 |================================================================ C . 74.02 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A . 132.39 |=================================================================== B . 119.29 |============================================================ C . 119.33 |============================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A . 159.24 |=================================================================== B . 147.56 |============================================================== C . 144.71 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 144.78 |=================================================================== B . 137.48 |================================================================ C . 135.33 |=============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A . 158.07 |=================================================================== B . 153.12 |================================================================= C . 149.69 |=============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A . 817.88 |=================================================================== B . 805.08 |================================================================== C . 796.05 |================================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A . 38.39 |================================================================= B . 40.25 |==================================================================== C . 37.72 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A . 79.59 |==================================================================== B . 79.05 |==================================================================== C . 75.18 |================================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A . 130.73 |=================================================================== B . 123.72 |=============================================================== C . 120.75 |============================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A . 166.14 |=================================================================== B . 151.22 |============================================================= C . 149.07 |============================================================ Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A . 146.86 |=================================================================== B . 138.55 |=============================================================== C . 136.88 |==============================================================