tr5 spark svt av1 Benchmarks for a future article. A: Processor: AMD Ryzen Threadripper PRO 5965WX 24-Cores @ 3.80GHz (24 Cores / 48 Threads), Motherboard: ASUS Pro WS WRX80E-SAGE SE WIFI (1003 BIOS), Chipset: AMD Starship/Matisse, Memory: 64GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: ASUS NVIDIA NV106 2GB, Audio: AMD Starship/Matisse, Monitor: VA2431, Network: 2 x Intel 10G X550T + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, Display Driver: nouveau, OpenGL: 4.3 Mesa 22.0.1, Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 B: Processor: AMD Ryzen Threadripper PRO 5965WX 24-Cores @ 3.80GHz (24 Cores / 48 Threads), Motherboard: ASUS Pro WS WRX80E-SAGE SE WIFI (1003 BIOS), Chipset: AMD Starship/Matisse, Memory: 64GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: ASUS NVIDIA NV106 2GB, Audio: AMD Starship/Matisse, Monitor: VA2431, Network: 2 x Intel 10G X550T + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, Display Driver: nouveau, OpenGL: 4.3 Mesa 22.0.1, Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 BB: Processor: AMD Ryzen Threadripper PRO 5965WX 24-Cores @ 3.80GHz (24 Cores / 48 Threads), Motherboard: ASUS Pro WS WRX80E-SAGE SE WIFI (1003 BIOS), Chipset: AMD Starship/Matisse, Memory: 64GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: ASUS NVIDIA NV106 2GB, Audio: AMD Starship/Matisse, Monitor: VA2431, Network: 2 x Intel 10G X550T + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, Display Driver: nouveau, OpenGL: 4.3 Mesa 22.0.1, Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 SVT-AV1 1.2 Encoder Mode: Preset 4 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A .. 2.869 |=================================================================== B .. 2.856 |=================================================================== BB . 2.836 |================================================================== SVT-AV1 1.2 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A .. 59.25 |=========================================================== B .. 66.73 |=================================================================== BB . 51.37 |==================================================== SVT-AV1 1.2 Encoder Mode: Preset 10 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A .. 102.12 |============================================================= B .. 111.01 |================================================================== BB . 86.16 |=================================================== SVT-AV1 1.2 Encoder Mode: Preset 12 - Input: Bosphorus 4K Frames Per Second > Higher Is Better A .. 129.14 |============================================================= B .. 139.51 |================================================================== BB . 108.38 |=================================================== SVT-AV1 1.2 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A .. 7.312 |================================================================= B .. 7.484 |=================================================================== BB . 7.387 |================================================================== SVT-AV1 1.2 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A .. 152.98 |=============================================================== B .. 161.39 |================================================================== BB . 149.40 |============================================================= SVT-AV1 1.2 Encoder Mode: Preset 10 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A .. 309.01 |============================================================ B .. 341.35 |================================================================== BB . 298.10 |========================================================== SVT-AV1 1.2 Encoder Mode: Preset 12 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A .. 418.67 |============================================================ B .. 461.47 |================================================================== BB . 411.29 |=========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 3.773601794 |============================================================= B .. 3.550000000 |========================================================= BB . 3.752523830 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.75 |=================================================================== B .. 49.06 |================================================================= BB . 50.79 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.360000000 |============================================================= B .. 3.340000000 |============================================================ BB . 3.373333355 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A .. 4.179243959 |========================================================== B .. 4.080000000 |======================================================== BB . 4.408564623 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A .. 1.890000000 |===================================================== B .. 1.890000000 |===================================================== BB . 2.184657049 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A .. 1.886124058 |======================================================== B .. 1.760000000 |==================================================== BB . 2.062209171 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 1.33000000 |========================================================== B .. 1.23000000 |====================================================== BB . 1.41487791 |============================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 3.81000000 |============================================================== B .. 3.51000000 |========================================================= BB . 3.77460265 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.22 |=================================================================== B .. 49.29 |================================================================== BB . 49.81 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.347404557 |=========================================================== B .. 3.410000000 |============================================================ BB . 3.463213224 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A .. 4.028182532 |========================================================== B .. 4.010000000 |========================================================= BB . 4.267736603 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A .. 1.970000000 |=================================================== B .. 1.910000000 |================================================= BB . 2.356867444 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A .. 1.959952423 |==================================================== B .. 1.840000000 |================================================= BB . 2.306298059 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 1.471185098 |====================================================== B .. 1.260000000 |============================================== BB . 1.667104916 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 3.970000000 |=========================================================== B .. 3.705339309 |======================================================= BB . 4.125141619 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 49.99 |=================================================================== B .. 49.46 |================================================================== BB . 49.32 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.400212784 |============================================================= B .. 3.390000000 |============================================================= BB . 3.380000000 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A .. 4.310000000 |========================================================== B .. 4.150000000 |======================================================== BB . 4.537829999 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A .. 2.140000000 |=================================================== B .. 2.050000000 |================================================= BB . 2.538924266 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A .. 2.168718063 |==================================================== B .. 2.040000000 |================================================= BB . 2.554630639 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 1.969098985 |================================================= B .. 1.639114181 |========================================= BB . 2.444848775 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 4.160000000 |========================================================== B .. 3.900000000 |======================================================= BB . 4.354368413 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.43 |=================================================================== B .. 50.47 |=================================================================== BB . 49.74 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.347674213 |============================================================= B .. 3.324121142 |============================================================ BB . 3.357334893 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A .. 4.718211324 |========================================================= B .. 4.740000000 |========================================================== BB . 5.008039519 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A .. 2.457157809 |==================================================== B .. 2.420000000 |==================================================== BB . 2.859752415 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A .. 2.850000000 |======================================================== B .. 2.576715878 |=================================================== BB . 3.080000000 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 2.32 |=========================================================== B .. 2.49 |=============================================================== BB . 2.67 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 15.13 |=========================================================== B .. 11.94 |=============================================== BB . 17.07 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.07 |================================================================== B .. 50.58 |=================================================================== BB . 50.34 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.360000000 |============================================================ B .. 3.410000000 |============================================================= BB . 3.390394288 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A .. 7.240000000 |======================================================= B .. 6.810000000 |==================================================== BB . 8.059610009 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A .. 10.128496839 |======================================================= B .. 6.990000000 |====================================== BB . 11.143807954 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A .. 11.428134919 |======================================================= B .. 7.760000000 |===================================== BB . 12.518076203 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 11.721111931 |========================================================= B .. 7.480000000 |===================================== BB . 12.264914309 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 15.41 |=========================================================== B .. 12.04 |============================================== BB . 17.61 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 49.78 |================================================================== B .. 50.73 |=================================================================== BB . 50.04 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.370000000 |=========================================================== B .. 3.480000000 |============================================================= BB . 3.403937261 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A .. 7.156971652 |======================================================== B .. 6.570000000 |==================================================== BB . 7.740000000 |============================================================= Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A .. 9.790000000 |===================================================== B .. 7.030000000 |====================================== BB . 11.130497241 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A .. 11.790956912 |======================================================= B .. 7.760000000 |==================================== BB . 12.930379514 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 11.241856909 |======================================================= B .. 7.060000000 |================================== BB . 12.333389834 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 24.18 |================================================= B .. 20.37 |========================================= BB . 32.98 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.05 |=================================================================== B .. 50.31 |=================================================================== BB . 50.01 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.400000000 |============================================================= B .. 3.310000000 |=========================================================== BB . 3.331336402 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A .. 10.857588257 |======================================================== B .. 9.380000000 |================================================ BB . 11.665361027 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A .. 14.05 |============================================ B .. 12.65 |======================================== BB . 21.32 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A .. 15.12 |========================================== B .. 13.50 |===================================== BB . 24.17 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 16.01 |============================================= B .. 13.74 |======================================= BB . 23.68 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 24.41 |================================================== B .. 20.53 |========================================== BB . 32.62 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.52 |=================================================================== B .. 49.70 |================================================================= BB . 50.85 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.45 |==================================================================== B .. 3.37 |================================================================== BB . 3.38 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A .. 10.595039675 |====================================================== B .. 9.510000000 |================================================= BB . 11.759991319 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A .. 15.75 |================================================ B .. 13.08 |======================================== BB . 21.92 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A .. 17.64 |============================================== B .. 14.63 |======================================= BB . 25.42 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 17.42 |================================================ B .. 14.47 |======================================== BB . 24.32 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 38.82 |========================================== B .. 37.99 |========================================= BB . 61.57 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.61 |=================================================================== B .. 49.79 |================================================================== BB . 50.04 |================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.341043375 |============================================================= B .. 3.340000000 |============================================================= BB . 3.330000000 |============================================================= Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better A .. 26.58 |====================================================== B .. 22.84 |============================================== BB . 33.11 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better A .. 26.70 |========================================== B .. 24.45 |======================================= BB . 42.47 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better A .. 28.25 |========================================== B .. 27.56 |========================================= BB . 44.80 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 28.72 |========================================== B .. 28.33 |========================================= BB . 46.03 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 40.74 |=========================================== B .. 38.49 |========================================= BB . 63.38 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 49.74 |================================================================== B .. 49.52 |================================================================== BB . 50.12 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.479319347 |============================================================= B .. 3.350000000 |=========================================================== BB . 3.390000000 |=========================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time Seconds < Lower Is Better A .. 24.77 |================================================== B .. 22.87 |============================================== BB . 33.34 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better A .. 24.33 |======================================= B .. 23.84 |====================================== BB . 42.30 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time Seconds < Lower Is Better A .. 27.32 |======================================= B .. 26.11 |===================================== BB . 47.29 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 27.60 |========================================= B .. 26.81 |======================================== BB . 45.42 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 12.18 |=============================================== B .. 11.71 |============================================= BB . 17.27 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 49.94 |================================================================== B .. 49.53 |================================================================= BB . 50.72 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.44 |=================================================================== B .. 3.47 |==================================================================== BB . 3.44 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A .. 6.93 |============================================================ B .. 6.55 |======================================================== BB . 7.92 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A .. 7.560000000 |=========================================== B .. 6.920000000 |======================================= BB . 10.667978128 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A .. 8.210000000 |======================================== B .. 8.030000000 |======================================= BB . 12.207016521 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 7.850000000 |========================================= B .. 7.410000000 |====================================== BB . 11.585953767 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 12.40 |================================================= B .. 11.59 |============================================= BB . 17.11 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.71 |=================================================================== B .. 50.15 |================================================================== BB . 50.07 |================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.36 |=================================================================== B .. 3.42 |==================================================================== BB . 3.38 |=================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A .. 7.36 |=========================================================== B .. 7.03 |========================================================= BB . 8.43 |==================================================================== Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A .. 7.850000000 |========================================= B .. 7.120000000 |====================================== BB . 11.383497001 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A .. 8.590000000 |======================================= B .. 8.310000000 |====================================== BB . 13.148685287 |============================================================ Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 8.39000000 |======================================== B .. 7.95000000 |====================================== BB . 12.65896058 |============================================================= Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 20.46 |========================================== B .. 20.54 |========================================== BB . 32.75 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.50 |=================================================================== B .. 49.94 |================================================================== BB . 50.22 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.42 |==================================================================== B .. 3.36 |================================================================== BB . 3.44 |==================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A .. 9.230000000 |================================================ B .. 8.950000000 |=============================================== BB . 11.503199565 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A .. 12.37 |======================================= B .. 12.39 |======================================= BB . 21.03 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A .. 13.13 |===================================== B .. 14.24 |======================================== BB . 24.06 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 13.23 |======================================= B .. 13.80 |========================================= BB . 22.58 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 21.27 |============================================ B .. 20.98 |=========================================== BB . 32.55 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.39 |=================================================================== B .. 49.71 |================================================================== BB . 49.75 |================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.39 |=================================================================== B .. 3.44 |==================================================================== BB . 3.40 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A .. 9.912154914 |================================================== B .. 9.350000000 |=============================================== BB . 11.850374914 |============================================================ Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A .. 13.06 |========================================= B .. 12.38 |======================================= BB . 21.38 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A .. 14.69 |========================================= B .. 14.17 |======================================= BB . 24.23 |=================================================================== Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 13.96 |======================================== B .. 13.48 |====================================== BB . 23.51 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 37.70 |========================================== B .. 37.58 |========================================== BB . 60.13 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 49.90 |================================================================== B .. 50.04 |================================================================== BB . 51.04 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.39 |=================================================================== B .. 3.37 |=================================================================== BB . 3.44 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time Seconds < Lower Is Better A .. 24.03 |================================================= B .. 22.78 |=============================================== BB . 32.59 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time Seconds < Lower Is Better A .. 24.36 |======================================= B .. 24.32 |====================================== BB . 42.34 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time Seconds < Lower Is Better A .. 27.76 |========================================== B .. 26.79 |======================================== BB . 44.56 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 26.27 |====================================== B .. 28.44 |========================================== BB . 45.78 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time Seconds < Lower Is Better A .. 36.70 |======================================== B .. 37.28 |========================================= BB . 60.83 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Seconds < Lower Is Better A .. 50.27 |================================================================== B .. 50.07 |================================================================= BB . 51.41 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better A .. 3.36 |================================================================== B .. 3.44 |==================================================================== BB . 3.44 |==================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time Seconds < Lower Is Better A .. 23.46 |=============================================== B .. 22.26 |============================================= BB . 33.39 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time Seconds < Lower Is Better A .. 23.65 |====================================== B .. 22.95 |===================================== BB . 41.21 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time Seconds < Lower Is Better A .. 26.80 |======================================== B .. 26.47 |======================================== BB . 44.62 |=================================================================== Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time Seconds < Lower Is Better A .. 26.03 |========================================= B .. 25.39 |======================================== BB . 42.82 |===================================================================