apache spark 5800X3D AMD Ryzen 7 5800X3D 8-Core testing with a ASUS ROG CROSSHAIR VIII HERO (4201 BIOS) and Gigabyte AMD Radeon RX 6600 8GB on Ubuntu 22.04 via the Phoronix Test Suite. ,,"A","B","C" Processor,,AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads),AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads),AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads) Motherboard,,ASUS ROG CROSSHAIR VIII HERO (4201 BIOS),ASUS ROG CROSSHAIR VIII HERO (4201 BIOS),ASUS ROG CROSSHAIR VIII HERO (4201 BIOS) Chipset,,AMD Starship/Matisse,AMD Starship/Matisse,AMD Starship/Matisse Memory,,32GB,32GB,32GB Disk,,1000GB Western Digital WDS100T1X0E-00AFY0,1000GB Western Digital WDS100T1X0E-00AFY0,1000GB Western Digital WDS100T1X0E-00AFY0 Graphics,,Gigabyte AMD Radeon RX 6600 8GB (2750/875MHz),Gigabyte AMD Radeon RX 6600 8GB (2750/875MHz),Gigabyte AMD Radeon RX 6600 8GB (2750/875MHz) Audio,,AMD Navi 21 HDMI Audio,AMD Navi 21 HDMI Audio,AMD Navi 21 HDMI Audio Monitor,,ASUS MG28U,ASUS MG28U,ASUS MG28U Network,,Realtek RTL8125 2.5GbE + Intel I211,Realtek RTL8125 2.5GbE + Intel I211,Realtek RTL8125 2.5GbE + Intel I211 OS,,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04 Kernel,,5.19.0-rc6-drm-next-28july (x86_64),5.19.0-rc6-drm-next-28july (x86_64),5.19.0-rc6-drm-next-28july (x86_64) Desktop,,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2 Display Server,,X Server 1.21.1.3 + Wayland,X Server 1.21.1.3 + Wayland,X Server 1.21.1.3 + Wayland OpenGL,,4.6 Mesa 22.2.0-devel (git-c6ded153d1) (LLVM 12.0.0 DRM 3.48),4.6 Mesa 22.2.0-devel (git-c6ded153d1) (LLVM 12.0.0 DRM 3.48),4.6 Mesa 22.2.0-devel (git-c6ded153d1) (LLVM 12.0.0 DRM 3.48) Vulkan,,1.3.211,1.3.211,1.3.211 Compiler,,GCC 11.2.0,GCC 11.2.0,GCC 11.2.0 File-System,,ext4,ext4,ext4 Screen Resolution,,3840x2160,3840x2160,3840x2160 ,,"A","B","C" "Apache Spark - Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time (sec)",LIB,2.91,2.88,2.84 "Apache Spark - Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark (sec)",LIB,149.348708414,148.735383131,146.52097559 "Apache Spark - Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.67,8.61,8.52 "Apache Spark - Row Count: 1000000 - Partitions: 100 - Group By Test Time (sec)",LIB,2.89,2.88,2.88 "Apache Spark - Row Count: 1000000 - Partitions: 100 - Repartition Test Time (sec)",LIB,1.90,1.93,1.96 "Apache Spark - Row Count: 1000000 - Partitions: 100 - Inner Join Test Time (sec)",LIB,1.45,1.40,1.44 "Apache Spark - Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time (sec)",LIB,1.31,1.36,1.30 "Apache Spark - Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time (sec)",LIB,3.06,3.02,3.03 "Apache Spark - Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark (sec)",LIB,150.184683924,149.134613280,148.565766046 "Apache Spark - Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.69,8.67,8.55 "Apache Spark - Row Count: 1000000 - Partitions: 500 - Group By Test Time (sec)",LIB,3.15,3.20,3.27 "Apache Spark - Row Count: 1000000 - Partitions: 500 - Repartition Test Time (sec)",LIB,1.99,1.99,2.02 "Apache Spark - Row Count: 1000000 - Partitions: 500 - Inner Join Test Time (sec)",LIB,1.63,1.63,1.62 "Apache Spark - Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time (sec)",LIB,1.48,1.45,1.38 "Apache Spark - Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time (sec)",LIB,3.17,3.19,3.14 "Apache Spark - Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark (sec)",LIB,150.409490333,149.520497364,149.529773024 "Apache Spark - Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.68,8.61,8.59 "Apache Spark - Row Count: 1000000 - Partitions: 1000 - Group By Test Time (sec)",LIB,3.42,3.43,3.36 "Apache Spark - Row Count: 1000000 - Partitions: 1000 - Repartition Test Time (sec)",LIB,2.20,2.20,2.16 "Apache Spark - Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time (sec)",LIB,1.92,1.84,1.76 "Apache Spark - Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time (sec)",LIB,1.58,1.66,1.74 "Apache Spark - Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time (sec)",LIB,3.46,3.47,3.48 "Apache Spark - Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark (sec)",LIB,150.031645092,148.583093415,149.71767697 "Apache Spark - Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.68,8.61,8.63 "Apache Spark - Row Count: 1000000 - Partitions: 2000 - Group By Test Time (sec)",LIB,3.74,3.84,3.79 "Apache Spark - Row Count: 1000000 - Partitions: 2000 - Repartition Test Time (sec)",LIB,2.50,2.46,2.54 "Apache Spark - Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time (sec)",LIB,2.32,2.36,2.50 "Apache Spark - Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time (sec)",LIB,2.02,2.05,1.94 "Apache Spark - Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time (sec)",LIB,14.539789898,14.60,14.47 "Apache Spark - Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark (sec)",LIB,149.758709975,149.564826029,149.06749502 "Apache Spark - Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.66,8.66,8.64 "Apache Spark - Row Count: 10000000 - Partitions: 100 - Group By Test Time (sec)",LIB,6.60,6.64,6.55 "Apache Spark - Row Count: 10000000 - Partitions: 100 - Repartition Test Time (sec)",LIB,9.16,9.15,8.95 "Apache Spark - Row Count: 10000000 - Partitions: 100 - Inner Join Test Time (sec)",LIB,11.340071822,11.01,10.93 "Apache Spark - Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time (sec)",LIB,11.566249356,11.28,11.54 "Apache Spark - Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time (sec)",LIB,13.94,13.97,14.07 "Apache Spark - Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark (sec)",LIB,148.982085231,148.915757535,148.055891825 "Apache Spark - Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.69,8.68,8.67 "Apache Spark - Row Count: 10000000 - Partitions: 500 - Group By Test Time (sec)",LIB,6.75,6.82,6.66 "Apache Spark - Row Count: 10000000 - Partitions: 500 - Repartition Test Time (sec)",LIB,8.94,9.03,8.83 "Apache Spark - Row Count: 10000000 - Partitions: 500 - Inner Join Test Time (sec)",LIB,10.320102526,10.48,10.14 "Apache Spark - Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time (sec)",LIB,10.589748727,10.11,10.24 "Apache Spark - Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time (sec)",LIB,27.22,27.24,27.29 "Apache Spark - Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark (sec)",LIB,149.362186051,148.786767111,149.245823899 "Apache Spark - Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.67,8.59,8.71 "Apache Spark - Row Count: 20000000 - Partitions: 100 - Group By Test Time (sec)",LIB,10.65,10.50,10.60 "Apache Spark - Row Count: 20000000 - Partitions: 100 - Repartition Test Time (sec)",LIB,17.908074200,17.81,18.05 "Apache Spark - Row Count: 20000000 - Partitions: 100 - Inner Join Test Time (sec)",LIB,21.82,22.08,22.09 "Apache Spark - Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time (sec)",LIB,22.08,22.27,22.650420462 "Apache Spark - Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time (sec)",LIB,25.771477402,25.98,25.62 "Apache Spark - Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark (sec)",LIB,148.224458268,149.139980735,148.939367323 "Apache Spark - Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.60,8.60,8.57 "Apache Spark - Row Count: 20000000 - Partitions: 500 - Group By Test Time (sec)",LIB,10.118608339,10.05,10.04 "Apache Spark - Row Count: 20000000 - Partitions: 500 - Repartition Test Time (sec)",LIB,16.94,17.02,17.493210745 "Apache Spark - Row Count: 20000000 - Partitions: 500 - Inner Join Test Time (sec)",LIB,20.035527670,19.77,21.21 "Apache Spark - Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time (sec)",LIB,20.35,20.05,19.94 "Apache Spark - Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time (sec)",LIB,49.41,49.28,49.53 "Apache Spark - Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark (sec)",LIB,149.227508787,148.597175671,149.610888179 "Apache Spark - Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.63,8.63,8.65 "Apache Spark - Row Count: 40000000 - Partitions: 100 - Group By Test Time (sec)",LIB,27.362051435,27.28,27.382169172 "Apache Spark - Row Count: 40000000 - Partitions: 100 - Repartition Test Time (sec)",LIB,33.933058393,34.41,34.74 "Apache Spark - Row Count: 40000000 - Partitions: 100 - Inner Join Test Time (sec)",LIB,40.00,39.87,41.98 "Apache Spark - Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time (sec)",LIB,40.78,40.14,39.621362405 "Apache Spark - Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time (sec)",LIB,50.13,49.86,48.84 "Apache Spark - Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark (sec)",LIB,151.330983793,149.128695060,147.715180363 "Apache Spark - Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.59,8.61,8.58 "Apache Spark - Row Count: 40000000 - Partitions: 500 - Group By Test Time (sec)",LIB,23.97,23.49,23.04 "Apache Spark - Row Count: 40000000 - Partitions: 500 - Repartition Test Time (sec)",LIB,33.546966500,33.85,34.11 "Apache Spark - Row Count: 40000000 - Partitions: 500 - Inner Join Test Time (sec)",LIB,39.55,40.14,40.17 "Apache Spark - Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time (sec)",LIB,40.32,40.760680072,40.291389364 "Apache Spark - Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time (sec)",LIB,13.97,13.89,14.07 "Apache Spark - Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark (sec)",LIB,148.548472344,148.532731450,148.988566083 "Apache Spark - Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.49,8.54,8.61 "Apache Spark - Row Count: 10000000 - Partitions: 1000 - Group By Test Time (sec)",LIB,6.89,6.77,6.86 "Apache Spark - Row Count: 10000000 - Partitions: 1000 - Repartition Test Time (sec)",LIB,9.05,9.01,8.90 "Apache Spark - Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time (sec)",LIB,10.79,11.02,10.51 "Apache Spark - Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time (sec)",LIB,10.65,10.60,10.08 "Apache Spark - Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time (sec)",LIB,14.15,14.12,14.14 "Apache Spark - Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark (sec)",LIB,148.548505705,149.183387153,150.275810804 "Apache Spark - Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.58,8.57,8.687892725 "Apache Spark - Row Count: 10000000 - Partitions: 2000 - Group By Test Time (sec)",LIB,7.03,7.14,7.04 "Apache Spark - Row Count: 10000000 - Partitions: 2000 - Repartition Test Time (sec)",LIB,9.34,9.22,9.24 "Apache Spark - Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time (sec)",LIB,11.20,11.21,11.66 "Apache Spark - Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time (sec)",LIB,10.60,10.56,10.411906333 "Apache Spark - Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time (sec)",LIB,25.55,25.53,25.60 "Apache Spark - Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark (sec)",LIB,149.230168484,147.914605982,149.292751295 "Apache Spark - Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.62,8.58,8.54 "Apache Spark - Row Count: 20000000 - Partitions: 1000 - Group By Test Time (sec)",LIB,10.25,10.16,10.03 "Apache Spark - Row Count: 20000000 - Partitions: 1000 - Repartition Test Time (sec)",LIB,17.03,17.09,17.01 "Apache Spark - Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time (sec)",LIB,19.97,20.33,20.49 "Apache Spark - Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time (sec)",LIB,19.87,20.66,21.08 "Apache Spark - Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time (sec)",LIB,25.70,25.76,25.72 "Apache Spark - Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark (sec)",LIB,148.853580559,148.300590012,149.847002868 "Apache Spark - Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.64,8.60,8.59 "Apache Spark - Row Count: 20000000 - Partitions: 2000 - Group By Test Time (sec)",LIB,10.25,10.32,10.41 "Apache Spark - Row Count: 20000000 - Partitions: 2000 - Repartition Test Time (sec)",LIB,17.52,17.81,17.44 "Apache Spark - Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time (sec)",LIB,20.79,20.72,20.50 "Apache Spark - Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time (sec)",LIB,20.01,19.87,19.31 "Apache Spark - Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time (sec)",LIB,49.63,49.95,49.84 "Apache Spark - Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark (sec)",LIB,149.450658423,148.664434137,151.941134869 "Apache Spark - Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.61,8.62,8.56 "Apache Spark - Row Count: 40000000 - Partitions: 1000 - Group By Test Time (sec)",LIB,22.89,23.24,23.18 "Apache Spark - Row Count: 40000000 - Partitions: 1000 - Repartition Test Time (sec)",LIB,34.50,34.09,34.62 "Apache Spark - Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time (sec)",LIB,39.60,40.50,39.899100315 "Apache Spark - Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time (sec)",LIB,40.993090142,41.01,41.20 "Apache Spark - Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time (sec)",LIB,50.33,51.35,50.12 "Apache Spark - Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark (sec)",LIB,148.601893741,148.502716195,147.981380284 "Apache Spark - Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe (sec)",LIB,8.59,8.57,8.50 "Apache Spark - Row Count: 40000000 - Partitions: 2000 - Group By Test Time (sec)",LIB,23.26,22.94,23.170788559 "Apache Spark - Row Count: 40000000 - Partitions: 2000 - Repartition Test Time (sec)",LIB,34.56,33.98,33.96 "Apache Spark - Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time (sec)",LIB,40.60,39.58,39.848198836 "Apache Spark - Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time (sec)",LIB,41.55,40.71,41.18