3990X spark AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2208052-NE-3990XSPAR25&grs&sor .
3990X spark Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution A B C AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads) Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) AMD Starship/Matisse 128GB Samsung SSD 970 EVO Plus 500GB AMD Radeon RX 5700 8GB (1750/875MHz) AMD Navi 10 HDMI Audio DELL P2415Q Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 22.04 5.19.0-051900rc7-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47) 1.2.204 GCC 11.2.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8301039 Java Details - OpenJDK Runtime Environment (build 11.0.15+10-Ubuntu-0ubuntu0.22.04.1) Python Details - Python 3.10.4 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
3990X spark spark: 1000000 - 2000 - Broadcast Inner Join Test Time spark: 1000000 - 500 - Broadcast Inner Join Test Time spark: 1000000 - 1000 - Repartition Test Time spark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 500 - Repartition Test Time spark: 40000000 - 1000 - Group By Test Time spark: 20000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 100 - Inner Join Test Time spark: 40000000 - 500 - Group By Test Time spark: 1000000 - 1000 - Broadcast Inner Join Test Time spark: 20000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 100 - Group By Test Time spark: 1000000 - 2000 - Inner Join Test Time spark: 1000000 - 100 - SHA-512 Benchmark Time spark: 10000000 - 2000 - Broadcast Inner Join Test Time spark: 1000000 - 100 - Broadcast Inner Join Test Time spark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 1000 - Group By Test Time spark: 20000000 - 1000 - Inner Join Test Time spark: 20000000 - 2000 - Group By Test Time spark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 20000000 - 500 - Group By Test Time spark: 10000000 - 1000 - Repartition Test Time spark: 20000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 100 - Inner Join Test Time spark: 10000000 - 1000 - Broadcast Inner Join Test Time spark: 40000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 500 - SHA-512 Benchmark Time spark: 20000000 - 2000 - Repartition Test Time spark: 40000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 100 - SHA-512 Benchmark Time spark: 40000000 - 2000 - Group By Test Time spark: 40000000 - 1000 - Inner Join Test Time spark: 20000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 20000000 - 100 - Group By Test Time spark: 40000000 - 500 - Broadcast Inner Join Test Time spark: 1000000 - 100 - Calculate Pi Benchmark spark: 10000000 - 100 - Repartition Test Time spark: 10000000 - 1000 - Group By Test Time spark: 10000000 - 1000 - Inner Join Test Time spark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 2000 - Inner Join Test Time spark: 20000000 - 500 - Repartition Test Time spark: 20000000 - 500 - Inner Join Test Time spark: 40000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 20000000 - 2000 - Broadcast Inner Join Test Time spark: 20000000 - 100 - Broadcast Inner Join Test Time spark: 10000000 - 500 - Broadcast Inner Join Test Time spark: 1000000 - 100 - Repartition Test Time spark: 1000000 - 2000 - Group By Test Time spark: 1000000 - 1000 - Inner Join Test Time spark: 40000000 - 500 - Calculate Pi Benchmark spark: 40000000 - 100 - Calculate Pi Benchmark spark: 20000000 - 2000 - Inner Join Test Time spark: 20000000 - 1000 - Repartition Test Time spark: 20000000 - 500 - Calculate Pi Benchmark spark: 10000000 - 500 - Calculate Pi Benchmark spark: 40000000 - 2000 - Broadcast Inner Join Test Time spark: 20000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 500 - SHA-512 Benchmark Time spark: 40000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 100 - Group By Test Time spark: 1000000 - 500 - Inner Join Test Time spark: 20000000 - 500 - SHA-512 Benchmark Time spark: 20000000 - 100 - Repartition Test Time spark: 40000000 - 2000 - Inner Join Test Time spark: 20000000 - 100 - Inner Join Test Time spark: 10000000 - 500 - Inner Join Test Time spark: 10000000 - 2000 - Repartition Test Time spark: 10000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 2000 - Group By Test Time spark: 40000000 - 500 - Inner Join Test Time spark: 40000000 - 1000 - SHA-512 Benchmark Time spark: 20000000 - 1000 - Calculate Pi Benchmark spark: 1000000 - 1000 - Calculate Pi Benchmark spark: 20000000 - 100 - SHA-512 Benchmark Time spark: 1000000 - 2000 - Calculate Pi Benchmark spark: 20000000 - 1000 - Group By Test Time spark: 10000000 - 100 - Calculate Pi Benchmark spark: 40000000 - 100 - Group By Test Time spark: 1000000 - 500 - Calculate Pi Benchmark spark: 20000000 - 100 - Calculate Pi Benchmark spark: 40000000 - 500 - Repartition Test Time spark: 10000000 - 2000 - Calculate Pi Benchmark spark: 10000000 - 1000 - Calculate Pi Benchmark spark: 10000000 - 500 - Repartition Test Time spark: 40000000 - 2000 - Calculate Pi Benchmark spark: 40000000 - 100 - SHA-512 Benchmark Time spark: 1000000 - 2000 - SHA-512 Benchmark Time spark: 20000000 - 2000 - SHA-512 Benchmark Time spark: 1000000 - 2000 - Repartition Test Time spark: 20000000 - 500 - Broadcast Inner Join Test Time spark: 20000000 - 1000 - Broadcast Inner Join Test Time spark: 40000000 - 1000 - Broadcast Inner Join Test Time spark: 40000000 - 2000 - SHA-512 Benchmark Time spark: 40000000 - 500 - SHA-512 Benchmark Time spark: 40000000 - 1000 - Repartition Test Time spark: 40000000 - 1000 - Calculate Pi Benchmark spark: 40000000 - 100 - Inner Join Test Time spark: 10000000 - 2000 - SHA-512 Benchmark Time spark: 40000000 - 2000 - Repartition Test Time spark: 10000000 - 500 - Group By Test Time spark: 40000000 - 100 - Broadcast Inner Join Test Time spark: 1000000 - 500 - Group By Test Time spark: 10000000 - 100 - Broadcast Inner Join Test Time spark: 40000000 - 100 - Repartition Test Time spark: 20000000 - 2000 - Calculate Pi Benchmark A B C 3.44108896 2.513151011 3.113442336 2.483052817 2.67 2.59 2.937488354 31.594366082 2.60 2.519010205 31.43642292 2.387009284 2.68943648 5.933072529 3.759185306 4.280670733 7.532539716 1.753881637 2.694834358 6.767080689 13.373576024 15.511465983 2.543826452 16.15063202 6.82 2.65 6.99 7.24 2.67 4.563995288 12.220676194 2.74 11.654840077 30.7287676 25.32970047 2.651130459 2.548499025 14.483154816 22.8055143 36.248622694 6.50 10.317818231 8.139453773 2.5146504 8.61 11.672443075 14.380601898 2.66 4.805359865 2.500858068 13.061305279 10.390551785 6.817877262 2.48582267 7.494374775 3.063892567 39.370876202 37.754295991 14.312660921 12.250536887 37.766682326 37.525136854 23.452444768 20.811280989 12.169652474 2.87 9.436098217 3.213155782 20.561849979 10.950903385 25.004226788 12.297972356 7.716858121 7.53074451 12.436763579 10.367283277 25.018874812 35.968807861 39.006547442 37.34716388 19.53858484 37.993649184 17.26379455 38.846312796 24.066146376 37.314599171 38.042122756 21.195916314 38.690406693 38.273600804 7.203962219 40.718631346 35.961485202 5.013305259 20.408405356 3.250958149 12.030512224 12.683783008 23.862663014 36.662652406 37.144937876 21.869024135 39.429906805 23.966626422 12.309031473 22.287631629 10.385351623 21.81621909 6.990199363 5.839089057 21.029863039 39.941276014 2.61 2.00 3.687104262 2.680850447 2.56858027 3.012985716 3.34 28.510656365 2.73 2.39467556 28.86457989 2.15 2.85 6.30 3.52 4.61 7.804257066 1.618939771 2.64 7.347205305 14.503284852 16.79 2.56 17.33831513 7.35 2.61 7.05 7.25 2.87 4.816485627 12.790569095 2.858828635 11.351640225 31.613703397 23.809158684 2.70 2.68 14.329520764 22.575629175 38.470876514 6.89 10.924768396 7.85 2.54 8.15 12.322506186 13.68621488 2.60 4.73 2.59 13.236549023 10.914900954 6.78 2.61 7.14 3.21 41.234760347 39.540303217 13.92 12.642395959 39.467979209 39.174491631 24.482603475 20.784366843 12.592860811 2.89 9.50 3.115619915 20.247146294 11.381130877 24.99 12.746875966 7.89 7.26 11.998314487 10.729555829 24.174249262 36.46 40.34 38.618365802 18.999681931 38.78677881 16.921223701 39.596501121 23.89407389 38.39893213 39.109839583 21.735012675 39.755258173 39.262330407 7.032123257 39.841065609 36.374094776 5.112937033 20.80 3.24 12.259419799 12.908223987 23.600356122 37.302670511 36.597600107 21.925475969 40.031265481 24.321995272 12.40958455 22.608170584 10.272378898 21.611806716 6.97 5.79 21.11486967 39.77 2.82 2.00 3.09 2.92 3.01 2.93 3.07 27.833616147 2.95 2.70 32.29 2.33 2.98 6.51 3.859701456 4.68 8.22 1.76 2.48 6.93 14.05 16.48 2.75 16.085284129 7.06 2.81 7.52 6.74 2.686635946 4.90 11.94 2.93 10.92 32.79 24.283844472 2.82 2.71 13.63 23.97 37.05 6.54 10.47 8.31 2.66 8.39 11.95 13.630398832 2.74 4.56 2.63 13.731127289 10.741352768 7.12 2.609953223 7.40 3.21 39.45 39.155044018 14.572376889 12.09 38.03 37.79 24.18 19.96 12.08 2.99 9.13 3.24 21.05 11.073934881 25.955727011 12.772232125 7.60 7.31 12.12 10.70 24.30293161 37.21 39.76 38.37 19.641329905 37.590725537 16.74 38.40 23.37 38.02 38.96 21.79 38.866531873 39.043305039 7.11 40.01 35.657478546 5.03 20.48770815 3.19 12.24 12.89258197 23.448286519 37.062007426 36.52 21.59 39.669981591 23.99 12.49 22.50 10.241372937 21.52 6.922055383 5.84 20.984226753 39.70 OpenBenchmarking.org
Apache Spark Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time B C A 0.7742 1.5484 2.3226 3.0968 3.871 2.61000000 2.82000000 3.44108896
Apache Spark Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time B C A 0.5655 1.131 1.6965 2.262 2.8275 2.000000000 2.000000000 2.513151011
Apache Spark Row Count: 1000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time C A B 0.8296 1.6592 2.4888 3.3184 4.148 3.090000000 3.113442336 3.687104262
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe A B C 0.657 1.314 1.971 2.628 3.285 2.483052817 2.680850447 2.920000000
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe B A C 0.6773 1.3546 2.0319 2.7092 3.3865 2.56858027 2.67000000 3.01000000
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe A C B 0.6779 1.3558 2.0337 2.7116 3.3895 2.590000000 2.930000000 3.012985716
Apache Spark Row Count: 1000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time A C B 0.7515 1.503 2.2545 3.006 3.7575 2.937488354 3.070000000 3.340000000
Apache Spark Row Count: 40000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time C B A 7 14 21 28 35 27.83 28.51 31.59
Apache Spark Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe A B C 0.6638 1.3276 1.9914 2.6552 3.319 2.60 2.73 2.95
Apache Spark Row Count: 1000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time B A C 0.6075 1.215 1.8225 2.43 3.0375 2.394675560 2.519010205 2.700000000
Apache Spark Row Count: 40000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time B A C 7 14 21 28 35 28.86 31.44 32.29
Apache Spark Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time B C A 0.5371 1.0742 1.6113 2.1484 2.6855 2.150000000 2.330000000 2.387009284
Apache Spark Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe A B C 0.6705 1.341 2.0115 2.682 3.3525 2.68943648 2.85000000 2.98000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time A B C 2 4 6 8 10 5.933072529 6.300000000 6.510000000
Apache Spark Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time B A C 0.8684 1.7368 2.6052 3.4736 4.342 3.520000000 3.759185306 3.859701456
Apache Spark Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time A B C 1.053 2.106 3.159 4.212 5.265 4.280670733 4.610000000 4.680000000
Apache Spark Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time A B C 2 4 6 8 10 7.532539716 7.804257066 8.220000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time B A C 0.396 0.792 1.188 1.584 1.98 1.618939771 1.753881637 1.760000000
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe C B A 0.6063 1.2126 1.8189 2.4252 3.0315 2.480000000 2.640000000 2.694834358
Apache Spark Row Count: 1000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time A C B 2 4 6 8 10 6.767080689 6.930000000 7.347205305
Apache Spark Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time A C B 4 8 12 16 20 13.37 14.05 14.50
Apache Spark Row Count: 20000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time A C B 4 8 12 16 20 15.51 16.48 16.79
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe A B C 0.6188 1.2376 1.8564 2.4752 3.094 2.543826452 2.560000000 2.750000000
Apache Spark Row Count: 20000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time C A B 4 8 12 16 20 16.09 16.15 17.34
Apache Spark Row Count: 10000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time A C B 2 4 6 8 10 6.82 7.06 7.35
Apache Spark Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe B A C 0.6323 1.2646 1.8969 2.5292 3.1615 2.61 2.65 2.81
Apache Spark Row Count: 10000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time A B C 2 4 6 8 10 6.99 7.05 7.52
Apache Spark Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time C A B 2 4 6 8 10 6.74 7.24 7.25
Apache Spark Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe A C B 0.6458 1.2916 1.9374 2.5832 3.229 2.670000000 2.686635946 2.870000000
Apache Spark Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time A B C 1.1025 2.205 3.3075 4.41 5.5125 4.563995288 4.816485627 4.900000000
Apache Spark Row Count: 20000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time C A B 3 6 9 12 15 11.94 12.22 12.79
Apache Spark Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe A B C 0.6593 1.3186 1.9779 2.6372 3.2965 2.740000000 2.858828635 2.930000000
Apache Spark Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time C B A 3 6 9 12 15 10.92 11.35 11.65
Apache Spark Row Count: 40000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time A B C 8 16 24 32 40 30.73 31.61 32.79
Apache Spark Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time B C A 6 12 18 24 30 23.81 24.28 25.33
Apache Spark Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe A B C 0.6345 1.269 1.9035 2.538 3.1725 2.651130459 2.700000000 2.820000000
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe A B C 0.6098 1.2196 1.8294 2.4392 3.049 2.548499025 2.680000000 2.710000000
Apache Spark Row Count: 20000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time C B A 4 8 12 16 20 13.63 14.33 14.48
Apache Spark Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time B A C 6 12 18 24 30 22.58 22.81 23.97
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark A C B 9 18 27 36 45 36.25 37.05 38.47
Apache Spark Row Count: 10000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time A C B 2 4 6 8 10 6.50 6.54 6.89
Apache Spark Row Count: 10000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time A C B 3 6 9 12 15 10.32 10.47 10.92
Apache Spark Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time B A C 2 4 6 8 10 7.850000000 8.139453773 8.310000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe A B C 0.5985 1.197 1.7955 2.394 2.9925 2.5146504 2.5400000 2.6600000
Apache Spark Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time B C A 2 4 6 8 10 8.15 8.39 8.61
Apache Spark Row Count: 20000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time A C B 3 6 9 12 15 11.67 11.95 12.32
Apache Spark Row Count: 20000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time C B A 4 8 12 16 20 13.63 13.69 14.38
Apache Spark Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe B A C 0.6165 1.233 1.8495 2.466 3.0825 2.60 2.66 2.74
Apache Spark Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time C B A 1.0812 2.1624 3.2436 4.3248 5.406 4.560000000 4.730000000 4.805359865
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe A B C 0.5918 1.1836 1.7754 2.3672 2.959 2.500858068 2.590000000 2.630000000
Apache Spark Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time A B C 4 8 12 16 20 13.06 13.24 13.73
Apache Spark Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time A C B 3 6 9 12 15 10.39 10.74 10.91
Apache Spark Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time B A C 2 4 6 8 10 6.780000000 6.817877262 7.120000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time A C B 0.5873 1.1746 1.7619 2.3492 2.9365 2.485822670 2.609953223 2.610000000
Apache Spark Row Count: 1000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time B C A 2 4 6 8 10 7.140000000 7.400000000 7.494374775
Apache Spark Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time A B C 0.7223 1.4446 2.1669 2.8892 3.6115 3.063892567 3.210000000 3.210000000
Apache Spark Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark A C B 9 18 27 36 45 39.37 39.45 41.23
Apache Spark Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark A C B 9 18 27 36 45 37.75 39.16 39.54
Apache Spark Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time B A C 4 8 12 16 20 13.92 14.31 14.57
Apache Spark Row Count: 20000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time C A B 3 6 9 12 15 12.09 12.25 12.64
Apache Spark Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark A C B 9 18 27 36 45 37.77 38.03 39.47
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark A C B 9 18 27 36 45 37.53 37.79 39.17
Apache Spark Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time A C B 6 12 18 24 30 23.45 24.18 24.48
Apache Spark Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time C B A 5 10 15 20 25 19.96 20.78 20.81
Apache Spark Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time C A B 3 6 9 12 15 12.08 12.17 12.59
Apache Spark Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe A B C 0.6728 1.3456 2.0184 2.6912 3.364 2.87 2.89 2.99
Apache Spark Row Count: 10000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time C A B 3 6 9 12 15 9.130000000 9.436098217 9.500000000
Apache Spark Row Count: 1000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time B A C 0.729 1.458 2.187 2.916 3.645 3.115619915 3.213155782 3.240000000
Apache Spark Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time B A C 5 10 15 20 25 20.25 20.56 21.05
Apache Spark Row Count: 20000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time A C B 3 6 9 12 15 10.95 11.07 11.38
Apache Spark Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time B A C 6 12 18 24 30 24.99 25.00 25.96
Apache Spark Row Count: 20000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time A B C 3 6 9 12 15 12.30 12.75 12.77
Apache Spark Row Count: 10000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time C A B 2 4 6 8 10 7.600000000 7.716858121 7.890000000
Apache Spark Row Count: 10000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time B C A 2 4 6 8 10 7.26000000 7.31000000 7.53074451
Apache Spark Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time B C A 3 6 9 12 15 12.00 12.12 12.44
Apache Spark Row Count: 10000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time A C B 3 6 9 12 15 10.37 10.70 10.73
Apache Spark Row Count: 40000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time B C A 6 12 18 24 30 24.17 24.30 25.02
Apache Spark Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time A B C 9 18 27 36 45 35.97 36.46 37.21
Apache Spark Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark A C B 9 18 27 36 45 39.01 39.76 40.34
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark A C B 9 18 27 36 45 37.35 38.37 38.62
Apache Spark Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time B A C 5 10 15 20 25 19.00 19.54 19.64
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark C A B 9 18 27 36 45 37.59 37.99 38.79
Apache Spark Row Count: 20000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time C B A 4 8 12 16 20 16.74 16.92 17.26
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark C A B 9 18 27 36 45 38.40 38.85 39.60
Apache Spark Row Count: 40000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time C B A 6 12 18 24 30 23.37 23.89 24.07
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark A C B 9 18 27 36 45 37.31 38.02 38.40
Apache Spark Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark A C B 9 18 27 36 45 38.04 38.96 39.11
Apache Spark Row Count: 40000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time A B C 5 10 15 20 25 21.20 21.74 21.79
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark A C B 9 18 27 36 45 38.69 38.87 39.76
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark A C B 9 18 27 36 45 38.27 39.04 39.26
Apache Spark Row Count: 10000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time B C A 2 4 6 8 10 7.032123257 7.110000000 7.203962219
Apache Spark Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark B C A 9 18 27 36 45 39.84 40.01 40.72
Apache Spark Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time C A B 8 16 24 32 40 35.66 35.96 36.37
Apache Spark Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time A C B 1.1504 2.3008 3.4512 4.6016 5.752 5.013305259 5.030000000 5.112937033
Apache Spark Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time A C B 5 10 15 20 25 20.41 20.49 20.80
Apache Spark Row Count: 1000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time C B A 0.7315 1.463 2.1945 2.926 3.6575 3.190000000 3.240000000 3.250958149
Apache Spark Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time A C B 3 6 9 12 15 12.03 12.24 12.26
Apache Spark Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time A C B 3 6 9 12 15 12.68 12.89 12.91
Apache Spark Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time C B A 6 12 18 24 30 23.45 23.60 23.86
Apache Spark Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time A C B 9 18 27 36 45 36.66 37.06 37.30
Apache Spark Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time C B A 9 18 27 36 45 36.52 36.60 37.14
Apache Spark Row Count: 40000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time C A B 5 10 15 20 25 21.59 21.87 21.93
Apache Spark Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark A C B 9 18 27 36 45 39.43 39.67 40.03
Apache Spark Row Count: 40000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time A C B 6 12 18 24 30 23.97 23.99 24.32
Apache Spark Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time A B C 3 6 9 12 15 12.31 12.41 12.49
Apache Spark Row Count: 40000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time A C B 5 10 15 20 25 22.29 22.50 22.61
Apache Spark Row Count: 10000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time C B A 3 6 9 12 15 10.24 10.27 10.39
Apache Spark Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time C B A 5 10 15 20 25 21.52 21.61 21.82
Apache Spark Row Count: 1000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time C B A 2 4 6 8 10 6.922055383 6.970000000 6.990199363
Apache Spark Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time B A C 1.314 2.628 3.942 5.256 6.57 5.790000000 5.839089057 5.840000000
Apache Spark Row Count: 40000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time C A B 5 10 15 20 25 20.98 21.03 21.11
Apache Spark Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark C B A 9 18 27 36 45 39.70 39.77 39.94
Phoronix Test Suite v10.8.4