apache spark 5900HX

AMD Ryzen 9 5900HX testing with a ASUS G513QY v1.0 (G513QY.318 BIOS) and ASUS AMD Cezanne 512MB on Ubuntu 22.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2208048-PTS-APACHESP92&grs.

apache spark 5900HXProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionABCDAMD Ryzen 9 5900HX @ 3.30GHz (8 Cores / 16 Threads)ASUS G513QY v1.0 (G513QY.318 BIOS)AMD Renoir/Cezanne16GB512GB SAMSUNG MZVLQ512HBLU-00B00 + 15GB Ultra USB 3.0ASUS AMD Cezanne 512MB (2500/1000MHz)AMD Navi 21/23LQ156M1JW25Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCIUbuntu 22.105.15.0-27-generic (x86_64)GNOME Shell 42.3.1X Server + Wayland4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.42)1.3.211GCC 11.3.0ext41920x1080ASUS AMD Cezanne 512MBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseProcessor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - Platform Profile: balanced - CPU Microcode: 0xa50000c - ACPI Profile: balancedJava Details- OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu1)Python Details- Python 3.10.5Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

apache spark 5900HXspark: 1000000 - 1000 - SHA-512 Benchmark Timespark: 1000000 - 2000 - Broadcast Inner Join Test Timespark: 20000000 - 100 - Inner Join Test Timespark: 20000000 - 100 - Group By Test Timespark: 10000000 - 500 - Group By Test Timespark: 1000000 - 2000 - Inner Join Test Timespark: 1000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 2000 - Group By Test Timespark: 1000000 - 1000 - Repartition Test Timespark: 20000000 - 500 - Group By Test Timespark: 1000000 - 100 - Broadcast Inner Join Test Timespark: 20000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 500 - Group By Test Timespark: 10000000 - 100 - Inner Join Test Timespark: 10000000 - 100 - Group By Test Timespark: 10000000 - 1000 - Group By Test Timespark: 40000000 - 500 - Inner Join Test Timespark: 1000000 - 500 - SHA-512 Benchmark Timespark: 40000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - Inner Join Test Timespark: 1000000 - 2000 - SHA-512 Benchmark Timespark: 1000000 - 500 - Inner Join Test Timespark: 1000000 - 1000 - Inner Join Test Timespark: 40000000 - 1000 - Calculate Pi Benchmarkspark: 1000000 - 100 - Group By Test Timespark: 40000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 1000 - Group By Test Timespark: 40000000 - 1000 - Inner Join Test Timespark: 10000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 2000 - Repartition Test Timespark: 20000000 - 100 - Repartition Test Timespark: 1000000 - 100 - SHA-512 Benchmark Timespark: 10000000 - 500 - Repartition Test Timespark: 20000000 - 2000 - Group By Test Timespark: 40000000 - 2000 - Inner Join Test Timespark: 10000000 - 100 - SHA-512 Benchmark Timespark: 20000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 500 - Repartition Test Timespark: 1000000 - 1000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - Repartition Test Timespark: 40000000 - 100 - Repartition Test Timespark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 500 - SHA-512 Benchmark Timespark: 10000000 - 500 - Calculate Pi Benchmarkspark: 1000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 500 - Calculate Pi Benchmarkspark: 10000000 - 500 - Inner Join Test Timespark: 20000000 - 100 - SHA-512 Benchmark Timespark: 20000000 - 2000 - Inner Join Test Timespark: 20000000 - 1000 - Broadcast Inner Join Test Timespark: 10000000 - 1000 - Repartition Test Timespark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 2000 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 1000 - Group By Test Timespark: 10000000 - 1000 - Inner Join Test Timespark: 1000000 - 500 - Calculate Pi Benchmarkspark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Inner Join Test Timespark: 40000000 - 1000 - Broadcast Inner Join Test Timespark: 40000000 - 2000 - Group By Test Timespark: 40000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - Inner Join Test Timespark: 40000000 - 500 - Repartition Test Timespark: 40000000 - 2000 - Repartition Test Timespark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Repartition Test Timespark: 40000000 - 500 - SHA-512 Benchmark Timespark: 20000000 - 500 - Repartition Test Timespark: 40000000 - 1000 - Group By Test Timespark: 40000000 - 1000 - Repartition Test Timespark: 10000000 - 100 - Calculate Pi Benchmarkspark: 20000000 - 500 - Broadcast Inner Join Test Timespark: 20000000 - 500 - Inner Join Test Timespark: 20000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - SHA-512 Benchmark Timespark: 10000000 - 2000 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 40000000 - 100 - Calculate Pi Benchmarkspark: 40000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 100 - Calculate Pi Benchmarkspark: 20000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 2000 - Repartition Test Timespark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - Group By Test Timespark: 10000000 - 100 - Repartition Test Timespark: 40000000 - 2000 - SHA-512 Benchmark Timespark: 10000000 - 2000 - SHA-512 Benchmark Timespark: 40000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - SHA-512 Benchmark Timespark: 20000000 - 1000 - Calculate Pi Benchmarkspark: 40000000 - 100 - Broadcast Inner Join Test Timespark: 10000000 - 2000 - Calculate Pi Benchmarkspark: 10000000 - 1000 - SHA-512 Benchmark Timespark: 10000000 - 2000 - Group By Test Timespark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - Broadcast Inner Join Test Timespark: 10000000 - 1000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 1000 - SHA-512 Benchmark Timespark: 20000000 - 500 - SHA-512 Benchmark Timespark: 40000000 - 500 - Calculate Pi Benchmarkspark: 10000000 - 1000 - Broadcast Inner Join Test Timespark: 40000000 - 1000 - SHA-512 Benchmark Timespark: 40000000 - 500 - Group By Test Timespark: 10000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 1000 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Repartition Test TimeABCD4.533.4732.4814.368.854.502.285.433.3013.731.8931.974.0716.608.739.4059.914.25153.4331.775.092.653.22152.8319726283.6959.074.5460.9215.263.9828.554.0214.3414.3861.6422.488.932.93153.11372386628.1454.638.9021.95155.304388476154.901816094153.11906837215.7642.3932.3830.7214.638.8560.468.848.8214.1116.44153.0827448008.868.8217.9360.4132.978.8760.5853.9655.508.8715.3678.9027.3232.9154.58153.42082714029.4730.158.8978.8516.43153.79153.358.88152.95152.40215181828.528.808.8039.4914.4780.9322.948.8841.96153.27199343958.79153.33595905422.269.978.8431.01151.938.8041.6540.89152.9315.4479.5734.1616.092.762.282.694.723.5834.8614.779.244.482.315.613.3314.171.9833.414.1016.839.039.2962.214.42159.37749738330.615.212.703.34157.2516055143.6958.784.5562.6815.623.9529.084.1314.7114.3363.2322.749.052.94154.6227.4955.919.0522.33154.55154.26154.8515.9243.2432.2830.1414.878.9561.198.918.9413.90801015716.64154.328.918.9217.7460.2533.178.7761.0354.7556.268.8615.5779.3627.0832.7555.24154.6729.3130.378.8479.6216.25153.24153.138.90153.30152.2528.528.738.8739.69740892514.4080.2623.018.8941.95153.6803410458.70152.8636641822.169.918.7930.91152.0749862698.7741.5040.72152.40549228315.4479.4934.1716.622.892.422.884.983.7433.0213.878.694.592.415.363.2813.521.9432.284.2516.778.799.0162.444.32153.71904667830.875.022.713.27151.707638953.5660.634.4761.7315.703.9128.304.1114.3614.7063.0822.188.862.89151.04700087227.7355.168.8521.86152.485567023151.74151.75682410715.6036520742.4232.9230.5714.598.7961.508.768.7914.1416.37151.830824858.908.7817.6559.4733.468.9061.4754.5455.948.8915.4879.9527.3932.4955.02152.8329.5830.0526952988.7978.7316.381663148152.15154.7257607418.97152.48153.6628.268.818.8839.3514.3780.5622.828.8241.64152.5358.36152.3722.309.928.8330.84152.678.7641.4740.78153.00140108115.4079.4534.1217.112.692.202.864.513.7533.5213.978.904.342.305.313.1713.491.9532.804.1116.128.654.365.092.753.333.634.4215.294.0228.874.1314.3222.648.832.96152.868.8922.07152.11152.07152.4415.6942.558.888.91153.138.778.888.7727.44153.29486606429.6630.418.82152.20153.9114.4940.83320572316.472.772.262.77OpenBenchmarking.org

Apache Spark

Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark TimeABCD1.12052.2413.36154.4825.6025SE +/- 0.02, N = 3SE +/- 0.05, N = 124.534.724.984.51

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test TimeABCD0.84381.68762.53143.37524.219SE +/- 0.02, N = 3SE +/- 0.03, N = 33.473.583.743.75

Apache Spark

Row Count: 20000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Inner Join Test TimeABCD816243240SE +/- 0.79, N = 3SE +/- 0.25, N = 332.4834.8633.0233.52

Apache Spark

Row Count: 20000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Group By Test TimeABCD48121620SE +/- 0.13, N = 3SE +/- 0.33, N = 314.3614.7713.8713.97

Apache Spark

Row Count: 10000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Group By Test TimeABCD3691215SE +/- 0.04, N = 3SE +/- 0.20, N = 38.859.248.698.90

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Inner Join Test TimeABCD1.03282.06563.09844.13125.164SE +/- 0.02, N = 3SE +/- 0.07, N = 34.504.484.594.34

Apache Spark

Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test TimeABCD0.54231.08461.62692.16922.7115SE +/- 0.02, N = 3SE +/- 0.02, N = 122.282.312.412.30

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Group By Test TimeABCD1.26232.52463.78695.04926.3115SE +/- 0.02, N = 3SE +/- 0.19, N = 35.435.615.365.31

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Repartition Test TimeABCD0.74931.49862.24792.99723.7465SE +/- 0.03, N = 3SE +/- 0.02, N = 123.303.333.283.17

Apache Spark

Row Count: 20000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Group By Test TimeABCD48121620SE +/- 0.03, N = 313.7314.1713.5213.49

Apache Spark

Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test TimeABCD0.44550.8911.33651.7822.2275SE +/- 0.01, N = 3SE +/- 0.04, N = 31.891.981.941.95

Apache Spark

Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test TimeABCD816243240SE +/- 0.57, N = 3SE +/- 0.16, N = 331.9733.4132.2832.80

Apache Spark

Row Count: 1000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Group By Test TimeABCD0.95631.91262.86893.82524.7815SE +/- 0.04, N = 3SE +/- 0.03, N = 124.074.104.254.11

Apache Spark

Row Count: 10000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Inner Join Test TimeABCD48121620SE +/- 0.35, N = 3SE +/- 0.28, N = 316.6016.8316.7716.12

Apache Spark

Row Count: 10000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Group By Test TimeABCD3691215SE +/- 0.07, N = 3SE +/- 0.14, N = 38.739.038.798.65

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Group By Test TimeABC3691215SE +/- 0.10, N = 39.409.299.01

Apache Spark

Row Count: 40000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Inner Join Test TimeABC1428425670SE +/- 0.07, N = 359.9162.2162.44

Apache Spark

Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark TimeABCD0.99451.9892.98353.9784.9725SE +/- 0.04, N = 3SE +/- 0.05, N = 124.254.424.324.36

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi BenchmarkABC4080120160200SE +/- 0.66, N = 3153.43159.38153.72

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Inner Join Test TimeABC714212835SE +/- 0.80, N = 331.7730.6130.87

Apache Spark

Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark TimeABCD1.17232.34463.51694.68925.8615SE +/- 0.07, N = 3SE +/- 0.03, N = 35.095.215.025.09

Apache Spark

Row Count: 1000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Inner Join Test TimeABCD0.61881.23761.85642.47523.094SE +/- 0.01, N = 3SE +/- 0.01, N = 122.652.702.712.75

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Inner Join Test TimeABCD0.75151.5032.25453.0063.7575SE +/- 0.02, N = 3SE +/- 0.05, N = 123.223.343.273.33

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi BenchmarkABC306090120150SE +/- 0.69, N = 3152.83157.25151.71

Apache Spark

Row Count: 1000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test TimeABCD0.83031.66062.49093.32124.1515SE +/- 0.03, N = 3SE +/- 0.05, N = 33.693.693.563.63

Apache Spark

Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test TimeABC1428425670SE +/- 0.30, N = 359.0758.7860.63

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Group By Test TimeABCD1.02382.04763.07144.09525.119SE +/- 0.04, N = 3SE +/- 0.05, N = 124.544.554.474.42

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Inner Join Test TimeABC1428425670SE +/- 0.45, N = 360.9262.6861.73

Apache Spark

Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test TimeABCD48121620SE +/- 0.15, N = 3SE +/- 0.16, N = 315.2615.6215.7015.29

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Repartition Test TimeABCD0.90451.8092.71353.6184.5225SE +/- 0.01, N = 3SE +/- 0.04, N = 33.983.953.914.02

Apache Spark

Row Count: 20000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Repartition Test TimeABCD714212835SE +/- 0.35, N = 3SE +/- 0.15, N = 328.5529.0828.3028.87

Apache Spark

Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeABCD0.92931.85862.78793.71724.6465SE +/- 0.03, N = 3SE +/- 0.01, N = 34.024.134.114.13

Apache Spark

Row Count: 10000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Repartition Test TimeABCD48121620SE +/- 0.06, N = 3SE +/- 0.25, N = 314.3414.7114.3614.32

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Group By Test TimeABC48121620SE +/- 0.18, N = 314.3814.3314.70

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Inner Join Test TimeABC1428425670SE +/- 0.39, N = 361.6463.2363.08

Apache Spark

Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark TimeABCD510152025SE +/- 0.10, N = 3SE +/- 0.26, N = 322.4822.7422.1822.64

Apache Spark

Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeABCD3691215SE +/- 0.09, N = 3SE +/- 0.09, N = 38.939.058.868.83

Apache Spark

Row Count: 1000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Repartition Test TimeABCD0.6661.3321.9982.6643.33SE +/- 0.02, N = 3SE +/- 0.02, N = 122.932.942.892.96

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi BenchmarkABCD306090120150SE +/- 0.71, N = 3SE +/- 0.31, N = 12153.11154.62151.05152.86

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Repartition Test TimeABC714212835SE +/- 0.31, N = 328.1427.4927.73

Apache Spark

Row Count: 40000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Repartition Test TimeABC1326395265SE +/- 0.82, N = 354.6355.9155.16

Apache Spark

Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeABCD3691215SE +/- 0.03, N = 3SE +/- 0.14, N = 38.909.058.858.89

Apache Spark

Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark TimeABCD510152025SE +/- 0.09, N = 3SE +/- 0.16, N = 321.9522.3321.8622.07

Apache Spark

Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi BenchmarkABCD306090120150SE +/- 2.71, N = 3SE +/- 0.65, N = 3155.30154.55152.49152.11

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi BenchmarkABCD306090120150SE +/- 2.55, N = 3SE +/- 0.45, N = 3154.90154.26151.74152.07

Apache Spark

Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi BenchmarkABCD306090120150SE +/- 0.19, N = 3153.12154.85151.76152.44

Apache Spark

Row Count: 10000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Inner Join Test TimeABCD48121620SE +/- 0.06, N = 3SE +/- 0.19, N = 315.7615.9215.6015.69

Apache Spark

Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark TimeABCD1020304050SE +/- 0.01, N = 3SE +/- 0.06, N = 342.3943.2442.4242.55

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Inner Join Test TimeABC816243240SE +/- 0.17, N = 332.3832.2832.92

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test TimeABC714212835SE +/- 0.50, N = 330.7230.1430.57

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Repartition Test TimeABC48121620SE +/- 0.06, N = 314.6314.8714.59

Apache Spark

Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeABCD3691215SE +/- 0.03, N = 3SE +/- 0.04, N = 128.858.958.798.88

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test TimeABC1428425670SE +/- 0.51, N = 360.4661.1961.50

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeABCD246810SE +/- 0.02, N = 3SE +/- 0.02, N = 38.848.918.768.91

Apache Spark

Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.01, N = 38.828.948.79

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Group By Test TimeABC48121620SE +/- 0.14, N = 314.1113.9114.14

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Inner Join Test TimeABC48121620SE +/- 0.01, N = 316.4416.6416.37

Apache Spark

Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi BenchmarkABCD306090120150SE +/- 0.84, N = 3SE +/- 0.26, N = 12153.08154.32151.83153.13

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeABCD246810SE +/- 0.02, N = 3SE +/- 0.03, N = 128.868.918.908.77

Apache Spark

Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeABCD246810SE +/- 0.01, N = 3SE +/- 0.05, N = 38.828.928.788.88

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Inner Join Test TimeABC48121620SE +/- 0.07, N = 317.9317.7417.65

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test TimeABC1428425670SE +/- 0.03, N = 360.4160.2559.47

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Group By Test TimeABC816243240SE +/- 0.29, N = 332.9733.1733.46

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.02, N = 38.878.778.90

Apache Spark

Row Count: 40000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Inner Join Test TimeABC1428425670SE +/- 0.78, N = 360.5861.0361.47

Apache Spark

Row Count: 40000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Repartition Test TimeABC1224364860SE +/- 0.21, N = 353.9654.7554.54

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Repartition Test TimeABC1326395265SE +/- 0.24, N = 355.5056.2655.94

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeABCD246810SE +/- 0.02, N = 3SE +/- 0.03, N = 38.878.868.898.77

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Repartition Test TimeABC48121620SE +/- 0.03, N = 315.3615.5715.48

Apache Spark

Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark TimeABC20406080100SE +/- 0.09, N = 378.9079.3679.95

Apache Spark

Row Count: 20000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Repartition Test TimeABCD612182430SE +/- 0.03, N = 327.3227.0827.3927.44

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Group By Test TimeABC816243240SE +/- 0.30, N = 332.9132.7532.49

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Repartition Test TimeABC1224364860SE +/- 0.36, N = 354.5855.2455.02

Apache Spark

Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi BenchmarkABCD306090120150SE +/- 0.40, N = 3SE +/- 0.15, N = 3153.42154.67152.83153.29

Apache Spark

Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test TimeABCD714212835SE +/- 0.07, N = 329.4729.3129.5829.66

Apache Spark

Row Count: 20000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Inner Join Test TimeABCD714212835SE +/- 0.20, N = 330.1530.3730.0530.41

Apache Spark

Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeABCD246810SE +/- 0.02, N = 38.898.848.798.82

Apache Spark

Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark TimeABC20406080100SE +/- 0.13, N = 378.8579.6278.73

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test TimeABC48121620SE +/- 0.10, N = 316.4316.2516.38

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkABCD306090120150SE +/- 0.42, N = 3SE +/- 0.70, N = 3153.79153.24152.15152.20

Apache Spark

Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi BenchmarkABC306090120150SE +/- 0.83, N = 3153.35153.13154.73

Apache Spark

Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeABC3691215SE +/- 0.02, N = 38.888.908.97

Apache Spark

Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi BenchmarkABCD306090120150SE +/- 0.26, N = 3SE +/- 0.44, N = 3152.95153.30152.48153.91

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi BenchmarkABC306090120150SE +/- 0.32, N = 3152.40152.25153.66

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Repartition Test TimeABC714212835SE +/- 0.12, N = 328.5228.5228.26

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.03, N = 38.808.738.81

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.01, N = 38.808.878.88

Apache Spark

Row Count: 40000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Group By Test TimeABC918273645SE +/- 0.17, N = 339.4939.7039.35

Apache Spark

Row Count: 10000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Repartition Test TimeABCD48121620SE +/- 0.20, N = 3SE +/- 0.11, N = 314.4714.4014.3714.49

Apache Spark

Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark TimeABC20406080100SE +/- 0.20, N = 380.9380.2680.56

Apache Spark

Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark TimeABC612182430SE +/- 0.15, N = 322.9423.0122.82

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.05, N = 38.888.898.82

Apache Spark

Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark TimeABC1020304050SE +/- 0.13, N = 341.9641.9541.64

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi BenchmarkABC306090120150SE +/- 0.66, N = 3153.27153.68152.53

Apache Spark

Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test TimeABC1326395265SE +/- 0.96, N = 358.7958.7058.36

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi BenchmarkABC306090120150SE +/- 0.26, N = 3153.34152.86152.37

Apache Spark

Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark TimeABC510152025SE +/- 0.04, N = 322.2622.1622.30

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Group By Test TimeABC3691215SE +/- 0.11, N = 39.979.919.92

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.01, N = 38.848.798.83

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test TimeABC714212835SE +/- 0.27, N = 331.0130.9130.84

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi BenchmarkABC306090120150SE +/- 0.35, N = 3151.93152.07152.67

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.05, N = 38.808.778.76

Apache Spark

Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark TimeABC1020304050SE +/- 0.17, N = 341.6541.5041.47

Apache Spark

Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark TimeABCD918273645SE +/- 0.02, N = 340.8940.7240.7840.83

Apache Spark

Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi BenchmarkABC306090120150SE +/- 0.43, N = 3152.93152.41153.00

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test TimeABC48121620SE +/- 0.04, N = 315.4415.4415.40

Apache Spark

Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark TimeABC20406080100SE +/- 0.03, N = 379.5779.4979.45

Apache Spark

Row Count: 40000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Group By Test TimeABC816243240SE +/- 0.36, N = 334.1634.1734.12

Apache Spark

Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test TimeABCD48121620SE +/- 0.43, N = 3SE +/- 0.81, N = 316.0916.6217.1116.47

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test TimeABCD0.65031.30061.95092.60123.2515SE +/- 0.07, N = 3SE +/- 0.08, N = 122.762.892.692.77

Apache Spark

Row Count: 1000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test TimeABCD0.54451.0891.63352.1782.7225SE +/- 0.02, N = 3SE +/- 0.10, N = 32.282.422.202.26

Apache Spark

Row Count: 1000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test TimeABCD0.6481.2961.9442.5923.24SE +/- 0.04, N = 3SE +/- 0.12, N = 32.692.882.862.77

Phoronix Test Suite v10.8.4