apache spark 5900HX

AMD Ryzen 9 5900HX testing with a ASUS G513QY v1.0 (G513QY.318 BIOS) and ASUS AMD Cezanne 512MB on Ubuntu 22.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2208048-PTS-APACHESP92&grs&sor.

apache spark 5900HXProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionABCDAMD Ryzen 9 5900HX @ 3.30GHz (8 Cores / 16 Threads)ASUS G513QY v1.0 (G513QY.318 BIOS)AMD Renoir/Cezanne16GB512GB SAMSUNG MZVLQ512HBLU-00B00 + 15GB Ultra USB 3.0ASUS AMD Cezanne 512MB (2500/1000MHz)AMD Navi 21/23LQ156M1JW25Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCIUbuntu 22.105.15.0-27-generic (x86_64)GNOME Shell 42.3.1X Server + Wayland4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.42)1.3.211GCC 11.3.0ext41920x1080ASUS AMD Cezanne 512MBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseProcessor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - Platform Profile: balanced - CPU Microcode: 0xa50000c - ACPI Profile: balancedJava Details- OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu1)Python Details- Python 3.10.5Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

apache spark 5900HXspark: 1000000 - 1000 - SHA-512 Benchmark Timespark: 1000000 - 2000 - Broadcast Inner Join Test Timespark: 20000000 - 100 - Inner Join Test Timespark: 20000000 - 100 - Group By Test Timespark: 10000000 - 500 - Group By Test Timespark: 1000000 - 2000 - Inner Join Test Timespark: 1000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 2000 - Group By Test Timespark: 1000000 - 1000 - Repartition Test Timespark: 20000000 - 500 - Group By Test Timespark: 1000000 - 100 - Broadcast Inner Join Test Timespark: 20000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 500 - Group By Test Timespark: 10000000 - 100 - Inner Join Test Timespark: 10000000 - 100 - Group By Test Timespark: 10000000 - 1000 - Group By Test Timespark: 40000000 - 500 - Inner Join Test Timespark: 1000000 - 500 - SHA-512 Benchmark Timespark: 40000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - Inner Join Test Timespark: 1000000 - 2000 - SHA-512 Benchmark Timespark: 1000000 - 500 - Inner Join Test Timespark: 1000000 - 1000 - Inner Join Test Timespark: 40000000 - 1000 - Calculate Pi Benchmarkspark: 1000000 - 100 - Group By Test Timespark: 40000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 1000 - Group By Test Timespark: 40000000 - 1000 - Inner Join Test Timespark: 10000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 2000 - Repartition Test Timespark: 20000000 - 100 - Repartition Test Timespark: 1000000 - 100 - SHA-512 Benchmark Timespark: 10000000 - 500 - Repartition Test Timespark: 20000000 - 2000 - Group By Test Timespark: 40000000 - 2000 - Inner Join Test Timespark: 10000000 - 100 - SHA-512 Benchmark Timespark: 20000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 500 - Repartition Test Timespark: 1000000 - 1000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - Repartition Test Timespark: 40000000 - 100 - Repartition Test Timespark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 500 - SHA-512 Benchmark Timespark: 10000000 - 500 - Calculate Pi Benchmarkspark: 1000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 500 - Calculate Pi Benchmarkspark: 10000000 - 500 - Inner Join Test Timespark: 20000000 - 100 - SHA-512 Benchmark Timespark: 20000000 - 2000 - Inner Join Test Timespark: 20000000 - 1000 - Broadcast Inner Join Test Timespark: 10000000 - 1000 - Repartition Test Timespark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 2000 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 1000 - Group By Test Timespark: 10000000 - 1000 - Inner Join Test Timespark: 1000000 - 500 - Calculate Pi Benchmarkspark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Inner Join Test Timespark: 40000000 - 1000 - Broadcast Inner Join Test Timespark: 40000000 - 2000 - Group By Test Timespark: 40000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - Inner Join Test Timespark: 40000000 - 500 - Repartition Test Timespark: 40000000 - 2000 - Repartition Test Timespark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Repartition Test Timespark: 40000000 - 500 - SHA-512 Benchmark Timespark: 20000000 - 500 - Repartition Test Timespark: 40000000 - 1000 - Group By Test Timespark: 40000000 - 1000 - Repartition Test Timespark: 10000000 - 100 - Calculate Pi Benchmarkspark: 20000000 - 500 - Broadcast Inner Join Test Timespark: 20000000 - 500 - Inner Join Test Timespark: 20000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - SHA-512 Benchmark Timespark: 10000000 - 2000 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 40000000 - 100 - Calculate Pi Benchmarkspark: 40000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 100 - Calculate Pi Benchmarkspark: 20000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 2000 - Repartition Test Timespark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - Group By Test Timespark: 10000000 - 100 - Repartition Test Timespark: 40000000 - 2000 - SHA-512 Benchmark Timespark: 10000000 - 2000 - SHA-512 Benchmark Timespark: 40000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - SHA-512 Benchmark Timespark: 20000000 - 1000 - Calculate Pi Benchmarkspark: 40000000 - 100 - Broadcast Inner Join Test Timespark: 10000000 - 2000 - Calculate Pi Benchmarkspark: 10000000 - 1000 - SHA-512 Benchmark Timespark: 10000000 - 2000 - Group By Test Timespark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - Broadcast Inner Join Test Timespark: 10000000 - 1000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 1000 - SHA-512 Benchmark Timespark: 20000000 - 500 - SHA-512 Benchmark Timespark: 40000000 - 500 - Calculate Pi Benchmarkspark: 10000000 - 1000 - Broadcast Inner Join Test Timespark: 40000000 - 1000 - SHA-512 Benchmark Timespark: 40000000 - 500 - Group By Test Timespark: 10000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 1000 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Repartition Test TimeABCD4.533.4732.4814.368.854.502.285.433.3013.731.8931.974.0716.608.739.4059.914.25153.4331.775.092.653.22152.8319726283.6959.074.5460.9215.263.9828.554.0214.3414.3861.6422.488.932.93153.11372386628.1454.638.9021.95155.304388476154.901816094153.11906837215.7642.3932.3830.7214.638.8560.468.848.8214.1116.44153.0827448008.868.8217.9360.4132.978.8760.5853.9655.508.8715.3678.9027.3232.9154.58153.42082714029.4730.158.8978.8516.43153.79153.358.88152.95152.40215181828.528.808.8039.4914.4780.9322.948.8841.96153.27199343958.79153.33595905422.269.978.8431.01151.938.8041.6540.89152.9315.4479.5734.1616.092.762.282.694.723.5834.8614.779.244.482.315.613.3314.171.9833.414.1016.839.039.2962.214.42159.37749738330.615.212.703.34157.2516055143.6958.784.5562.6815.623.9529.084.1314.7114.3363.2322.749.052.94154.6227.4955.919.0522.33154.55154.26154.8515.9243.2432.2830.1414.878.9561.198.918.9413.90801015716.64154.328.918.9217.7460.2533.178.7761.0354.7556.268.8615.5779.3627.0832.7555.24154.6729.3130.378.8479.6216.25153.24153.138.90153.30152.2528.528.738.8739.69740892514.4080.2623.018.8941.95153.6803410458.70152.8636641822.169.918.7930.91152.0749862698.7741.5040.72152.40549228315.4479.4934.1716.622.892.422.884.983.7433.0213.878.694.592.415.363.2813.521.9432.284.2516.778.799.0162.444.32153.71904667830.875.022.713.27151.707638953.5660.634.4761.7315.703.9128.304.1114.3614.7063.0822.188.862.89151.04700087227.7355.168.8521.86152.485567023151.74151.75682410715.6036520742.4232.9230.5714.598.7961.508.768.7914.1416.37151.830824858.908.7817.6559.4733.468.9061.4754.5455.948.8915.4879.9527.3932.4955.02152.8329.5830.0526952988.7978.7316.381663148152.15154.7257607418.97152.48153.6628.268.818.8839.3514.3780.5622.828.8241.64152.5358.36152.3722.309.928.8330.84152.678.7641.4740.78153.00140108115.4079.4534.1217.112.692.202.864.513.7533.5213.978.904.342.305.313.1713.491.9532.804.1116.128.654.365.092.753.333.634.4215.294.0228.874.1314.3222.648.832.96152.868.8922.07152.11152.07152.4415.6942.558.888.91153.138.778.888.7727.44153.29486606429.6630.418.82152.20153.9114.4940.83320572316.472.772.262.77OpenBenchmarking.org

Apache Spark

Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark TimeDABC1.12052.2413.36154.4825.6025SE +/- 0.02, N = 3SE +/- 0.05, N = 124.514.534.724.98

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test TimeABCD0.84381.68762.53143.37524.219SE +/- 0.02, N = 3SE +/- 0.03, N = 33.473.583.743.75

Apache Spark

Row Count: 20000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Inner Join Test TimeACDB816243240SE +/- 0.79, N = 3SE +/- 0.25, N = 332.4833.0233.5234.86

Apache Spark

Row Count: 20000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Group By Test TimeCDAB48121620SE +/- 0.13, N = 3SE +/- 0.33, N = 313.8713.9714.3614.77

Apache Spark

Row Count: 10000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Group By Test TimeCADB3691215SE +/- 0.04, N = 3SE +/- 0.20, N = 38.698.858.909.24

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Inner Join Test TimeDBAC1.03282.06563.09844.13125.164SE +/- 0.07, N = 3SE +/- 0.02, N = 34.344.484.504.59

Apache Spark

Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test TimeADBC0.54231.08461.62692.16922.7115SE +/- 0.02, N = 3SE +/- 0.02, N = 122.282.302.312.41

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Group By Test TimeDCAB1.26232.52463.78695.04926.3115SE +/- 0.02, N = 3SE +/- 0.19, N = 35.315.365.435.61

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Repartition Test TimeDCAB0.74931.49862.24792.99723.7465SE +/- 0.03, N = 3SE +/- 0.02, N = 123.173.283.303.33

Apache Spark

Row Count: 20000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Group By Test TimeDCAB48121620SE +/- 0.03, N = 313.4913.5213.7314.17

Apache Spark

Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test TimeACDB0.44550.8911.33651.7822.2275SE +/- 0.01, N = 3SE +/- 0.04, N = 31.891.941.951.98

Apache Spark

Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test TimeACDB816243240SE +/- 0.57, N = 3SE +/- 0.16, N = 331.9732.2832.8033.41

Apache Spark

Row Count: 1000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Group By Test TimeABDC0.95631.91262.86893.82524.7815SE +/- 0.04, N = 3SE +/- 0.03, N = 124.074.104.114.25

Apache Spark

Row Count: 10000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Inner Join Test TimeDACB48121620SE +/- 0.35, N = 3SE +/- 0.28, N = 316.1216.6016.7716.83

Apache Spark

Row Count: 10000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Group By Test TimeDACB3691215SE +/- 0.07, N = 3SE +/- 0.14, N = 38.658.738.799.03

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Group By Test TimeCBA3691215SE +/- 0.10, N = 39.019.299.40

Apache Spark

Row Count: 40000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Inner Join Test TimeABC1428425670SE +/- 0.07, N = 359.9162.2162.44

Apache Spark

Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark TimeACDB0.99451.9892.98353.9784.9725SE +/- 0.04, N = 3SE +/- 0.05, N = 124.254.324.364.42

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi BenchmarkACB4080120160200SE +/- 0.66, N = 3153.43153.72159.38

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Inner Join Test TimeBCA714212835SE +/- 0.80, N = 330.6130.8731.77

Apache Spark

Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark TimeCADB1.17232.34463.51694.68925.8615SE +/- 0.07, N = 3SE +/- 0.03, N = 35.025.095.095.21

Apache Spark

Row Count: 1000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Inner Join Test TimeABCD0.61881.23761.85642.47523.094SE +/- 0.01, N = 3SE +/- 0.01, N = 122.652.702.712.75

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Inner Join Test TimeACDB0.75151.5032.25453.0063.7575SE +/- 0.02, N = 3SE +/- 0.05, N = 123.223.273.333.34

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi BenchmarkCAB306090120150SE +/- 0.69, N = 3151.71152.83157.25

Apache Spark

Row Count: 1000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test TimeCDAB0.83031.66062.49093.32124.1515SE +/- 0.03, N = 3SE +/- 0.05, N = 33.563.633.693.69

Apache Spark

Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test TimeBAC1428425670SE +/- 0.30, N = 358.7859.0760.63

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Group By Test TimeDCAB1.02382.04763.07144.09525.119SE +/- 0.04, N = 3SE +/- 0.05, N = 124.424.474.544.55

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Inner Join Test TimeACB1428425670SE +/- 0.45, N = 360.9261.7362.68

Apache Spark

Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test TimeADBC48121620SE +/- 0.15, N = 3SE +/- 0.16, N = 315.2615.2915.6215.70

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Repartition Test TimeCBAD0.90451.8092.71353.6184.5225SE +/- 0.04, N = 3SE +/- 0.01, N = 33.913.953.984.02

Apache Spark

Row Count: 20000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Repartition Test TimeCADB714212835SE +/- 0.35, N = 3SE +/- 0.15, N = 328.3028.5528.8729.08

Apache Spark

Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeACBD0.92931.85862.78793.71724.6465SE +/- 0.03, N = 3SE +/- 0.01, N = 34.024.114.134.13

Apache Spark

Row Count: 10000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Repartition Test TimeDACB48121620SE +/- 0.06, N = 3SE +/- 0.25, N = 314.3214.3414.3614.71

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Group By Test TimeBAC48121620SE +/- 0.18, N = 314.3314.3814.70

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Inner Join Test TimeACB1428425670SE +/- 0.39, N = 361.6463.0863.23

Apache Spark

Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark TimeCADB510152025SE +/- 0.10, N = 3SE +/- 0.26, N = 322.1822.4822.6422.74

Apache Spark

Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeDCAB3691215SE +/- 0.09, N = 3SE +/- 0.09, N = 38.838.868.939.05

Apache Spark

Row Count: 1000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Repartition Test TimeCABD0.6661.3321.9982.6643.33SE +/- 0.02, N = 3SE +/- 0.02, N = 122.892.932.942.96

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi BenchmarkCDAB306090120150SE +/- 0.71, N = 3SE +/- 0.31, N = 12151.05152.86153.11154.62

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Repartition Test TimeBCA714212835SE +/- 0.31, N = 327.4927.7328.14

Apache Spark

Row Count: 40000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Repartition Test TimeACB1326395265SE +/- 0.82, N = 354.6355.1655.91

Apache Spark

Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCDAB3691215SE +/- 0.03, N = 3SE +/- 0.14, N = 38.858.898.909.05

Apache Spark

Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark TimeCADB510152025SE +/- 0.09, N = 3SE +/- 0.16, N = 321.8621.9522.0722.33

Apache Spark

Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi BenchmarkDCBA306090120150SE +/- 0.65, N = 3SE +/- 2.71, N = 3152.11152.49154.55155.30

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi BenchmarkCDBA306090120150SE +/- 0.45, N = 3SE +/- 2.55, N = 3151.74152.07154.26154.90

Apache Spark

Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi BenchmarkCDAB306090120150SE +/- 0.19, N = 3151.76152.44153.12154.85

Apache Spark

Row Count: 10000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Inner Join Test TimeCDAB48121620SE +/- 0.06, N = 3SE +/- 0.19, N = 315.6015.6915.7615.92

Apache Spark

Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark TimeACDB1020304050SE +/- 0.01, N = 3SE +/- 0.06, N = 342.3942.4242.5543.24

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Inner Join Test TimeBAC816243240SE +/- 0.17, N = 332.2832.3832.92

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test TimeBCA714212835SE +/- 0.50, N = 330.1430.5730.72

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Repartition Test TimeCAB48121620SE +/- 0.06, N = 314.5914.6314.87

Apache Spark

Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCADB3691215SE +/- 0.03, N = 3SE +/- 0.04, N = 128.798.858.888.95

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test TimeABC1428425670SE +/- 0.51, N = 360.4661.1961.50

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCABD246810SE +/- 0.02, N = 3SE +/- 0.02, N = 38.768.848.918.91

Apache Spark

Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCAB246810SE +/- 0.01, N = 38.798.828.94

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Group By Test TimeBAC48121620SE +/- 0.14, N = 313.9114.1114.14

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Inner Join Test TimeCAB48121620SE +/- 0.01, N = 316.3716.4416.64

Apache Spark

Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi BenchmarkCADB306090120150SE +/- 0.84, N = 3SE +/- 0.26, N = 12151.83153.08153.13154.32

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeDACB246810SE +/- 0.02, N = 3SE +/- 0.03, N = 128.778.868.908.91

Apache Spark

Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCADB246810SE +/- 0.01, N = 3SE +/- 0.05, N = 38.788.828.888.92

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Inner Join Test TimeCBA48121620SE +/- 0.07, N = 317.6517.7417.93

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBA1428425670SE +/- 0.03, N = 359.4760.2560.41

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Group By Test TimeABC816243240SE +/- 0.29, N = 332.9733.1733.46

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeBAC246810SE +/- 0.02, N = 38.778.878.90

Apache Spark

Row Count: 40000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Inner Join Test TimeABC1428425670SE +/- 0.78, N = 360.5861.0361.47

Apache Spark

Row Count: 40000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Repartition Test TimeACB1224364860SE +/- 0.21, N = 353.9654.5454.75

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Repartition Test TimeACB1326395265SE +/- 0.24, N = 355.5055.9456.26

Apache Spark

Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeDBAC246810SE +/- 0.03, N = 3SE +/- 0.02, N = 38.778.868.878.89

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Repartition Test TimeACB48121620SE +/- 0.03, N = 315.3615.4815.57

Apache Spark

Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark TimeABC20406080100SE +/- 0.09, N = 378.9079.3679.95

Apache Spark

Row Count: 20000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Repartition Test TimeBACD612182430SE +/- 0.03, N = 327.0827.3227.3927.44

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Group By Test TimeCBA816243240SE +/- 0.30, N = 332.4932.7532.91

Apache Spark

Row Count: 40000000 - Partitions: 1000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Repartition Test TimeACB1224364860SE +/- 0.36, N = 354.5855.0255.24

Apache Spark

Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi BenchmarkCDAB306090120150SE +/- 0.40, N = 3SE +/- 0.15, N = 3152.83153.29153.42154.67

Apache Spark

Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test TimeBACD714212835SE +/- 0.07, N = 329.3129.4729.5829.66

Apache Spark

Row Count: 20000000 - Partitions: 500 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Inner Join Test TimeCABD714212835SE +/- 0.20, N = 330.0530.1530.3730.41

Apache Spark

Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCDBA246810SE +/- 0.02, N = 38.798.828.848.89

Apache Spark

Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark TimeCAB20406080100SE +/- 0.13, N = 378.7378.8579.62

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test TimeBCA48121620SE +/- 0.10, N = 316.2516.3816.43

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkCDBA306090120150SE +/- 0.70, N = 3SE +/- 0.42, N = 3152.15152.20153.24153.79

Apache Spark

Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi BenchmarkBAC306090120150SE +/- 0.83, N = 3153.13153.35154.73

Apache Spark

Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeABC3691215SE +/- 0.02, N = 38.888.908.97

Apache Spark

Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi BenchmarkCABD306090120150SE +/- 0.26, N = 3SE +/- 0.44, N = 3152.48152.95153.30153.91

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi BenchmarkBAC306090120150SE +/- 0.32, N = 3152.25152.40153.66

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Repartition Test TimeCAB714212835SE +/- 0.12, N = 328.2628.5228.52

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeBAC246810SE +/- 0.03, N = 38.738.808.81

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeABC246810SE +/- 0.01, N = 38.808.878.88

Apache Spark

Row Count: 40000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Group By Test TimeCAB918273645SE +/- 0.17, N = 339.3539.4939.70

Apache Spark

Row Count: 10000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Repartition Test TimeCBAD48121620SE +/- 0.11, N = 3SE +/- 0.20, N = 314.3714.4014.4714.49

Apache Spark

Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark TimeBCA20406080100SE +/- 0.20, N = 380.2680.5680.93

Apache Spark

Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark TimeCAB612182430SE +/- 0.15, N = 322.8222.9423.01

Apache Spark

Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCAB246810SE +/- 0.05, N = 38.828.888.89

Apache Spark

Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBA1020304050SE +/- 0.13, N = 341.6441.9541.96

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi BenchmarkCAB306090120150SE +/- 0.66, N = 3152.53153.27153.68

Apache Spark

Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBA1326395265SE +/- 0.96, N = 358.3658.7058.79

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi BenchmarkCBA306090120150SE +/- 0.26, N = 3152.37152.86153.34

Apache Spark

Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark TimeBAC510152025SE +/- 0.04, N = 322.1622.2622.30

Apache Spark

Row Count: 10000000 - Partitions: 2000 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Group By Test TimeBCA3691215SE +/- 0.11, N = 39.919.929.97

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeBCA246810SE +/- 0.01, N = 38.798.838.84

Apache Spark

Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBA714212835SE +/- 0.27, N = 330.8430.9131.01

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi BenchmarkABC306090120150SE +/- 0.35, N = 3151.93152.07152.67

Apache Spark

Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBA246810SE +/- 0.05, N = 38.768.778.80

Apache Spark

Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBA1020304050SE +/- 0.17, N = 341.4741.5041.65

Apache Spark

Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark TimeBCDA918273645SE +/- 0.02, N = 340.7240.7840.8340.89

Apache Spark

Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi BenchmarkBAC306090120150SE +/- 0.43, N = 3152.41152.93153.00

Apache Spark

Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCAB48121620SE +/- 0.04, N = 315.4015.4415.44

Apache Spark

Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBA20406080100SE +/- 0.03, N = 379.4579.4979.57

Apache Spark

Row Count: 40000000 - Partitions: 500 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Group By Test TimeCAB816243240SE +/- 0.36, N = 334.1234.1634.17

Apache Spark

Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test TimeADBC48121620SE +/- 0.43, N = 3SE +/- 0.81, N = 316.0916.4716.6217.11

Apache Spark

Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCADB0.65031.30061.95092.60123.2515SE +/- 0.07, N = 3SE +/- 0.08, N = 122.692.762.772.89

Apache Spark

Row Count: 1000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test TimeCDAB0.54451.0891.63352.1782.7225SE +/- 0.02, N = 3SE +/- 0.10, N = 32.202.262.282.42

Apache Spark

Row Count: 1000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test TimeADCB0.6481.2961.9442.5923.24SE +/- 0.04, N = 3SE +/- 0.12, N = 32.692.772.862.88

Phoronix Test Suite v10.8.4