5950xspark

AMD Ryzen 9 5950X 16-Core testing with a Gigabyte X570 AORUS ELITE WIFI (F37c BIOS) and eVGA NVIDIA GeForce GTX 1060 6GB on Gentoo 2.8 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2208104-QUAR-5950XSP90
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX
August 10 2022
  8 Hours, 18 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


5950xsparkOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)Gigabyte X570 AORUS ELITE WIFI (F37c BIOS)AMD Starship/Matisse2 x 16 GB DDR4-3733MT/s TEAMGROUP-UD4-36002 x 1000GB Samsung SSD 980 PRO 1TBeVGA NVIDIA GeForce GTX 1060 6GBNVIDIA GP106 HD AudioDELL 2707WFPIntel I211 + Intel Dual Band-AC 3168NGWGentoo 2.85.19.0-gentoo-harambe-edition (x86_64)KDE Plasma 5.25.4X Server 1.21.1.4NVIDIA 515.65.01GCC 11.3.0ext43840x1200ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverCompilerFile-SystemScreen Resolution5950xspark BenchmarksSystem Logs- Transparent Huge Pages: madvise- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - OpenJDK Runtime Environment Temurin-17.0.3+7 (build 17.0.3+7)- Python 3.10.5- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

5950xsparkspark: 1000000 - 100 - SHA-512 Benchmark Timespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 100 - Group By Test Timespark: 1000000 - 100 - Repartition Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 500 - SHA-512 Benchmark Timespark: 1000000 - 500 - Calculate Pi Benchmarkspark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 500 - Group By Test Timespark: 1000000 - 500 - Repartition Test Timespark: 1000000 - 500 - Inner Join Test Timespark: 1000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 1000 - SHA-512 Benchmark Timespark: 1000000 - 1000 - Calculate Pi Benchmarkspark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 1000 - Group By Test Timespark: 1000000 - 1000 - Repartition Test Timespark: 1000000 - 1000 - Inner Join Test Timespark: 1000000 - 1000 - Broadcast Inner Join Test Timespark: 1000000 - 2000 - SHA-512 Benchmark Timespark: 1000000 - 2000 - Calculate Pi Benchmarkspark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 2000 - Group By Test Timespark: 1000000 - 2000 - Repartition Test Timespark: 1000000 - 2000 - Inner Join Test Timespark: 1000000 - 2000 - Broadcast Inner Join Test Timespark: 10000000 - 100 - SHA-512 Benchmark Timespark: 10000000 - 100 - Calculate Pi Benchmarkspark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 100 - Group By Test Timespark: 10000000 - 100 - Repartition Test Timespark: 10000000 - 100 - Inner Join Test Timespark: 10000000 - 100 - Broadcast Inner Join Test Timespark: 10000000 - 500 - SHA-512 Benchmark Timespark: 10000000 - 500 - Calculate Pi Benchmarkspark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 500 - Group By Test Timespark: 10000000 - 500 - Repartition Test Timespark: 10000000 - 500 - Inner Join Test Timespark: 10000000 - 500 - Broadcast Inner Join Test Timespark: 10000000 - 1000 - SHA-512 Benchmark Timespark: 10000000 - 1000 - Calculate Pi Benchmarkspark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 1000 - Group By Test Timespark: 10000000 - 1000 - Repartition Test Timespark: 10000000 - 1000 - Inner Join Test Timespark: 10000000 - 1000 - Broadcast Inner Join Test Timespark: 10000000 - 2000 - SHA-512 Benchmark Timespark: 10000000 - 2000 - Calculate Pi Benchmarkspark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Group By Test Timespark: 10000000 - 2000 - Repartition Test Timespark: 10000000 - 2000 - Inner Join Test Timespark: 10000000 - 2000 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX2.1973.1883683693.402.851.2840120221.060.852.1473.3315682313.392.621.311.180.902.2274.1214811153.372.671.371.241.062.3973.8622695133.372.971.621.671.356.9273.4008950133.424.624.615.144.876.5173.5599748933.364.144.355.004.667.0973.663.394.664.685.295.017.6173.623.394.834.966.045.47OpenBenchmarking.org

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.49280.98561.47841.97122.464SE +/- 0.02, N = 32.19

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.68, N = 373.19

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.7651.532.2953.063.825SE +/- 0.01, N = 33.40

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.64131.28261.92392.56523.2065SE +/- 0.00, N = 32.85

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.28890.57780.86671.15561.4445SE +/- 0.026244349, N = 31.284012022

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.23850.4770.71550.9541.1925SE +/- 0.03, N = 31.06

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.19130.38260.57390.76520.9565SE +/- 0.02, N = 30.85

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.48150.9631.44451.9262.4075SE +/- 0.02, N = 92.14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.21, N = 973.33

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.76281.52562.28843.05123.814SE +/- 0.01, N = 93.39

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.58951.1791.76852.3582.9475SE +/- 0.02, N = 92.62

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.29480.58960.88441.17921.474SE +/- 0.01, N = 91.31

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.26550.5310.79651.0621.3275SE +/- 0.01, N = 91.18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.20250.4050.60750.811.0125SE +/- 0.01, N = 90.90

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.49950.9991.49851.9982.4975SE +/- 0.01, N = 32.22

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.34, N = 374.12

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.75831.51662.27493.03323.7915SE +/- 0.01, N = 33.37

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.60081.20161.80242.40323.004SE +/- 0.04, N = 32.67

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.30830.61660.92491.23321.5415SE +/- 0.02, N = 31.37

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.2790.5580.8371.1161.395SE +/- 0.05, N = 31.24

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.23850.4770.71550.9541.1925SE +/- 0.03, N = 31.06

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.53781.07561.61342.15122.689SE +/- 0.02, N = 32.39

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.10, N = 373.86

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.75831.51662.27493.03323.7915SE +/- 0.01, N = 33.37

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.66831.33662.00492.67323.3415SE +/- 0.00, N = 32.97

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.36450.7291.09351.4581.8225SE +/- 0.02, N = 31.62

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.37580.75161.12741.50321.879SE +/- 0.02, N = 31.67

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.30380.60760.91141.21521.519SE +/- 0.03, N = 31.35

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX246810SE +/- 0.02, N = 36.92

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.28, N = 373.40

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.76951.5392.30853.0783.8475SE +/- 0.00, N = 33.42

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.03952.0793.11854.1585.1975SE +/- 0.04, N = 34.62

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.03732.07463.11194.14925.1865SE +/- 0.04, N = 34.61

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.15652.3133.46954.6265.7825SE +/- 0.07, N = 35.14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.09582.19163.28744.38325.479SE +/- 0.06, N = 34.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX246810SE +/- 0.03, N = 36.51

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.39, N = 373.56

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.7561.5122.2683.0243.78SE +/- 0.04, N = 33.36

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.93151.8632.79453.7264.6575SE +/- 0.04, N = 34.14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.97881.95762.93643.91524.894SE +/- 0.07, N = 34.35

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.1252.253.3754.55.625SE +/- 0.11, N = 35.00

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.04852.0973.14554.1945.2425SE +/- 0.21, N = 34.66

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX246810SE +/- 0.06, N = 157.09

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.13, N = 1573.66

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.76281.52562.28843.05123.814SE +/- 0.01, N = 153.39

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.04852.0973.14554.1945.2425SE +/- 0.03, N = 154.66

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.0532.1063.1594.2125.265SE +/- 0.04, N = 154.68

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.19032.38063.57094.76125.9515SE +/- 0.05, N = 155.29

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.12732.25463.38194.50925.6365SE +/- 0.08, N = 155.01

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX246810SE +/- 0.04, N = 37.61

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi BenchmarkAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1632486480SE +/- 0.44, N = 373.62

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX0.76281.52562.28843.05123.814SE +/- 0.02, N = 33.39

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Group By Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.08682.17363.26044.34725.434SE +/- 0.03, N = 34.83

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Repartition Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.1162.2323.3484.4645.58SE +/- 0.12, N = 34.96

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX246810SE +/- 0.26, N = 36.04

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test TimeAMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX1.23082.46163.69244.92326.154SE +/- 0.07, N = 35.47

56 Results Shown

Apache Spark:
  1000000 - 100 - SHA-512 Benchmark Time
  1000000 - 100 - Calculate Pi Benchmark
  1000000 - 100 - Calculate Pi Benchmark Using Dataframe
  1000000 - 100 - Group By Test Time
  1000000 - 100 - Repartition Test Time
  1000000 - 100 - Inner Join Test Time
  1000000 - 100 - Broadcast Inner Join Test Time
  1000000 - 500 - SHA-512 Benchmark Time
  1000000 - 500 - Calculate Pi Benchmark
  1000000 - 500 - Calculate Pi Benchmark Using Dataframe
  1000000 - 500 - Group By Test Time
  1000000 - 500 - Repartition Test Time
  1000000 - 500 - Inner Join Test Time
  1000000 - 500 - Broadcast Inner Join Test Time
  1000000 - 1000 - SHA-512 Benchmark Time
  1000000 - 1000 - Calculate Pi Benchmark
  1000000 - 1000 - Calculate Pi Benchmark Using Dataframe
  1000000 - 1000 - Group By Test Time
  1000000 - 1000 - Repartition Test Time
  1000000 - 1000 - Inner Join Test Time
  1000000 - 1000 - Broadcast Inner Join Test Time
  1000000 - 2000 - SHA-512 Benchmark Time
  1000000 - 2000 - Calculate Pi Benchmark
  1000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  1000000 - 2000 - Group By Test Time
  1000000 - 2000 - Repartition Test Time
  1000000 - 2000 - Inner Join Test Time
  1000000 - 2000 - Broadcast Inner Join Test Time
  10000000 - 100 - SHA-512 Benchmark Time
  10000000 - 100 - Calculate Pi Benchmark
  10000000 - 100 - Calculate Pi Benchmark Using Dataframe
  10000000 - 100 - Group By Test Time
  10000000 - 100 - Repartition Test Time
  10000000 - 100 - Inner Join Test Time
  10000000 - 100 - Broadcast Inner Join Test Time
  10000000 - 500 - SHA-512 Benchmark Time
  10000000 - 500 - Calculate Pi Benchmark
  10000000 - 500 - Calculate Pi Benchmark Using Dataframe
  10000000 - 500 - Group By Test Time
  10000000 - 500 - Repartition Test Time
  10000000 - 500 - Inner Join Test Time
  10000000 - 500 - Broadcast Inner Join Test Time
  10000000 - 1000 - SHA-512 Benchmark Time
  10000000 - 1000 - Calculate Pi Benchmark
  10000000 - 1000 - Calculate Pi Benchmark Using Dataframe
  10000000 - 1000 - Group By Test Time
  10000000 - 1000 - Repartition Test Time
  10000000 - 1000 - Inner Join Test Time
  10000000 - 1000 - Broadcast Inner Join Test Time
  10000000 - 2000 - SHA-512 Benchmark Time
  10000000 - 2000 - Calculate Pi Benchmark
  10000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  10000000 - 2000 - Group By Test Time
  10000000 - 2000 - Repartition Test Time
  10000000 - 2000 - Inner Join Test Time
  10000000 - 2000 - Broadcast Inner Join Test Time