5950xGentoo-ApacheSpark-all AMD Ryzen 9 5950X 16-Core testing with a Gigabyte X570 AORUS ELITE WIFI (F37c BIOS) and eVGA NVIDIA GeForce GTX 1060 6GB on Gentoo 2.8 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2208048-QUAR-5950XGE41 .
5950xGentoo-ApacheSpark-all Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver Compiler File-System Screen Resolution AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads) Gigabyte X570 AORUS ELITE WIFI (F37c BIOS) AMD Starship/Matisse 4 x 8 GB DDR4-3533MT/s CMK16GX4M2Z3200C16 2 x 1000GB Samsung SSD 980 PRO 1TB eVGA NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio DELL 2707WFP Intel I211 + Intel Dual Band-AC 3168NGW Gentoo 2.8 5.19.0-gentoo-harambe-edition (x86_64) KDE Plasma 5.25.4 X Server 1.21.1.4 NVIDIA 515.65.01 GCC 11.3.0 ext4 3840x1200 OpenBenchmarking.org - Transparent Huge Pages: madvise - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - OpenJDK Runtime Environment Temurin-17.0.3+7 (build 17.0.3+7) - Python 3.10.5 - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
5950xGentoo-ApacheSpark-all spark: 1000000 - 100 - SHA-512 Benchmark Time spark: 1000000 - 100 - Calculate Pi Benchmark spark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 100 - Group By Test Time spark: 1000000 - 100 - Repartition Test Time spark: 1000000 - 100 - Inner Join Test Time spark: 1000000 - 100 - Broadcast Inner Join Test Time spark: 1000000 - 500 - SHA-512 Benchmark Time spark: 1000000 - 500 - Calculate Pi Benchmark spark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 500 - Group By Test Time spark: 1000000 - 500 - Repartition Test Time spark: 1000000 - 500 - Inner Join Test Time spark: 1000000 - 500 - Broadcast Inner Join Test Time spark: 1000000 - 1000 - SHA-512 Benchmark Time spark: 1000000 - 1000 - Calculate Pi Benchmark spark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 1000 - Group By Test Time spark: 1000000 - 1000 - Repartition Test Time spark: 1000000 - 1000 - Inner Join Test Time spark: 1000000 - 1000 - Broadcast Inner Join Test Time spark: 1000000 - 2000 - SHA-512 Benchmark Time spark: 1000000 - 2000 - Calculate Pi Benchmark spark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 2000 - Group By Test Time spark: 1000000 - 2000 - Repartition Test Time spark: 1000000 - 2000 - Inner Join Test Time spark: 1000000 - 2000 - Broadcast Inner Join Test Time spark: 10000000 - 100 - SHA-512 Benchmark Time spark: 10000000 - 100 - Calculate Pi Benchmark spark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 100 - Group By Test Time spark: 10000000 - 100 - Repartition Test Time spark: 10000000 - 100 - Inner Join Test Time spark: 10000000 - 100 - Broadcast Inner Join Test Time spark: 10000000 - 500 - SHA-512 Benchmark Time spark: 10000000 - 500 - Calculate Pi Benchmark spark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 500 - Group By Test Time spark: 10000000 - 500 - Repartition Test Time spark: 10000000 - 500 - Inner Join Test Time spark: 10000000 - 500 - Broadcast Inner Join Test Time spark: 20000000 - 100 - SHA-512 Benchmark Time spark: 20000000 - 100 - Calculate Pi Benchmark spark: 20000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 20000000 - 100 - Group By Test Time spark: 20000000 - 100 - Repartition Test Time spark: 20000000 - 100 - Inner Join Test Time spark: 20000000 - 100 - Broadcast Inner Join Test Time spark: 20000000 - 500 - SHA-512 Benchmark Time spark: 20000000 - 500 - Calculate Pi Benchmark spark: 20000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 20000000 - 500 - Group By Test Time spark: 20000000 - 500 - Repartition Test Time spark: 20000000 - 500 - Inner Join Test Time spark: 20000000 - 500 - Broadcast Inner Join Test Time spark: 40000000 - 100 - SHA-512 Benchmark Time spark: 40000000 - 100 - Calculate Pi Benchmark spark: 40000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 40000000 - 100 - Group By Test Time spark: 40000000 - 100 - Repartition Test Time spark: 40000000 - 100 - Inner Join Test Time spark: 40000000 - 100 - Broadcast Inner Join Test Time spark: 40000000 - 500 - SHA-512 Benchmark Time spark: 40000000 - 500 - Calculate Pi Benchmark spark: 40000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 40000000 - 500 - Group By Test Time spark: 40000000 - 500 - Repartition Test Time spark: 40000000 - 500 - Inner Join Test Time spark: 40000000 - 500 - Broadcast Inner Join Test Time spark: 10000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 1000 - Calculate Pi Benchmark spark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 1000 - Group By Test Time spark: 10000000 - 1000 - Repartition Test Time spark: 10000000 - 1000 - Inner Join Test Time spark: 10000000 - 1000 - Broadcast Inner Join Test Time spark: 10000000 - 2000 - SHA-512 Benchmark Time spark: 10000000 - 2000 - Calculate Pi Benchmark spark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 2000 - Group By Test Time spark: 10000000 - 2000 - Repartition Test Time spark: 10000000 - 2000 - Inner Join Test Time spark: 10000000 - 2000 - Broadcast Inner Join Test Time spark: 20000000 - 1000 - SHA-512 Benchmark Time spark: 20000000 - 1000 - Calculate Pi Benchmark spark: 20000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 20000000 - 1000 - Group By Test Time spark: 20000000 - 1000 - Repartition Test Time spark: 20000000 - 1000 - Inner Join Test Time spark: 20000000 - 1000 - Broadcast Inner Join Test Time spark: 20000000 - 2000 - SHA-512 Benchmark Time spark: 20000000 - 2000 - Calculate Pi Benchmark spark: 20000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 20000000 - 2000 - Group By Test Time spark: 20000000 - 2000 - Repartition Test Time spark: 20000000 - 2000 - Inner Join Test Time spark: 20000000 - 2000 - Broadcast Inner Join Test Time spark: 40000000 - 1000 - SHA-512 Benchmark Time spark: 40000000 - 1000 - Calculate Pi Benchmark spark: 40000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 40000000 - 1000 - Group By Test Time spark: 40000000 - 1000 - Repartition Test Time spark: 40000000 - 1000 - Inner Join Test Time spark: 40000000 - 1000 - Broadcast Inner Join Test Time spark: 40000000 - 2000 - SHA-512 Benchmark Time spark: 40000000 - 2000 - Calculate Pi Benchmark spark: 40000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 40000000 - 2000 - Group By Test Time spark: 40000000 - 2000 - Repartition Test Time spark: 40000000 - 2000 - Inner Join Test Time spark: 40000000 - 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2.28 73.71 3.42 2.85 1.31 1.16 0.87 2.24 73.64 3.41 2.65 1.38 1.21 0.99 2.32 73.92 3.41 2.76 1.45 1.36 1.08 2.59 72.99 3.41 3.17 1.76 1.92 1.47 7.55 72.94 3.39 4.85 5.02 5.65 5.49 7.20 73.66 3.44 4.45 5.02 5.53 5.12 13.48 72.89 3.43 6.89 9.40 10.59 10.26 12.63 73.60 3.41 6.12 8.91 10.73 9.53 25.54 73.01 3.43 18.14 18.32 21.46 21.48 23.58 73.74 3.42 17.30 17.32 19.21 18.89 7.45 73.71 3.38 5.01 5.09 5.70 5.50 8.24 73.41 3.42 5.14 5.42 6.33 5.91 12.68 73.32 3.37 6.74 9.37 10.47 9.90 13.58 73.62 3.42 6.87 9.40 10.79 10.14 23.11 72.90 3.40 15.86 16.79 18.52 18.14 24.03 73.76 3.39 14.51 17.68 19.95 18.89 OpenBenchmarking.org
Apache Spark Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.513 1.026 1.539 2.052 2.565 SE +/- 0.02, N = 3 2.28
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.33, N = 3 73.71
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7695 1.539 2.3085 3.078 3.8475 SE +/- 0.01, N = 3 3.42
Apache Spark Row Count: 1000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.6413 1.2826 1.9239 2.5652 3.2065 SE +/- 0.02, N = 3 2.85
Apache Spark Row Count: 1000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.2948 0.5896 0.8844 1.1792 1.474 SE +/- 0.02, N = 3 1.31
Apache Spark Row Count: 1000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.261 0.522 0.783 1.044 1.305 SE +/- 0.03, N = 3 1.16
Apache Spark Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.1958 0.3916 0.5874 0.7832 0.979 SE +/- 0.01, N = 3 0.87
Apache Spark Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.504 1.008 1.512 2.016 2.52 SE +/- 0.02, N = 3 2.24
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.42, N = 3 73.64
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7673 1.5346 2.3019 3.0692 3.8365 SE +/- 0.01, N = 3 3.41
Apache Spark Row Count: 1000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.5963 1.1926 1.7889 2.3852 2.9815 SE +/- 0.03, N = 3 2.65
Apache Spark Row Count: 1000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.3105 0.621 0.9315 1.242 1.5525 SE +/- 0.02, N = 3 1.38
Apache Spark Row Count: 1000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.2723 0.5446 0.8169 1.0892 1.3615 SE +/- 0.02, N = 3 1.21
Apache Spark Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.2228 0.4456 0.6684 0.8912 1.114 SE +/- 0.01, N = 3 0.99
Apache Spark Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.522 1.044 1.566 2.088 2.61 SE +/- 0.02, N = 3 2.32
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.36, N = 3 73.92
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7673 1.5346 2.3019 3.0692 3.8365 SE +/- 0.02, N = 3 3.41
Apache Spark Row Count: 1000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.621 1.242 1.863 2.484 3.105 SE +/- 0.05, N = 3 2.76
Apache Spark Row Count: 1000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.3263 0.6526 0.9789 1.3052 1.6315 SE +/- 0.01, N = 3 1.45
Apache Spark Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.306 0.612 0.918 1.224 1.53 SE +/- 0.01, N = 3 1.36
Apache Spark Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.243 0.486 0.729 0.972 1.215 SE +/- 0.02, N = 3 1.08
Apache Spark Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.5828 1.1656 1.7484 2.3312 2.914 SE +/- 0.03, N = 3 2.59
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.18, N = 3 72.99
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7673 1.5346 2.3019 3.0692 3.8365 SE +/- 0.04, N = 3 3.41
Apache Spark Row Count: 1000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7133 1.4266 2.1399 2.8532 3.5665 SE +/- 0.01, N = 3 3.17
Apache Spark Row Count: 1000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.396 0.792 1.188 1.584 1.98 SE +/- 0.02, N = 3 1.76
Apache Spark Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.432 0.864 1.296 1.728 2.16 SE +/- 0.11, N = 3 1.92
Apache Spark Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.3308 0.6616 0.9924 1.3232 1.654 SE +/- 0.05, N = 3 1.47
Apache Spark Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.05, N = 3 7.55
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.20, N = 3 72.94
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.01, N = 3 3.39
Apache Spark Row Count: 10000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.0913 2.1826 3.2739 4.3652 5.4565 SE +/- 0.03, N = 3 4.85
Apache Spark Row Count: 10000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.1295 2.259 3.3885 4.518 5.6475 SE +/- 0.01, N = 3 5.02
Apache Spark Row Count: 10000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.2713 2.5426 3.8139 5.0852 6.3565 SE +/- 0.09, N = 3 5.65
Apache Spark Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.2353 2.4706 3.7059 4.9412 6.1765 SE +/- 0.25, N = 3 5.49
Apache Spark Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.01, N = 3 7.20
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.41, N = 3 73.66
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.774 1.548 2.322 3.096 3.87 SE +/- 0.03, N = 3 3.44
Apache Spark Row Count: 10000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.0013 2.0026 3.0039 4.0052 5.0065 SE +/- 0.07, N = 3 4.45
Apache Spark Row Count: 10000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.1295 2.259 3.3885 4.518 5.6475 SE +/- 0.26, N = 3 5.02
Apache Spark Row Count: 10000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.2443 2.4886 3.7329 4.9772 6.2215 SE +/- 0.17, N = 3 5.53
Apache Spark Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.152 2.304 3.456 4.608 5.76 SE +/- 0.28, N = 3 5.12
Apache Spark Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.02, N = 3 13.48
Apache Spark Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.47, N = 3 72.89
Apache Spark Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7718 1.5436 2.3154 3.0872 3.859 SE +/- 0.01, N = 3 3.43
Apache Spark Row Count: 20000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.06, N = 3 6.89
Apache Spark Row Count: 20000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.04, N = 3 9.40
Apache Spark Row Count: 20000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.40, N = 3 10.59
Apache Spark Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.19, N = 3 10.26
Apache Spark Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.09, N = 12 12.63
Apache Spark Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.30, N = 12 73.60
Apache Spark Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7673 1.5346 2.3019 3.0692 3.8365 SE +/- 0.01, N = 12 3.41
Apache Spark Row Count: 20000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.03, N = 12 6.12
Apache Spark Row Count: 20000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.15, N = 12 8.91
Apache Spark Row Count: 20000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.16, N = 12 10.73
Apache Spark Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.19, N = 12 9.53
Apache Spark Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 6 12 18 24 30 SE +/- 0.10, N = 3 25.54
Apache Spark Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.69, N = 3 73.01
Apache Spark Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7718 1.5436 2.3154 3.0872 3.859 SE +/- 0.01, N = 3 3.43
Apache Spark Row Count: 40000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.03, N = 3 18.14
Apache Spark Row Count: 40000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 0.63, N = 3 18.32
Apache Spark Row Count: 40000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 1.07, N = 3 21.46
Apache Spark Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 0.81, N = 3 21.48
Apache Spark Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 6 12 18 24 30 SE +/- 0.10, N = 3 23.58
Apache Spark Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.42, N = 3 73.74
Apache Spark Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7695 1.539 2.3085 3.078 3.8475 SE +/- 0.01, N = 3 3.42
Apache Spark Row Count: 40000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.04, N = 3 17.30
Apache Spark Row Count: 40000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.13, N = 3 17.32
Apache Spark Row Count: 40000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 0.16, N = 3 19.21
Apache Spark Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 0.05, N = 3 18.89
Apache Spark Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.04, N = 3 7.45
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.25, N = 3 73.71
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7605 1.521 2.2815 3.042 3.8025 SE +/- 0.02, N = 3 3.38
Apache Spark Row Count: 10000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.1273 2.2546 3.3819 4.5092 5.6365 SE +/- 0.04, N = 3 5.01
Apache Spark Row Count: 10000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.1453 2.2906 3.4359 4.5812 5.7265 SE +/- 0.01, N = 3 5.09
Apache Spark Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.2825 2.565 3.8475 5.13 6.4125 SE +/- 0.10, N = 3 5.70
Apache Spark Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.2375 2.475 3.7125 4.95 6.1875 SE +/- 0.12, N = 3 5.50
Apache Spark Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.09, N = 15 8.24
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.21, N = 15 73.41
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7695 1.539 2.3085 3.078 3.8475 SE +/- 0.01, N = 15 3.42
Apache Spark Row Count: 10000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.1565 2.313 3.4695 4.626 5.7825 SE +/- 0.02, N = 15 5.14
Apache Spark Row Count: 10000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.2195 2.439 3.6585 4.878 6.0975 SE +/- 0.04, N = 15 5.42
Apache Spark Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.11, N = 15 6.33
Apache Spark Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.3298 2.6596 3.9894 5.3192 6.649 SE +/- 0.08, N = 15 5.91
Apache Spark Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.07, N = 3 12.68
Apache Spark Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.65, N = 3 73.32
Apache Spark Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7583 1.5166 2.2749 3.0332 3.7915 SE +/- 0.02, N = 3 3.37
Apache Spark Row Count: 20000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.03, N = 3 6.74
Apache Spark Row Count: 20000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.29, N = 3 9.37
Apache Spark Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.29, N = 3 10.47
Apache Spark Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.59, N = 3 9.90
Apache Spark Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.17, N = 12 13.58
Apache Spark Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.22, N = 12 73.62
Apache Spark Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7695 1.539 2.3085 3.078 3.8475 SE +/- 0.01, N = 12 3.42
Apache Spark Row Count: 20000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.02, N = 12 6.87
Apache Spark Row Count: 20000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.08, N = 12 9.40
Apache Spark Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.15, N = 12 10.79
Apache Spark Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 3 6 9 12 15 SE +/- 0.19, N = 12 10.14
Apache Spark Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 6 12 18 24 30 SE +/- 0.05, N = 3 23.11
Apache Spark Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.22, N = 3 72.90
Apache Spark Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.765 1.53 2.295 3.06 3.825 SE +/- 0.01, N = 3 3.40
Apache Spark Row Count: 40000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.12, N = 3 15.86
Apache Spark Row Count: 40000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.03, N = 3 16.79
Apache Spark Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 0.23, N = 3 18.52
Apache Spark Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.23, N = 3 18.14
Apache Spark Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 6 12 18 24 30 SE +/- 0.21, N = 12 24.03
Apache Spark Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.29, N = 12 73.76
Apache Spark Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.01, N = 12 3.39
Apache Spark Row Count: 40000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.17, N = 12 14.51
Apache Spark Row Count: 40000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 4 8 12 16 20 SE +/- 0.19, N = 12 17.68
Apache Spark Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 0.30, N = 12 19.95
Apache Spark Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 5 10 15 20 25 SE +/- 0.32, N = 12 18.89
Phoronix Test Suite v10.8.4