5950xspark AMD Ryzen 9 5950X 16-Core testing with a Gigabyte X570 AORUS ELITE WIFI (F37d BIOS) and eVGA NVIDIA GeForce GTX 1060 6GB on Gentoo 2.8 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2208122-QUAR-220810448&gru .
5950xspark Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver Compiler File-System Screen Resolution AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads) Gigabyte X570 AORUS ELITE WIFI (F37c BIOS) AMD Starship/Matisse 2 x 16 GB DDR4-3733MT/s TEAMGROUP-UD4-3600 2 x 1000GB Samsung SSD 980 PRO 1TB eVGA NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio DELL 2707WFP Intel I211 + Intel Dual Band-AC 3168NGW Gentoo 2.8 5.19.0-gentoo-harambe-edition (x86_64) KDE Plasma 5.25.4 X Server 1.21.1.4 NVIDIA 515.65.01 GCC 11.3.0 ext4 3840x1200 Gigabyte X570 AORUS ELITE WIFI (F37d BIOS) 5.19.1-gentoo-harambe-edition (x86_64) OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 Java Details - AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX: OpenJDK Runtime Environment Temurin-17.0.3+7 (build 17.0.3+7) - biosupdate: OpenJDK Runtime Environment 17.0.3_p7-r1 (build 17.0.3+7) Python Details - Python 3.10.5 Security Details - AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected - biosupdate: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
5950xspark spark: 1000000 - 100 - SHA-512 Benchmark Time spark: 1000000 - 100 - Calculate Pi Benchmark spark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 100 - Group By Test Time spark: 1000000 - 100 - Repartition Test Time spark: 1000000 - 100 - Inner Join Test Time spark: 1000000 - 100 - Broadcast Inner Join Test Time spark: 1000000 - 500 - SHA-512 Benchmark Time spark: 1000000 - 500 - Calculate Pi Benchmark spark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 500 - Group By Test Time spark: 1000000 - 500 - Repartition Test Time spark: 1000000 - 500 - Inner Join Test Time spark: 1000000 - 500 - Broadcast Inner Join Test Time spark: 1000000 - 1000 - SHA-512 Benchmark Time spark: 1000000 - 1000 - Calculate Pi Benchmark spark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 1000 - Group By Test Time spark: 1000000 - 1000 - Repartition Test Time spark: 1000000 - 1000 - Inner Join Test Time spark: 1000000 - 1000 - Broadcast Inner Join Test Time spark: 1000000 - 2000 - SHA-512 Benchmark Time spark: 1000000 - 2000 - Calculate Pi Benchmark spark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 2000 - Group By Test Time spark: 1000000 - 2000 - Repartition Test Time spark: 1000000 - 2000 - Inner Join Test Time spark: 1000000 - 2000 - Broadcast Inner Join Test Time spark: 10000000 - 100 - SHA-512 Benchmark Time spark: 10000000 - 100 - Calculate Pi Benchmark spark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 100 - Group By Test Time spark: 10000000 - 100 - Repartition Test Time spark: 10000000 - 100 - Inner Join Test Time spark: 10000000 - 100 - Broadcast Inner Join Test Time spark: 10000000 - 500 - SHA-512 Benchmark Time spark: 10000000 - 500 - Calculate Pi Benchmark spark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 500 - Group By Test Time spark: 10000000 - 500 - Repartition Test Time spark: 10000000 - 500 - Inner Join Test Time spark: 10000000 - 500 - Broadcast Inner Join Test Time spark: 10000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 1000 - Calculate Pi Benchmark spark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 1000 - Group By Test Time spark: 10000000 - 1000 - Repartition Test Time spark: 10000000 - 1000 - Inner Join Test Time spark: 10000000 - 1000 - Broadcast Inner Join Test Time spark: 10000000 - 2000 - SHA-512 Benchmark Time spark: 10000000 - 2000 - Calculate Pi Benchmark spark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 2000 - Group By Test Time spark: 10000000 - 2000 - Repartition Test Time spark: 10000000 - 2000 - Inner Join Test Time spark: 10000000 - 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 2.19 73.188368369 3.40 2.85 1.284012022 1.06 0.85 2.14 73.331568231 3.39 2.62 1.31 1.18 0.90 2.22 74.121481115 3.37 2.67 1.37 1.24 1.06 2.39 73.862269513 3.37 2.97 1.62 1.67 1.35 6.92 73.400895013 3.42 4.62 4.61 5.14 4.87 6.51 73.559974893 3.36 4.14 4.35 5.00 4.66 7.09 73.66 3.39 4.66 4.68 5.29 5.01 7.61 73.62 3.39 4.83 4.96 6.04 5.47 2.084516000 71.833082625 3.376076714 2.706542193 1.26 1.00 0.78 2.11 73.155361744 3.40 2.54 1.28 1.18 0.88 2.20 73.315972914 3.40 2.61 1.38 1.31 1.07 2.43 72.243896245 3.34 2.97 1.66 1.85 1.60 7.00 72.602425360 3.36 4.54 4.80 5.30 5.11 6.46 72.69 3.32 4.12 4.37 4.84 4.31 6.80 72.340356028 3.33 4.547132891 4.67 5.18 5.030332925 7.58 72.597187220 3.36 4.782490479 5.04 6.05 5.51 OpenBenchmarking.org
Apache Spark Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.023234964, N = 3 SE +/- 0.018586861, N = 3 2.190000000 2.084516000
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.68, N = 3 SE +/- 0.40, N = 3 73.19 71.83
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.765 1.53 2.295 3.06 3.825 SE +/- 0.007006827, N = 3 SE +/- 0.015434365, N = 3 3.400000000 3.376076714
Apache Spark Row Count: 1000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.6413 1.2826 1.9239 2.5652 3.2065 SE +/- 0.002674928, N = 3 SE +/- 0.018597071, N = 3 2.850000000 2.706542193
Apache Spark Row Count: 1000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2889 0.5778 0.8667 1.1556 1.4445 SE +/- 0.026244349, N = 3 SE +/- 0.005255675, N = 3 1.284012022 1.260000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2385 0.477 0.7155 0.954 1.1925 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 1.06 1.00
Apache Spark Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.1913 0.3826 0.5739 0.7652 0.9565 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 0.85 0.78
Apache Spark Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.4815 0.963 1.4445 1.926 2.4075 SE +/- 0.02, N = 9 SE +/- 0.02, N = 5 2.14 2.11
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.21, N = 9 SE +/- 0.08, N = 5 73.33 73.16
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.765 1.53 2.295 3.06 3.825 SE +/- 0.01, N = 9 SE +/- 0.02, N = 5 3.39 3.40
Apache Spark Row Count: 1000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.5895 1.179 1.7685 2.358 2.9475 SE +/- 0.02, N = 9 SE +/- 0.02, N = 5 2.62 2.54
Apache Spark Row Count: 1000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2948 0.5896 0.8844 1.1792 1.474 SE +/- 0.01, N = 9 SE +/- 0.01, N = 5 1.31 1.28
Apache Spark Row Count: 1000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2655 0.531 0.7965 1.062 1.3275 SE +/- 0.01, N = 9 SE +/- 0.01, N = 5 1.18 1.18
Apache Spark Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2025 0.405 0.6075 0.81 1.0125 SE +/- 0.01, N = 9 SE +/- 0.01, N = 5 0.90 0.88
Apache Spark Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.4995 0.999 1.4985 1.998 2.4975 SE +/- 0.01, N = 3 SE +/- 0.02, N = 15 2.22 2.20
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.34, N = 3 SE +/- 0.17, N = 15 74.12 73.32
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.765 1.53 2.295 3.06 3.825 SE +/- 0.01, N = 3 SE +/- 0.01, N = 15 3.37 3.40
Apache Spark Row Count: 1000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.6008 1.2016 1.8024 2.4032 3.004 SE +/- 0.04, N = 3 SE +/- 0.02, N = 15 2.67 2.61
Apache Spark Row Count: 1000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.3105 0.621 0.9315 1.242 1.5525 SE +/- 0.02, N = 3 SE +/- 0.01, N = 15 1.37 1.38
Apache Spark Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2948 0.5896 0.8844 1.1792 1.474 SE +/- 0.05, N = 3 SE +/- 0.01, N = 15 1.24 1.31
Apache Spark Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.03, N = 3 SE +/- 0.01, N = 15 1.06 1.07
Apache Spark Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.5468 1.0936 1.6404 2.1872 2.734 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 2.39 2.43
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.10, N = 3 SE +/- 0.26, N = 3 73.86 72.24
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.7583 1.5166 2.2749 3.0332 3.7915 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 3.37 3.34
Apache Spark Row Count: 1000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.6683 1.3366 2.0049 2.6732 3.3415 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 2.97 2.97
Apache Spark Row Count: 1000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.3735 0.747 1.1205 1.494 1.8675 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 1.62 1.66
Apache Spark Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.4163 0.8326 1.2489 1.6652 2.0815 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 1.67 1.85
Apache Spark Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.36 0.72 1.08 1.44 1.8 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 1.35 1.60
Apache Spark Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.06, N = 9 6.92 7.00
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.28, N = 3 SE +/- 0.18, N = 9 73.40 72.60
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.7695 1.539 2.3085 3.078 3.8475 SE +/- 0.00, N = 3 SE +/- 0.01, N = 9 3.42 3.36
Apache Spark Row Count: 10000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.0395 2.079 3.1185 4.158 5.1975 SE +/- 0.04, N = 3 SE +/- 0.02, N = 9 4.62 4.54
Apache Spark Row Count: 10000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.08 2.16 3.24 4.32 5.4 SE +/- 0.04, N = 3 SE +/- 0.06, N = 9 4.61 4.80
Apache Spark Row Count: 10000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.1925 2.385 3.5775 4.77 5.9625 SE +/- 0.07, N = 3 SE +/- 0.09, N = 9 5.14 5.30
Apache Spark Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.1498 2.2996 3.4494 4.5992 5.749 SE +/- 0.06, N = 3 SE +/- 0.11, N = 9 4.87 5.11
Apache Spark Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 2 4 6 8 10 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 6.51 6.46
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.39, N = 3 SE +/- 0.24, N = 3 73.56 72.69
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.756 1.512 2.268 3.024 3.78 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 3.36 3.32
Apache Spark Row Count: 10000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.9315 1.863 2.7945 3.726 4.6575 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 4.14 4.12
Apache Spark Row Count: 10000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.9833 1.9666 2.9499 3.9332 4.9165 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 4.35 4.37
Apache Spark Row Count: 10000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.125 2.25 3.375 4.5 5.625 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 5.00 4.84
Apache Spark Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.0485 2.097 3.1455 4.194 5.2425 SE +/- 0.21, N = 3 SE +/- 0.11, N = 3 4.66 4.31
Apache Spark Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 2 4 6 8 10 SE +/- 0.06, N = 15 SE +/- 0.02, N = 3 7.09 6.80
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.13, N = 15 SE +/- 0.67, N = 3 73.66 72.34
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.01, N = 15 SE +/- 0.02, N = 3 3.39 3.33
Apache Spark Row Count: 10000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.0485 2.097 3.1455 4.194 5.2425 SE +/- 0.027353887, N = 15 SE +/- 0.024456312, N = 3 4.660000000 4.547132891
Apache Spark Row Count: 10000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.053 2.106 3.159 4.212 5.265 SE +/- 0.04, N = 15 SE +/- 0.07, N = 3 4.68 4.67
Apache Spark Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.1903 2.3806 3.5709 4.7612 5.9515 SE +/- 0.05, N = 15 SE +/- 0.05, N = 3 5.29 5.18
Apache Spark Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.081633186, N = 15 SE +/- 0.045345498, N = 3 5.010000000 5.030332925
Apache Spark Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 7.61 7.58
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 16 32 48 64 80 SE +/- 0.44, N = 3 SE +/- 0.41, N = 3 73.62 72.60
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 3.39 3.36
Apache Spark Row Count: 10000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.0868 2.1736 3.2604 4.3472 5.434 SE +/- 0.025414084, N = 3 SE +/- 0.040437448, N = 3 4.830000000 4.782490479
Apache Spark Row Count: 10000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.134 2.268 3.402 4.536 5.67 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 4.96 5.04
Apache Spark Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 2 4 6 8 10 SE +/- 0.26, N = 3 SE +/- 0.11, N = 3 6.04 6.05
Apache Spark Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.2398 2.4796 3.7194 4.9592 6.199 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 5.47 5.51
Phoronix Test Suite v10.8.4