5950xspark AMD Ryzen 9 5950X 16-Core testing with a Gigabyte X570 AORUS ELITE WIFI (F37d BIOS) and eVGA NVIDIA GeForce GTX 1060 6GB on Gentoo 2.8 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2208149-QUAR-220812204&grr .
5950xspark Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver Compiler File-System Screen Resolution AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads) Gigabyte X570 AORUS ELITE WIFI (F37c BIOS) AMD Starship/Matisse 2 x 16 GB DDR4-3733MT/s TEAMGROUP-UD4-3600 2 x 1000GB Samsung SSD 980 PRO 1TB eVGA NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio DELL 2707WFP Intel I211 + Intel Dual Band-AC 3168NGW Gentoo 2.8 5.19.0-gentoo-harambe-edition (x86_64) KDE Plasma 5.25.4 X Server 1.21.1.4 NVIDIA 515.65.01 GCC 11.3.0 ext4 3840x1200 Gigabyte X570 AORUS ELITE WIFI (F37d BIOS) 5.19.1-gentoo-harambe-edition (x86_64) OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 Java Details - AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX: OpenJDK Runtime Environment Temurin-17.0.3+7 (build 17.0.3+7) - biosupdate: OpenJDK Runtime Environment 17.0.3_p7-r1 (build 17.0.3+7) - run3: OpenJDK Runtime Environment 17.0.3_p7-r1 (build 17.0.3+7) Python Details - Python 3.10.5 Security Details - AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected - biosupdate: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - run3: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
5950xspark spark: 10000000 - 1000 - Broadcast Inner Join Test Time spark: 10000000 - 1000 - Inner Join Test Time spark: 10000000 - 1000 - Repartition Test Time spark: 10000000 - 1000 - Group By Test Time spark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 1000 - Calculate Pi Benchmark spark: 10000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 2000 - Broadcast Inner Join Test Time spark: 10000000 - 2000 - Inner Join Test Time spark: 10000000 - 2000 - Repartition Test Time spark: 10000000 - 2000 - Group By Test Time spark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 2000 - Calculate Pi Benchmark spark: 10000000 - 2000 - SHA-512 Benchmark Time spark: 1000000 - 1000 - Broadcast Inner Join Test Time spark: 1000000 - 1000 - Inner Join Test Time spark: 1000000 - 1000 - Repartition Test Time spark: 1000000 - 1000 - Group By Test Time spark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 1000 - Calculate Pi Benchmark spark: 1000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 100 - Broadcast Inner Join Test Time spark: 10000000 - 100 - Inner Join Test Time spark: 10000000 - 100 - Repartition Test Time spark: 10000000 - 100 - Group By Test Time spark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 100 - Calculate Pi Benchmark spark: 10000000 - 100 - SHA-512 Benchmark Time spark: 1000000 - 500 - Broadcast Inner Join Test Time spark: 1000000 - 500 - Inner Join Test Time spark: 1000000 - 500 - Repartition Test Time spark: 1000000 - 500 - Group By Test Time spark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 500 - Calculate Pi Benchmark spark: 1000000 - 500 - SHA-512 Benchmark Time spark: 10000000 - 500 - Broadcast Inner Join Test Time spark: 10000000 - 500 - Inner Join Test Time spark: 10000000 - 500 - Repartition Test Time spark: 10000000 - 500 - Group By Test Time spark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 500 - Calculate Pi Benchmark spark: 10000000 - 500 - SHA-512 Benchmark Time spark: 1000000 - 2000 - Broadcast Inner Join Test Time spark: 1000000 - 2000 - Inner Join Test Time spark: 1000000 - 2000 - Repartition Test Time spark: 1000000 - 2000 - Group By Test Time spark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 2000 - Calculate Pi Benchmark spark: 1000000 - 2000 - SHA-512 Benchmark Time spark: 1000000 - 100 - Broadcast Inner Join Test Time spark: 1000000 - 100 - Inner Join Test Time spark: 1000000 - 100 - Repartition Test Time spark: 1000000 - 100 - Group By Test Time spark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 100 - Calculate Pi Benchmark spark: 1000000 - 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 5.01 5.29 4.68 4.66 3.39 73.66 7.09 5.47 6.04 4.96 4.83 3.39 73.62 7.61 1.06 1.24 1.37 2.67 3.37 74.121481115 2.22 4.87 5.14 4.61 4.62 3.42 73.400895013 6.92 0.90 1.18 1.31 2.62 3.39 73.331568231 2.14 4.66 5.00 4.35 4.14 3.36 73.559974893 6.51 1.35 1.67 1.62 2.97 3.37 73.862269513 2.39 0.85 1.06 1.284012022 2.85 3.40 73.188368369 2.19 5.030332925 5.18 4.67 4.547132891 3.33 72.340356028 6.80 5.51 6.05 5.04 4.782490479 3.36 72.597187220 7.58 1.07 1.31 1.38 2.61 3.40 73.315972914 2.20 5.11 5.30 4.80 4.54 3.36 72.602425360 7.00 0.88 1.18 1.28 2.54 3.40 73.155361744 2.11 4.31 4.84 4.37 4.12 3.32 72.69 6.46 1.60 1.85 1.66 2.97 3.34 72.243896245 2.43 0.78 1.00 1.26 2.706542193 3.376076714 71.833082625 2.084516000 4.97 5.22 4.66 4.60 3.35 72.971566274 7.16 5.63 6.15 5.08 4.89 3.38 72.90 7.59 1.030154333 1.288637942 1.36 2.59 3.35 72.397735201 2.174480498 4.76 5.03 4.50 4.55 3.37 72.805421372 6.89 0.91 1.15 1.322680530 2.56 3.383028862 72.958775560 2.11 4.35 4.80 4.36 4.12 3.36 72.516467036 6.45 1.58 1.783195486 1.70 2.968895385 3.35 73.315666958 2.46 0.82 1.036923318 1.246820785 2.701018099 3.355984574 73.250036258 2.073868692 OpenBenchmarking.org
Apache Spark Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.081633186, N = 15 SE +/- 0.045345498, N = 3 SE +/- 0.055199356, N = 15 5.010000000 5.030332925 4.970000000
Apache Spark Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.1903 2.3806 3.5709 4.7612 5.9515 SE +/- 0.05, N = 15 SE +/- 0.05, N = 3 SE +/- 0.04, N = 15 5.29 5.18 5.22
Apache Spark Row Count: 10000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.053 2.106 3.159 4.212 5.265 SE +/- 0.04, N = 15 SE +/- 0.07, N = 3 SE +/- 0.03, N = 15 4.68 4.67 4.66
Apache Spark Row Count: 10000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.0485 2.097 3.1455 4.194 5.2425 SE +/- 0.027353887, N = 15 SE +/- 0.024456312, N = 3 SE +/- 0.019369254, N = 15 4.660000000 4.547132891 4.600000000
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.01, N = 15 SE +/- 0.02, N = 3 SE +/- 0.01, N = 15 3.39 3.33 3.35
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.13, N = 15 SE +/- 0.67, N = 3 SE +/- 0.21, N = 15 73.66 72.34 72.97
Apache Spark Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 2 4 6 8 10 SE +/- 0.06, N = 15 SE +/- 0.02, N = 3 SE +/- 0.07, N = 15 7.09 6.80 7.16
Apache Spark Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.2668 2.5336 3.8004 5.0672 6.334 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 15 5.47 5.51 5.63
Apache Spark Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 2 4 6 8 10 SE +/- 0.26, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 15 6.04 6.05 6.15
Apache Spark Row Count: 10000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.143 2.286 3.429 4.572 5.715 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 15 4.96 5.04 5.08
Apache Spark Row Count: 10000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.1003 2.2006 3.3009 4.4012 5.5015 SE +/- 0.025414084, N = 3 SE +/- 0.040437448, N = 3 SE +/- 0.013015326, N = 15 4.830000000 4.782490479 4.890000000
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 15 3.39 3.36 3.38
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.44, N = 3 SE +/- 0.41, N = 3 SE +/- 0.18, N = 15 73.62 72.60 72.90
Apache Spark Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 15 7.61 7.58 7.59
Apache Spark Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.028225821, N = 3 SE +/- 0.012599815, N = 15 SE +/- 0.003729003, N = 3 1.060000000 1.070000000 1.030154333
Apache Spark Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.2948 0.5896 0.8844 1.1792 1.474 SE +/- 0.047560271, N = 3 SE +/- 0.010845249, N = 15 SE +/- 0.012954848, N = 3 1.240000000 1.310000000 1.288637942
Apache Spark Row Count: 1000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.3105 0.621 0.9315 1.242 1.5525 SE +/- 0.02, N = 3 SE +/- 0.01, N = 15 SE +/- 0.01, N = 3 1.37 1.38 1.36
Apache Spark Row Count: 1000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.6008 1.2016 1.8024 2.4032 3.004 SE +/- 0.04, N = 3 SE +/- 0.02, N = 15 SE +/- 0.01, N = 3 2.67 2.61 2.59
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.765 1.53 2.295 3.06 3.825 SE +/- 0.01, N = 3 SE +/- 0.01, N = 15 SE +/- 0.01, N = 3 3.37 3.40 3.35
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.34, N = 3 SE +/- 0.17, N = 15 SE +/- 0.37, N = 3 74.12 73.32 72.40
Apache Spark Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.4995 0.999 1.4985 1.998 2.4975 SE +/- 0.005834761, N = 3 SE +/- 0.018146528, N = 15 SE +/- 0.017037429, N = 3 2.220000000 2.200000000 2.174480498
Apache Spark Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.1498 2.2996 3.4494 4.5992 5.749 SE +/- 0.06, N = 3 SE +/- 0.11, N = 9 SE +/- 0.03, N = 3 4.87 5.11 4.76
Apache Spark Row Count: 10000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.1925 2.385 3.5775 4.77 5.9625 SE +/- 0.07, N = 3 SE +/- 0.09, N = 9 SE +/- 0.04, N = 3 5.14 5.30 5.03
Apache Spark Row Count: 10000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.08 2.16 3.24 4.32 5.4 SE +/- 0.04, N = 3 SE +/- 0.06, N = 9 SE +/- 0.04, N = 3 4.61 4.80 4.50
Apache Spark Row Count: 10000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.0395 2.079 3.1185 4.158 5.1975 SE +/- 0.04, N = 3 SE +/- 0.02, N = 9 SE +/- 0.02, N = 3 4.62 4.54 4.55
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.7695 1.539 2.3085 3.078 3.8475 SE +/- 0.00, N = 3 SE +/- 0.01, N = 9 SE +/- 0.02, N = 3 3.42 3.36 3.37
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.28, N = 3 SE +/- 0.18, N = 9 SE +/- 0.40, N = 3 73.40 72.60 72.81
Apache Spark Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.06, N = 9 SE +/- 0.01, N = 3 6.92 7.00 6.89
Apache Spark Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.2048 0.4096 0.6144 0.8192 1.024 SE +/- 0.01, N = 9 SE +/- 0.01, N = 5 SE +/- 0.03, N = 3 0.90 0.88 0.91
Apache Spark Row Count: 1000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.2655 0.531 0.7965 1.062 1.3275 SE +/- 0.01, N = 9 SE +/- 0.01, N = 5 SE +/- 0.02, N = 3 1.18 1.18 1.15
Apache Spark Row Count: 1000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.2976 0.5952 0.8928 1.1904 1.488 SE +/- 0.006140697, N = 9 SE +/- 0.011466668, N = 5 SE +/- 0.021467852, N = 3 1.310000000 1.280000000 1.322680530
Apache Spark Row Count: 1000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.5895 1.179 1.7685 2.358 2.9475 SE +/- 0.02, N = 9 SE +/- 0.02, N = 5 SE +/- 0.03, N = 3 2.62 2.54 2.56
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.765 1.53 2.295 3.06 3.825 SE +/- 0.010285382, N = 9 SE +/- 0.017527129, N = 5 SE +/- 0.019118909, N = 3 3.390000000 3.400000000 3.383028862
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.21, N = 9 SE +/- 0.08, N = 5 SE +/- 0.40, N = 3 73.33 73.16 72.96
Apache Spark Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.4815 0.963 1.4445 1.926 2.4075 SE +/- 0.02, N = 9 SE +/- 0.02, N = 5 SE +/- 0.03, N = 3 2.14 2.11 2.11
Apache Spark Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.0485 2.097 3.1455 4.194 5.2425 SE +/- 0.21, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 4.66 4.31 4.35
Apache Spark Row Count: 10000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.125 2.25 3.375 4.5 5.625 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 5.00 4.84 4.80
Apache Spark Row Count: 10000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.9833 1.9666 2.9499 3.9332 4.9165 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 4.35 4.37 4.36
Apache Spark Row Count: 10000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.9315 1.863 2.7945 3.726 4.6575 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 4.14 4.12 4.12
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.756 1.512 2.268 3.024 3.78 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 3.36 3.32 3.36
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.39, N = 3 SE +/- 0.24, N = 3 SE +/- 0.30, N = 3 73.56 72.69 72.52
Apache Spark Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 2 4 6 8 10 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 6.51 6.46 6.45
Apache Spark Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.36 0.72 1.08 1.44 1.8 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 1.35 1.60 1.58
Apache Spark Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.4163 0.8326 1.2489 1.6652 2.0815 SE +/- 0.015096162, N = 3 SE +/- 0.023342599, N = 3 SE +/- 0.019200265, N = 3 1.670000000 1.850000000 1.783195486
Apache Spark Row Count: 1000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.3825 0.765 1.1475 1.53 1.9125 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 1.62 1.66 1.70
Apache Spark Row Count: 1000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.6683 1.3366 2.0049 2.6732 3.3415 SE +/- 0.004893060, N = 3 SE +/- 0.024308288, N = 3 SE +/- 0.020703226, N = 3 2.970000000 2.970000000 2.968895385
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.7583 1.5166 2.2749 3.0332 3.7915 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 3.37 3.34 3.35
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.10, N = 3 SE +/- 0.26, N = 3 SE +/- 0.18, N = 3 73.86 72.24 73.32
Apache Spark Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.5535 1.107 1.6605 2.214 2.7675 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.39 2.43 2.46
Apache Spark Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.1913 0.3826 0.5739 0.7652 0.9565 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 0.85 0.78 0.82
Apache Spark Row Count: 1000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.2385 0.477 0.7155 0.954 1.1925 SE +/- 0.031879521, N = 3 SE +/- 0.055926683, N = 3 SE +/- 0.018923539, N = 3 1.060000000 1.000000000 1.036923318
Apache Spark Row Count: 1000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.2889 0.5778 0.8667 1.1556 1.4445 SE +/- 0.026244349, N = 3 SE +/- 0.005255675, N = 3 SE +/- 0.011339499, N = 3 1.284012022 1.260000000 1.246820785
Apache Spark Row Count: 1000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.6413 1.2826 1.9239 2.5652 3.2065 SE +/- 0.002674928, N = 3 SE +/- 0.018597071, N = 3 SE +/- 0.015733792, N = 3 2.850000000 2.706542193 2.701018099
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.765 1.53 2.295 3.06 3.825 SE +/- 0.007006827, N = 3 SE +/- 0.015434365, N = 3 SE +/- 0.035994588, N = 3 3.400000000 3.376076714 3.355984574
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 16 32 48 64 80 SE +/- 0.68, N = 3 SE +/- 0.40, N = 3 SE +/- 0.94, N = 3 73.19 71.83 73.25
Apache Spark Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.023234964, N = 3 SE +/- 0.018586861, N = 3 SE +/- 0.005436250, N = 3 2.190000000 2.084516000 2.073868692
Phoronix Test Suite v10.8.4