5950xspark AMD Ryzen 9 5950X 16-Core testing with a Gigabyte X570 AORUS ELITE WIFI (F37d BIOS) and eVGA NVIDIA GeForce GTX 1060 6GB on Gentoo 2.8 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2208149-QUAR-220812204&grr&sor .
5950xspark Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver Compiler File-System Screen Resolution AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads) Gigabyte X570 AORUS ELITE WIFI (F37c BIOS) AMD Starship/Matisse 2 x 16 GB DDR4-3733MT/s TEAMGROUP-UD4-3600 2 x 1000GB Samsung SSD 980 PRO 1TB eVGA NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio DELL 2707WFP Intel I211 + Intel Dual Band-AC 3168NGW Gentoo 2.8 5.19.0-gentoo-harambe-edition (x86_64) KDE Plasma 5.25.4 X Server 1.21.1.4 NVIDIA 515.65.01 GCC 11.3.0 ext4 3840x1200 Gigabyte X570 AORUS ELITE WIFI (F37d BIOS) 5.19.1-gentoo-harambe-edition (x86_64) OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 Java Details - AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX: OpenJDK Runtime Environment Temurin-17.0.3+7 (build 17.0.3+7) - biosupdate: OpenJDK Runtime Environment 17.0.3_p7-r1 (build 17.0.3+7) - run3: OpenJDK Runtime Environment 17.0.3_p7-r1 (build 17.0.3+7) Python Details - Python 3.10.5 Security Details - AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected - biosupdate: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - run3: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
5950xspark spark: 10000000 - 1000 - Broadcast Inner Join Test Time spark: 10000000 - 1000 - Inner Join Test Time spark: 10000000 - 1000 - Repartition Test Time spark: 10000000 - 1000 - Group By Test Time spark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 1000 - Calculate Pi Benchmark spark: 10000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 2000 - Broadcast Inner Join Test Time spark: 10000000 - 2000 - Inner Join Test Time spark: 10000000 - 2000 - Repartition Test Time spark: 10000000 - 2000 - Group By Test Time spark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 2000 - Calculate Pi Benchmark spark: 10000000 - 2000 - SHA-512 Benchmark Time spark: 1000000 - 1000 - Broadcast Inner Join Test Time spark: 1000000 - 1000 - Inner Join Test Time spark: 1000000 - 1000 - Repartition Test Time spark: 1000000 - 1000 - Group By Test Time spark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 1000 - Calculate Pi Benchmark spark: 1000000 - 1000 - SHA-512 Benchmark Time spark: 10000000 - 100 - Broadcast Inner Join Test Time spark: 10000000 - 100 - Inner Join Test Time spark: 10000000 - 100 - Repartition Test Time spark: 10000000 - 100 - Group By Test Time spark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 100 - Calculate Pi Benchmark spark: 10000000 - 100 - SHA-512 Benchmark Time spark: 1000000 - 500 - Broadcast Inner Join Test Time spark: 1000000 - 500 - Inner Join Test Time spark: 1000000 - 500 - Repartition Test Time spark: 1000000 - 500 - Group By Test Time spark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 500 - Calculate Pi Benchmark spark: 1000000 - 500 - SHA-512 Benchmark Time spark: 10000000 - 500 - Broadcast Inner Join Test Time spark: 10000000 - 500 - Inner Join Test Time spark: 10000000 - 500 - Repartition Test Time spark: 10000000 - 500 - Group By Test Time spark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 10000000 - 500 - Calculate Pi Benchmark spark: 10000000 - 500 - SHA-512 Benchmark Time spark: 1000000 - 2000 - Broadcast Inner Join Test Time spark: 1000000 - 2000 - Inner Join Test Time spark: 1000000 - 2000 - Repartition Test Time spark: 1000000 - 2000 - Group By Test Time spark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 2000 - Calculate Pi Benchmark spark: 1000000 - 2000 - SHA-512 Benchmark Time spark: 1000000 - 100 - Broadcast Inner Join Test Time spark: 1000000 - 100 - Inner Join Test Time spark: 1000000 - 100 - Repartition Test Time spark: 1000000 - 100 - Group By Test Time spark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 100 - Calculate Pi Benchmark spark: 1000000 - 100 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 5.01 5.29 4.68 4.66 3.39 73.66 7.09 5.47 6.04 4.96 4.83 3.39 73.62 7.61 1.06 1.24 1.37 2.67 3.37 74.121481115 2.22 4.87 5.14 4.61 4.62 3.42 73.400895013 6.92 0.90 1.18 1.31 2.62 3.39 73.331568231 2.14 4.66 5.00 4.35 4.14 3.36 73.559974893 6.51 1.35 1.67 1.62 2.97 3.37 73.862269513 2.39 0.85 1.06 1.284012022 2.85 3.40 73.188368369 2.19 5.030332925 5.18 4.67 4.547132891 3.33 72.340356028 6.80 5.51 6.05 5.04 4.782490479 3.36 72.597187220 7.58 1.07 1.31 1.38 2.61 3.40 73.315972914 2.20 5.11 5.30 4.80 4.54 3.36 72.602425360 7.00 0.88 1.18 1.28 2.54 3.40 73.155361744 2.11 4.31 4.84 4.37 4.12 3.32 72.69 6.46 1.60 1.85 1.66 2.97 3.34 72.243896245 2.43 0.78 1.00 1.26 2.706542193 3.376076714 71.833082625 2.084516000 4.97 5.22 4.66 4.60 3.35 72.971566274 7.16 5.63 6.15 5.08 4.89 3.38 72.90 7.59 1.030154333 1.288637942 1.36 2.59 3.35 72.397735201 2.174480498 4.76 5.03 4.50 4.55 3.37 72.805421372 6.89 0.91 1.15 1.322680530 2.56 3.383028862 72.958775560 2.11 4.35 4.80 4.36 4.12 3.36 72.516467036 6.45 1.58 1.783195486 1.70 2.968895385 3.35 73.315666958 2.46 0.82 1.036923318 1.246820785 2.701018099 3.355984574 73.250036258 2.073868692 OpenBenchmarking.org
Apache Spark Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.055199356, N = 15 SE +/- 0.081633186, N = 15 SE +/- 0.045345498, N = 3 4.970000000 5.010000000 5.030332925
Apache Spark Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Inner Join Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.1903 2.3806 3.5709 4.7612 5.9515 SE +/- 0.05, N = 3 SE +/- 0.04, N = 15 SE +/- 0.05, N = 15 5.18 5.22 5.29
Apache Spark Row Count: 10000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Repartition Test Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.053 2.106 3.159 4.212 5.265 SE +/- 0.03, N = 15 SE +/- 0.07, N = 3 SE +/- 0.04, N = 15 4.66 4.67 4.68
Apache Spark Row Count: 10000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Group By Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.0485 2.097 3.1455 4.194 5.2425 SE +/- 0.024456312, N = 3 SE +/- 0.019369254, N = 15 SE +/- 0.027353887, N = 15 4.547132891 4.600000000 4.660000000
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.02, N = 3 SE +/- 0.01, N = 15 SE +/- 0.01, N = 15 3.33 3.35 3.39
Apache Spark Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.67, N = 3 SE +/- 0.21, N = 15 SE +/- 0.13, N = 15 72.34 72.97 73.66
Apache Spark Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark Time biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.06, N = 15 SE +/- 0.07, N = 15 6.80 7.09 7.16
Apache Spark Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.2668 2.5336 3.8004 5.0672 6.334 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 15 5.47 5.51 5.63
Apache Spark Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 2 4 6 8 10 SE +/- 0.26, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 15 6.04 6.05 6.15
Apache Spark Row Count: 10000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 1.143 2.286 3.429 4.572 5.715 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 15 4.96 5.04 5.08
Apache Spark Row Count: 10000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Group By Test Time biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 1.1003 2.2006 3.3009 4.4012 5.5015 SE +/- 0.040437448, N = 3 SE +/- 0.025414084, N = 3 SE +/- 0.013015326, N = 15 4.782490479 4.830000000 4.890000000
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.01, N = 3 SE +/- 0.01, N = 15 SE +/- 0.02, N = 3 3.36 3.38 3.39
Apache Spark Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.41, N = 3 SE +/- 0.18, N = 15 SE +/- 0.44, N = 3 72.60 72.90 73.62
Apache Spark Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.08, N = 3 SE +/- 0.08, N = 15 SE +/- 0.04, N = 3 7.58 7.59 7.61
Apache Spark Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.003729003, N = 3 SE +/- 0.028225821, N = 3 SE +/- 0.012599815, N = 15 1.030154333 1.060000000 1.070000000
Apache Spark Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 biosupdate 0.2948 0.5896 0.8844 1.1792 1.474 SE +/- 0.047560271, N = 3 SE +/- 0.012954848, N = 3 SE +/- 0.010845249, N = 15 1.240000000 1.288637942 1.310000000
Apache Spark Row Count: 1000000 - Partitions: 1000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Repartition Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.3105 0.621 0.9315 1.242 1.5525 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 15 1.36 1.37 1.38
Apache Spark Row Count: 1000000 - Partitions: 1000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Group By Test Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.6008 1.2016 1.8024 2.4032 3.004 SE +/- 0.01, N = 3 SE +/- 0.02, N = 15 SE +/- 0.04, N = 3 2.59 2.61 2.67
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using Dataframe run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.765 1.53 2.295 3.06 3.825 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 15 3.35 3.37 3.40
Apache Spark Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.37, N = 3 SE +/- 0.17, N = 15 SE +/- 0.34, N = 3 72.40 73.32 74.12
Apache Spark Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.4995 0.999 1.4985 1.998 2.4975 SE +/- 0.017037429, N = 3 SE +/- 0.018146528, N = 15 SE +/- 0.005834761, N = 3 2.174480498 2.200000000 2.220000000
Apache Spark Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.1498 2.2996 3.4494 4.5992 5.749 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 9 4.76 4.87 5.11
Apache Spark Row Count: 10000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Inner Join Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.1925 2.385 3.5775 4.77 5.9625 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 9 5.03 5.14 5.30
Apache Spark Row Count: 10000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Repartition Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 1.08 2.16 3.24 4.32 5.4 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 9 4.50 4.61 4.80
Apache Spark Row Count: 10000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Group By Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.0395 2.079 3.1185 4.158 5.1975 SE +/- 0.02, N = 9 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 4.54 4.55 4.62
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7695 1.539 2.3085 3.078 3.8475 SE +/- 0.01, N = 9 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 3.36 3.37 3.42
Apache Spark Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.18, N = 9 SE +/- 0.40, N = 3 SE +/- 0.28, N = 3 72.60 72.81 73.40
Apache Spark Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 9 6.89 6.92 7.00
Apache Spark Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 0.2048 0.4096 0.6144 0.8192 1.024 SE +/- 0.01, N = 5 SE +/- 0.01, N = 9 SE +/- 0.03, N = 3 0.88 0.90 0.91
Apache Spark Row Count: 1000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.2655 0.531 0.7965 1.062 1.3275 SE +/- 0.02, N = 3 SE +/- 0.01, N = 9 SE +/- 0.01, N = 5 1.15 1.18 1.18
Apache Spark Row Count: 1000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 0.2976 0.5952 0.8928 1.1904 1.488 SE +/- 0.011466668, N = 5 SE +/- 0.006140697, N = 9 SE +/- 0.021467852, N = 3 1.280000000 1.310000000 1.322680530
Apache Spark Row Count: 1000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.5895 1.179 1.7685 2.358 2.9475 SE +/- 0.02, N = 5 SE +/- 0.03, N = 3 SE +/- 0.02, N = 9 2.54 2.56 2.62
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.765 1.53 2.295 3.06 3.825 SE +/- 0.019118909, N = 3 SE +/- 0.010285382, N = 9 SE +/- 0.017527129, N = 5 3.383028862 3.390000000 3.400000000
Apache Spark Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.40, N = 3 SE +/- 0.08, N = 5 SE +/- 0.21, N = 9 72.96 73.16 73.33
Apache Spark Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.4815 0.963 1.4445 1.926 2.4075 SE +/- 0.02, N = 5 SE +/- 0.03, N = 3 SE +/- 0.02, N = 9 2.11 2.11 2.14
Apache Spark Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.0485 2.097 3.1455 4.194 5.2425 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.21, N = 3 4.31 4.35 4.66
Apache Spark Row Count: 10000000 - Partitions: 500 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Inner Join Test Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 1.125 2.25 3.375 4.5 5.625 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 4.80 4.84 5.00
Apache Spark Row Count: 10000000 - Partitions: 500 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 biosupdate 0.9833 1.9666 2.9499 3.9332 4.9165 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 4.35 4.36 4.37
Apache Spark Row Count: 10000000 - Partitions: 500 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Group By Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.9315 1.863 2.7945 3.726 4.6575 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 4.12 4.12 4.14
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 0.756 1.512 2.268 3.024 3.78 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 3.32 3.36 3.36
Apache Spark Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.30, N = 3 SE +/- 0.24, N = 3 SE +/- 0.39, N = 3 72.52 72.69 73.56
Apache Spark Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 2 4 6 8 10 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 6.45 6.46 6.51
Apache Spark Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 biosupdate 0.36 0.72 1.08 1.44 1.8 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 1.35 1.58 1.60
Apache Spark Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Inner Join Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 biosupdate 0.4163 0.8326 1.2489 1.6652 2.0815 SE +/- 0.015096162, N = 3 SE +/- 0.019200265, N = 3 SE +/- 0.023342599, N = 3 1.670000000 1.783195486 1.850000000
Apache Spark Row Count: 1000000 - Partitions: 2000 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Repartition Test Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.3825 0.765 1.1475 1.53 1.9125 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 1.62 1.66 1.70
Apache Spark Row Count: 1000000 - Partitions: 2000 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Group By Test Time run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate 0.6683 1.3366 2.0049 2.6732 3.3415 SE +/- 0.020703226, N = 3 SE +/- 0.004893060, N = 3 SE +/- 0.024308288, N = 3 2.968895385 2.970000000 2.970000000
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using Dataframe biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.7583 1.5166 2.2749 3.0332 3.7915 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 3.34 3.35 3.37
Apache Spark Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 16 32 48 64 80 SE +/- 0.26, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 72.24 73.32 73.86
Apache Spark Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark Time AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX biosupdate run3 0.5535 1.107 1.6605 2.214 2.7675 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.39 2.43 2.46
Apache Spark Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.1913 0.3826 0.5739 0.7652 0.9565 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 0.78 0.82 0.85
Apache Spark Row Count: 1000000 - Partitions: 100 - Inner Join Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time biosupdate run3 AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.2385 0.477 0.7155 0.954 1.1925 SE +/- 0.055926683, N = 3 SE +/- 0.018923539, N = 3 SE +/- 0.031879521, N = 3 1.000000000 1.036923318 1.060000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Repartition Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.2889 0.5778 0.8667 1.1556 1.4445 SE +/- 0.011339499, N = 3 SE +/- 0.005255675, N = 3 SE +/- 0.026244349, N = 3 1.246820785 1.260000000 1.284012022
Apache Spark Row Count: 1000000 - Partitions: 100 - Group By Test Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.6413 1.2826 1.9239 2.5652 3.2065 SE +/- 0.015733792, N = 3 SE +/- 0.018597071, N = 3 SE +/- 0.002674928, N = 3 2.701018099 2.706542193 2.850000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.765 1.53 2.295 3.06 3.825 SE +/- 0.035994588, N = 3 SE +/- 0.015434365, N = 3 SE +/- 0.007006827, N = 3 3.355984574 3.376076714 3.400000000
Apache Spark Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX run3 16 32 48 64 80 SE +/- 0.40, N = 3 SE +/- 0.68, N = 3 SE +/- 0.94, N = 3 71.83 73.19 73.25
Apache Spark Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time run3 biosupdate AMD Ryzen 9 5950X 16-Core - eVGA NVIDIA GeForce GTX 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.005436250, N = 3 SE +/- 0.018586861, N = 3 SE +/- 0.023234964, N = 3 2.073868692 2.084516000 2.190000000
Phoronix Test Suite v10.8.5