spark-benchmark-2024-02-26

2 x Intel Xeon E5-2699 v4 testing with a Supermicro X10DRL-i v1.01 (3.4 BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2402261-NE-SPARKBENC89&rdt.

spark-benchmark-2024-02-26ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDisplay ServerVulkanCompilerFile-SystemScreen Resolution2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicroappleseed-benchmark-2024-02-262 x Intel Xeon E5-2699 v4 @ 3.60GHz (44 Cores / 88 Threads)Supermicro X10DRL-i v1.01 (3.4 BIOS)Intel Xeon E7 v4/Xeon128GB1920GB INTEL SSDSC2KG01ASPEED2 x Intel I210Ubuntu 22.046.5.0-21-generic (x86_64)X Server 1.21.1.41.3.255GCC 11.4.0ext41024x768OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseProcessor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb000040Java Details- 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro: OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu122.04)Python Details- 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro: Python 3.10.12Security Details- gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable

spark-benchmark-2024-02-26spark: 1000000 - 100 - SHA-512 Benchmark Timespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 100 - Group By Test Timespark: 1000000 - 100 - Repartition Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Broadcast Inner Join Test Timeappleseed: Disney Material2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicroappleseed-benchmark-2024-02-264.9971.5277913274.327.073.283.012.0998.515946OpenBenchmarking.org

Apache Spark

Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro1.12282.24563.36844.49125.614SE +/- 0.04, N = 154.99

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro1632486480SE +/- 0.21, N = 1571.53

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.9721.9442.9163.8884.86SE +/- 0.02, N = 154.32

Apache Spark

Row Count: 1000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro246810SE +/- 0.03, N = 157.07

Apache Spark

Row Count: 1000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.7381.4762.2142.9523.69SE +/- 0.06, N = 153.28

Apache Spark

Row Count: 1000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.67731.35462.03192.70923.3865SE +/- 0.05, N = 153.01

Apache Spark

Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.47030.94061.41091.88122.3515SE +/- 0.02, N = 152.09

Appleseed

Scene: Disney Material

OpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Disney Materialappleseed-benchmark-2024-02-262040608010098.52

Phoronix Test Suite v10.8.4