apache-spark1m-100-benchmark-2024-02-28--

2 x Intel Xeon E5-2699 v4 testing with a Supermicro X10DRL-i v1.01 (3.4 BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2402286-NE-APACHESPA08
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro
February 28
  38 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro

Processor: 2 x Intel Xeon E5-2699 v4 @ 3.60GHz (44 Cores / 88 Threads), Motherboard: Supermicro X10DRL-i v1.01 (3.4 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 128GB, Disk: 1920GB INTEL SSDSC2KG01, Graphics: ASPEED, Network: 2 x Intel I210

OS: Ubuntu 22.04, Kernel: 6.5.0-21-generic (x86_64), Display Server: X Server 1.21.1.4, Vulkan: 1.3.255, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768

Kernel Notes: Transparent Huge Pages: madvise
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb000040
Java Notes: OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu122.04)
Python Notes: Python 3.10.12
Security Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable

apache-spark1m-100-benchmark-2024-02-28--OpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2699 v4 @ 3.60GHz (44 Cores / 88 Threads)Supermicro X10DRL-i v1.01 (3.4 BIOS)Intel Xeon E7 v4/Xeon128GB1920GB INTEL SSDSC2KG01ASPEED2 x Intel I210Ubuntu 22.046.5.0-21-generic (x86_64)X Server 1.21.1.41.3.255GCC 11.4.0ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDisplay ServerVulkanCompilerFile-SystemScreen ResolutionApache-spark1m-100-benchmark-2024-02-28-- PerformanceSystem Logs- Transparent Huge Pages: madvise- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb000040- OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu122.04)- Python 3.10.12- gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable

apache-spark1m-100-benchmark-2024-02-28--spark: 1000000 - 100 - SHA-512 Benchmark Timespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 100 - Group By Test Timespark: 1000000 - 100 - Repartition Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Broadcast Inner Join Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro4.9570.7215957744.297.023.162.872.11OpenBenchmarking.org

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro1.11382.22763.34144.45525.569SE +/- 0.04, N = 34.95

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro1632486480SE +/- 0.27, N = 370.72

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.96531.93062.89593.86124.8265SE +/- 0.04, N = 34.29

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro246810SE +/- 0.17, N = 37.02

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.7111.4222.1332.8443.555SE +/- 0.07, N = 33.16

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.64581.29161.93742.58323.229SE +/- 0.14, N = 32.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro0.47480.94961.42441.89922.374SE +/- 0.05, N = 32.11

2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro

Processor: 2 x Intel Xeon E5-2699 v4 @ 3.60GHz (44 Cores / 88 Threads), Motherboard: Supermicro X10DRL-i v1.01 (3.4 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 128GB, Disk: 1920GB INTEL SSDSC2KG01, Graphics: ASPEED, Network: 2 x Intel I210

OS: Ubuntu 22.04, Kernel: 6.5.0-21-generic (x86_64), Display Server: X Server 1.21.1.4, Vulkan: 1.3.255, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768

Kernel Notes: Transparent Huge Pages: madvise
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb000040
Java Notes: OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu122.04)
Python Notes: Python 3.10.12
Security Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable

Testing initiated at 28 February 2024 23:05 by user eszkin.