spark tpch benchmark xeon

Tests for a future article. 2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312059-NE-SPARKTPCH04
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
December 05 2023
  1 Day, 21 Hours, 36 Minutes
b
December 05 2023
  9 Hours, 11 Minutes
Invert Hiding All Results Option
  1 Day, 3 Hours, 23 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


spark tpch benchmark xeonOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSpark Tpch Benchmark Xeon PerformanceSystem Logs- Transparent Huge Pages: madvise- Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0 - OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)- Python 3.11.6- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

a vs. b ComparisonPhoronix Test SuiteBaseline+8.4%+8.4%+16.8%+16.8%+25.2%+25.2%2.7%14.5%3.2%10.5%28.3%16%11.9%3%13.2%7.6%2.4%2.5%4.7%4.7%9.5%7.7%4.3%8.4%11%12.3%5.2%5.7%2.8%7.1%5.1%3.3%6.9%3.8%2.1%8.5%4.2%3.1%100 - G.M.O.A.Q5.1%1 - G.M.O.A.Q1 - Q019%1 - Q024.5%1 - Q041 - Q052.2%1 - Q069.4%1 - Q071 - Q087.8%1 - Q1015.9%1 - Q1117.8%1 - Q121 - Q141 - Q151 - Q161 - Q171 - Q186.6%1 - Q191 - Q201 - Q2210 - Q018%10 - Q025.3%10 - Q032.7%10 - Q0410 - Q0510 - Q062.8%10 - Q086.6%10 - Q099.6%10 - Q1010 - Q113.3%10 - Q1210 - Q134.8%10 - Q145.8%10 - Q1510 - Q1610 - Q1710 - Q1910 - Q206.7%10 - Q2250 - Q0150 - Q0250 - Q0313.5%50 - Q045.5%50 - Q062.5%50 - Q0750 - Q1250 - Q1350 - Q143%50 - Q164.1%50 - Q1850 - Q2050 - Q22100 - Q01100 - Q03100 - Q0422.4%100 - Q063%100 - Q09100 - Q1233.5%100 - Q133.4%100 - Q14100 - Q154%100 - Q1631.2%100 - Q192.2%100 - Q202.7%100 - Q224.4%Apache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-Hab

Apache Spark TPC-H

This is a benchmark of Apache Spark using TPC-H data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration using spark-submit. The test makes use of https://github.com/ssavvides/tpch-spark/ for facilitating the TPC-H benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Geometric Mean Of All Queriesab0.43350.8671.30051.7342.1675SE +/- 0.01846436, N = 61.926817781.87671195MIN: 0.83 / MAX: 7.62MIN: 0.83 / MAX: 7.27

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 10 - Geometric Mean Of All Queriesab246810SE +/- 0.09138457, N = 36.649610276.58410643MIN: 3.57 / MAX: 20.64MIN: 3.52 / MAX: 19.9

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 50 - Geometric Mean Of All Queriesab48121620SE +/- 0.08, N = 316.1015.88MIN: 6.98 / MAX: 76.43MIN: 7.22 / MAX: 73.93

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 100 - Geometric Mean Of All Queriesab714212835SE +/- 0.30, N = 527.6529.06MIN: 9.13 / MAX: 150.71MIN: 9.51 / MAX: 143.28