spark tpch benchmark xeon

Tests for a future article. 2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312059-NE-SPARKTPCH04
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
December 05 2023
  1 Day, 21 Hours, 36 Minutes
b
December 05 2023
  9 Hours, 11 Minutes
Invert Hiding All Results Option
  1 Day, 3 Hours, 23 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


spark tpch benchmark xeonOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSpark Tpch Benchmark Xeon PerformanceSystem Logs- Transparent Huge Pages: madvise- Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0 - OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)- Python 3.11.6- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

a vs. b ComparisonPhoronix Test SuiteBaseline+8.4%+8.4%+16.8%+16.8%+25.2%+25.2%2.7%3.1%4.2%8.5%2.1%3.8%6.9%3.3%5.1%7.1%2.8%5.7%5.2%12.3%11%8.4%4.3%7.7%9.5%4.7%4.7%2.5%2.4%7.6%13.2%3%11.9%16%28.3%10.5%3.2%14.5%100 - G.M.O.A.Q5.1%1 - G.M.O.A.Q100 - Q224.4%100 - Q202.7%100 - Q192.2%100 - Q1631.2%100 - Q154%100 - Q14100 - Q133.4%100 - Q1233.5%100 - Q09100 - Q063%100 - Q0422.4%100 - Q03100 - Q0150 - Q2250 - Q2050 - Q1850 - Q164.1%50 - Q143%50 - Q1350 - Q1250 - Q0750 - Q062.5%50 - Q045.5%50 - Q0313.5%50 - Q0250 - Q0110 - Q2210 - Q206.7%10 - Q1910 - Q1710 - Q1610 - Q1510 - Q145.8%10 - Q134.8%10 - Q1210 - Q113.3%10 - Q1010 - Q099.6%10 - Q086.6%10 - Q062.8%10 - Q0510 - Q0410 - Q032.7%10 - Q025.3%10 - Q018%1 - Q221 - Q201 - Q191 - Q186.6%1 - Q171 - Q161 - Q151 - Q141 - Q121 - Q1117.8%1 - Q1015.9%1 - Q087.8%1 - Q071 - Q069.4%1 - Q052.2%1 - Q041 - Q024.5%1 - Q019%Apache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-Hab

spark tpch benchmark xeonspark-tpch: 100 - Geometric Mean Of All Queriesspark-tpch: 1 - Geometric Mean Of All Queriesspark-tpch: 50 - Geometric Mean Of All Queriesspark-tpch: 10 - Geometric Mean Of All Queriesspark-tpch: 100 - Q22spark-tpch: 100 - Q21spark-tpch: 100 - Q20spark-tpch: 100 - Q19spark-tpch: 100 - Q18spark-tpch: 100 - Q17spark-tpch: 100 - Q16spark-tpch: 100 - Q15spark-tpch: 100 - Q14spark-tpch: 100 - Q13spark-tpch: 100 - Q12spark-tpch: 100 - Q11spark-tpch: 100 - Q10spark-tpch: 100 - Q09spark-tpch: 100 - Q08spark-tpch: 100 - Q07spark-tpch: 100 - Q06spark-tpch: 100 - Q05spark-tpch: 100 - Q04spark-tpch: 100 - Q03spark-tpch: 100 - Q02spark-tpch: 100 - Q01spark-tpch: 50 - Q22spark-tpch: 50 - Q21spark-tpch: 50 - Q20spark-tpch: 50 - Q19spark-tpch: 50 - Q18spark-tpch: 50 - Q17spark-tpch: 50 - Q16spark-tpch: 50 - Q15spark-tpch: 50 - Q14spark-tpch: 50 - Q13spark-tpch: 50 - Q12spark-tpch: 50 - Q11spark-tpch: 50 - Q10spark-tpch: 50 - Q09spark-tpch: 50 - Q08spark-tpch: 50 - Q07spark-tpch: 50 - Q06spark-tpch: 50 - Q05spark-tpch: 50 - Q04spark-tpch: 50 - Q03spark-tpch: 50 - Q02spark-tpch: 50 - Q01spark-tpch: 10 - Q22spark-tpch: 10 - Q21spark-tpch: 10 - Q20spark-tpch: 10 - Q19spark-tpch: 10 - Q18spark-tpch: 10 - Q17spark-tpch: 10 - Q16spark-tpch: 10 - Q15spark-tpch: 10 - Q14spark-tpch: 10 - Q13spark-tpch: 10 - Q12spark-tpch: 10 - Q11spark-tpch: 10 - Q10spark-tpch: 10 - Q09spark-tpch: 10 - Q08spark-tpch: 10 - Q07spark-tpch: 10 - Q06spark-tpch: 10 - Q05spark-tpch: 10 - Q04spark-tpch: 10 - Q03spark-tpch: 10 - Q02spark-tpch: 10 - Q01spark-tpch: 1 - Q22spark-tpch: 1 - Q21spark-tpch: 1 - Q20spark-tpch: 1 - Q19spark-tpch: 1 - Q18spark-tpch: 1 - Q17spark-tpch: 1 - Q16spark-tpch: 1 - Q15spark-tpch: 1 - Q14spark-tpch: 1 - Q13spark-tpch: 1 - Q12spark-tpch: 1 - Q11spark-tpch: 1 - Q10spark-tpch: 1 - Q09spark-tpch: 1 - Q08spark-tpch: 1 - Q07spark-tpch: 1 - Q06spark-tpch: 1 - Q05spark-tpch: 1 - Q04spark-tpch: 1 - Q03spark-tpch: 1 - Q02spark-tpch: 1 - Q01ab27.648031431.9268177816.095215966.6496102713.99626141144.5908386225.3670208020.7542572057.7968231249.7394508416.3894941316.9292648320.1340320614.4740705530.773602689.5140573532.3775791257.1769116735.1438179031.4488525411.9943445237.5873962430.7560672851.9675941512.6629663520.458975607.4921498373.6816711415.7230847711.3376846330.9899648025.248199469.757402429.4683380111.6171846410.4618066216.119141587.1565489820.2717628528.9566574121.7359294920.968189247.0433952027.1339607217.4275372827.8946870210.6149406513.903172813.9508829919.879419966.795962654.4933850710.528648068.651460014.363078283.818186444.139957904.887215616.270245394.847642108.9652458813.273308758.532934518.172349612.2056274010.486206697.014889248.574233374.764167947.179414270.963043077.359979712.222167370.942220923.243384922.297739271.210527841.795108261.720304811.228319781.910990460.990493462.724498393.957229461.892110272.970415950.768010043.368314112.607173842.912842311.855504494.9263021229.059827231.8767119515.875810886.5841064314.61200809143.2830352826.0459747321.2176036858.0580673250.0931472821.5084857917.6061801919.52896514.9643545241.088203439.5120773332.2211418254.8636016834.5925788931.5776882212.3594179237.9086570737.6510276847.9020500212.501154920.040903097.2173185373.9325027514.7144079211.1912050230.0131130225.1552562710.162290579.3915500611.961516389.9517965315.056835177.230300920.0726203928.8585205121.5815792120.391494757.2226400427.2575149518.3906536131.6714897210.040087713.213317873.5196106419.900465017.253193864.0488996510.659009937.982191564.183871753.545779714.380564695.1202245.726495275.009202488.566652314.549153339.098587048.025947572.2672870210.019138346.841894638.808214195.018533717.750827790.940757817.273092272.065347910.832487763.457467082.231829641.082250241.547615531.34116841.215781691.729034421.167011863.158519513.915166622.039551972.877943040.839891673.442064052.277596952.86002351.939615615.36804438OpenBenchmarking.org

Apache Spark TPC-H

This is a benchmark of Apache Spark using TPC-H data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration using spark-submit. The test makes use of https://github.com/ssavvides/tpch-spark/ for facilitating the TPC-H benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 100 - Geometric Mean Of All Queriesba714212835SE +/- 0.30, N = 529.0627.65MIN: 9.51 / MAX: 143.28MIN: 9.13 / MAX: 150.71

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Geometric Mean Of All Queriesba0.43350.8671.30051.7342.1675SE +/- 0.01846436, N = 61.876711951.92681778MIN: 0.83 / MAX: 7.27MIN: 0.83 / MAX: 7.62

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 50 - Geometric Mean Of All Queriesba48121620SE +/- 0.08, N = 315.8816.10MIN: 7.22 / MAX: 73.93MIN: 6.98 / MAX: 76.43

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 10 - Geometric Mean Of All Queriesba246810SE +/- 0.09138457, N = 36.584106436.64961027MIN: 3.52 / MAX: 19.9MIN: 3.57 / MAX: 20.64