spark tpch benchmark xeon

Tests for a future article. 2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312059-NE-SPARKTPCH04
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
December 05 2023
  1 Day, 21 Hours, 36 Minutes
b
December 05 2023
  9 Hours, 11 Minutes
Invert Hiding All Results Option
  1 Day, 3 Hours, 23 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


spark tpch benchmark xeonOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSpark Tpch Benchmark Xeon PerformanceSystem Logs- Transparent Huge Pages: madvise- Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0 - OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)- Python 3.11.6- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

a vs. b ComparisonPhoronix Test SuiteBaseline+8.4%+8.4%+16.8%+16.8%+25.2%+25.2%2.7%14.5%3.2%10.5%28.3%16%11.9%3%13.2%7.6%2.4%2.5%4.7%4.7%9.5%7.7%4.3%8.4%11%12.3%5.2%5.7%2.8%7.1%5.1%3.3%6.9%3.8%2.1%8.5%4.2%3.1%100 - G.M.O.A.Q5.1%1 - G.M.O.A.Q1 - Q019%1 - Q024.5%1 - Q041 - Q052.2%1 - Q069.4%1 - Q071 - Q087.8%1 - Q1015.9%1 - Q1117.8%1 - Q121 - Q141 - Q151 - Q161 - Q171 - Q186.6%1 - Q191 - Q201 - Q2210 - Q018%10 - Q025.3%10 - Q032.7%10 - Q0410 - Q0510 - Q062.8%10 - Q086.6%10 - Q099.6%10 - Q1010 - Q113.3%10 - Q1210 - Q134.8%10 - Q145.8%10 - Q1510 - Q1610 - Q1710 - Q1910 - Q206.7%10 - Q2250 - Q0150 - Q0250 - Q0313.5%50 - Q045.5%50 - Q062.5%50 - Q0750 - Q1250 - Q1350 - Q143%50 - Q164.1%50 - Q1850 - Q2050 - Q22100 - Q01100 - Q03100 - Q0422.4%100 - Q063%100 - Q09100 - Q1233.5%100 - Q133.4%100 - Q14100 - Q154%100 - Q1631.2%100 - Q192.2%100 - Q202.7%100 - Q224.4%Apache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-Hab

spark tpch benchmark xeonspark-tpch: 1 - Geometric Mean Of All Queriesspark-tpch: 1 - Q01spark-tpch: 1 - Q02spark-tpch: 1 - Q03spark-tpch: 1 - Q04spark-tpch: 1 - Q05spark-tpch: 1 - Q06spark-tpch: 1 - Q07spark-tpch: 1 - Q08spark-tpch: 1 - Q09spark-tpch: 1 - Q10spark-tpch: 1 - Q11spark-tpch: 1 - Q12spark-tpch: 1 - Q13spark-tpch: 1 - Q14spark-tpch: 1 - Q15spark-tpch: 1 - Q16spark-tpch: 1 - Q17spark-tpch: 1 - Q18spark-tpch: 1 - Q19spark-tpch: 1 - Q20spark-tpch: 1 - Q21spark-tpch: 1 - Q22spark-tpch: 10 - Geometric Mean Of All Queriesspark-tpch: 10 - Q01spark-tpch: 10 - Q02spark-tpch: 10 - Q03spark-tpch: 10 - Q04spark-tpch: 10 - Q05spark-tpch: 10 - Q06spark-tpch: 10 - Q07spark-tpch: 10 - Q08spark-tpch: 10 - Q09spark-tpch: 10 - Q10spark-tpch: 10 - Q11spark-tpch: 10 - Q12spark-tpch: 10 - Q13spark-tpch: 10 - Q14spark-tpch: 10 - Q15spark-tpch: 10 - Q16spark-tpch: 10 - Q17spark-tpch: 10 - Q18spark-tpch: 10 - Q19spark-tpch: 10 - Q20spark-tpch: 10 - Q21spark-tpch: 10 - Q22spark-tpch: 50 - Geometric Mean Of All Queriesspark-tpch: 50 - Q01spark-tpch: 50 - Q02spark-tpch: 50 - Q03spark-tpch: 50 - Q04spark-tpch: 50 - Q05spark-tpch: 50 - Q06spark-tpch: 50 - Q07spark-tpch: 50 - Q08spark-tpch: 50 - Q09spark-tpch: 50 - Q10spark-tpch: 50 - Q11spark-tpch: 50 - Q12spark-tpch: 50 - Q13spark-tpch: 50 - Q14spark-tpch: 50 - Q15spark-tpch: 50 - Q16spark-tpch: 50 - Q17spark-tpch: 50 - Q18spark-tpch: 50 - Q19spark-tpch: 50 - Q20spark-tpch: 50 - Q21spark-tpch: 50 - Q22spark-tpch: 100 - Geometric Mean Of All Queriesspark-tpch: 100 - Q01spark-tpch: 100 - Q02spark-tpch: 100 - Q03spark-tpch: 100 - Q04spark-tpch: 100 - Q05spark-tpch: 100 - Q06spark-tpch: 100 - Q07spark-tpch: 100 - Q08spark-tpch: 100 - Q09spark-tpch: 100 - Q10spark-tpch: 100 - Q11spark-tpch: 100 - Q12spark-tpch: 100 - Q13spark-tpch: 100 - Q14spark-tpch: 100 - Q15spark-tpch: 100 - Q16spark-tpch: 100 - Q17spark-tpch: 100 - Q18spark-tpch: 100 - Q19spark-tpch: 100 - Q20spark-tpch: 100 - Q21spark-tpch: 100 - Q22ab1.926817784.926302121.855504492.912842312.607173843.368314110.768010042.970415951.892110273.957229462.724498390.990493461.910990461.228319781.720304811.795108261.210527842.297739273.243384920.942220922.222167377.359979710.963043076.649610277.179414274.764167948.574233377.0148892410.486206692.205627408.172349618.5329345113.273308758.965245884.847642106.270245394.887215614.139957903.818186444.363078288.6514600110.528648064.493385076.7959626519.879419963.9508829916.0952159613.9031728110.6149406527.8946870217.4275372827.133960727.0433952020.9681892421.7359294928.9566574120.271762857.1565489816.1191415810.4618066211.617184649.468338019.7574024225.2481994630.9899648011.3376846315.7230847773.681671147.4921498327.6480314320.4589756012.6629663551.9675941530.7560672837.5873962411.9943445231.4488525435.1438179057.1769116732.377579129.5140573530.7736026814.4740705520.1340320616.9292648316.3894941349.7394508457.7968231220.7542572025.36702080144.5908386213.996261411.876711955.368044381.939615612.86002352.277596953.442064050.839891672.877943042.039551973.915166623.158519511.167011861.729034421.215781691.34116841.547615531.082250242.231829643.457467080.832487762.065347917.273092270.940757816.584106437.750827795.018533718.808214196.8418946310.019138342.267287028.025947579.0985870414.549153338.56665235.009202485.726495275.1202244.380564693.545779714.183871757.9821915610.659009934.048899657.2531938619.900465013.5196106415.8758108813.2133178710.040087731.6714897218.3906536127.257514957.2226400420.3914947521.5815792128.8585205120.072620397.230300915.056835179.9517965311.961516389.3915500610.1622905725.1552562730.0131130211.1912050214.7144079273.932502757.2173185329.0598272320.0409030912.501154947.9020500237.6510276837.9086570712.3594179231.5776882234.5925788954.8636016832.221141829.5120773341.0882034314.9643545219.52896517.6061801921.5084857950.0931472858.0580673221.2176036826.04597473143.2830352814.61200809OpenBenchmarking.org

Apache Spark TPC-H

This is a benchmark of Apache Spark using TPC-H data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration using spark-submit. The test makes use of https://github.com/ssavvides/tpch-spark/ for facilitating the TPC-H benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Geometric Mean Of All Queriesab0.43350.8671.30051.7342.1675SE +/- 0.01846436, N = 61.926817781.87671195MIN: 0.83 / MAX: 7.62MIN: 0.83 / MAX: 7.27

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 10 - Geometric Mean Of All Queriesab246810SE +/- 0.09138457, N = 36.649610276.58410643MIN: 3.57 / MAX: 20.64MIN: 3.52 / MAX: 19.9

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 50 - Geometric Mean Of All Queriesab48121620SE +/- 0.08, N = 316.1015.88MIN: 6.98 / MAX: 76.43MIN: 7.22 / MAX: 73.93

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 100 - Geometric Mean Of All Queriesab714212835SE +/- 0.30, N = 527.6529.06MIN: 9.13 / MAX: 150.71MIN: 9.51 / MAX: 143.28