spark tpch benchmark xeon

2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312141-NE-SPARKTPCH73
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
December 05 2023
  1 Day, 21 Hours, 36 Minutes
b
December 05 2023
  9 Hours, 11 Minutes
c
December 14 2023
  12 Hours, 29 Minutes
Invert Hiding All Results Option
  22 Hours, 25 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


spark tpch benchmark xeonProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen Resolutionabc2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x10802 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseProcessor Details- a: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- b: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- c: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Java Details- OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

abcResult OverviewPhoronix Test Suite100%122%144%166%Apache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-H100 - G.M.O.A.Q50 - G.M.O.A.Q10 - G.M.O.A.Q1 - G.M.O.A.Q1 - Q011 - Q021 - Q031 - Q041 - Q051 - Q061 - Q071 - Q081 - Q091 - Q101 - Q111 - Q121 - Q131 - Q141 - Q151 - Q161 - Q171 - Q181 - Q191 - Q201 - Q2110 - Q0110 - Q0210 - Q0310 - Q0410 - Q0510 - Q0610 - Q0710 - Q0810 - Q0910 - Q1010 - Q1110 - Q1210 - Q1310 - Q1410 - Q1510 - Q1610 - Q1710 - Q1810 - Q1910 - Q2010 - Q2110 - Q2250 - Q0150 - Q0250 - Q0350 - Q0450 - Q0550 - Q0650 - Q0750 - Q0850 - Q0950 - Q1050 - Q1150 - Q1250 - Q1350 - Q1450 - Q1550 - Q1650 - Q1750 - Q1850 - Q1950 - Q2050 - Q2150 - Q22100 - Q01100 - Q02100 - Q03100 - Q04100 - Q05100 - Q06100 - Q07100 - Q08100 - Q09100 - Q10100 - Q11100 - Q12100 - Q13100 - Q14100 - Q15100 - Q16100 - Q17100 - Q18100 - Q19100 - Q20100 - Q21100 - Q22

spark tpch benchmark xeonspark-tpch: 1 - Geometric Mean Of All Queriesspark-tpch: 1 - Q01spark-tpch: 1 - Q02spark-tpch: 1 - Q03spark-tpch: 1 - Q04spark-tpch: 1 - Q05spark-tpch: 1 - Q06spark-tpch: 1 - Q07spark-tpch: 1 - Q08spark-tpch: 1 - Q09spark-tpch: 1 - Q10spark-tpch: 1 - Q11spark-tpch: 1 - Q12spark-tpch: 1 - Q13spark-tpch: 1 - Q14spark-tpch: 1 - Q15spark-tpch: 1 - Q16spark-tpch: 1 - Q17spark-tpch: 1 - Q18spark-tpch: 1 - Q19spark-tpch: 1 - Q20spark-tpch: 1 - Q21spark-tpch: 1 - Q22spark-tpch: 10 - Geometric Mean Of All Queriesspark-tpch: 10 - Q01spark-tpch: 10 - Q02spark-tpch: 10 - Q03spark-tpch: 10 - Q04spark-tpch: 10 - Q05spark-tpch: 10 - Q06spark-tpch: 10 - Q07spark-tpch: 10 - Q08spark-tpch: 10 - Q09spark-tpch: 10 - Q10spark-tpch: 10 - Q11spark-tpch: 10 - Q12spark-tpch: 10 - Q13spark-tpch: 10 - Q14spark-tpch: 10 - Q15spark-tpch: 10 - Q16spark-tpch: 10 - Q17spark-tpch: 10 - Q18spark-tpch: 10 - Q19spark-tpch: 10 - Q20spark-tpch: 10 - Q21spark-tpch: 10 - Q22spark-tpch: 50 - Geometric Mean Of All Queriesspark-tpch: 50 - Q01spark-tpch: 50 - Q02spark-tpch: 50 - Q03spark-tpch: 50 - Q04spark-tpch: 50 - Q05spark-tpch: 50 - Q06spark-tpch: 50 - Q07spark-tpch: 50 - Q08spark-tpch: 50 - Q09spark-tpch: 50 - Q10spark-tpch: 50 - Q11spark-tpch: 50 - Q12spark-tpch: 50 - Q13spark-tpch: 50 - Q14spark-tpch: 50 - Q15spark-tpch: 50 - Q16spark-tpch: 50 - Q17spark-tpch: 50 - Q18spark-tpch: 50 - Q19spark-tpch: 50 - Q20spark-tpch: 50 - Q21spark-tpch: 50 - Q22spark-tpch: 100 - Geometric Mean Of All Queriesspark-tpch: 100 - Q01spark-tpch: 100 - Q02spark-tpch: 100 - Q03spark-tpch: 100 - Q04spark-tpch: 100 - Q05spark-tpch: 100 - Q06spark-tpch: 100 - Q07spark-tpch: 100 - Q08spark-tpch: 100 - Q09spark-tpch: 100 - Q10spark-tpch: 100 - Q11spark-tpch: 100 - Q12spark-tpch: 100 - Q13spark-tpch: 100 - Q14spark-tpch: 100 - Q15spark-tpch: 100 - Q16spark-tpch: 100 - Q17spark-tpch: 100 - Q18spark-tpch: 100 - Q19spark-tpch: 100 - Q20spark-tpch: 100 - Q21spark-tpch: 100 - Q22abc1.926817784.926302121.855504492.912842312.607173843.368314110.768010042.970415951.892110273.957229462.724498390.990493461.910990461.228319781.720304811.795108261.210527842.297739273.243384920.942220922.222167377.359979710.963043076.649610277.179414274.764167948.574233377.0148892410.486206692.205627408.172349618.5329345113.273308758.965245884.847642106.270245394.887215614.139957903.818186444.363078288.6514600110.528648064.493385076.7959626519.879419963.9508829916.0952159613.9031728110.6149406527.8946870217.4275372827.133960727.0433952020.9681892421.7359294928.9566574120.271762857.1565489816.1191415810.4618066211.617184649.468338019.7574024225.2481994630.9899648011.3376846315.7230847773.681671147.4921498327.6480314320.4589756012.6629663551.9675941530.7560672837.5873962411.9943445231.4488525435.1438179057.1769116732.377579129.5140573530.7736026814.4740705520.1340320616.9292648316.3894941349.7394508457.7968231220.7542572025.36702080144.5908386213.996261411.876711955.368044381.939615612.86002352.277596953.442064050.839891672.877943042.039551973.915166623.158519511.167011861.729034421.215781691.34116841.547615531.082250242.231829643.457467080.832487762.065347917.273092270.940757816.584106437.750827795.018533718.808214196.8418946310.019138342.267287028.025947579.0985870414.549153338.56665235.009202485.726495275.1202244.380564693.545779714.183871757.9821915610.659009934.048899657.2531938619.900465013.5196106415.8758108813.2133178710.040087731.6714897218.3906536127.257514957.2226400420.3914947521.5815792128.8585205120.072620397.230300915.056835179.9517965311.961516389.3915500610.1622905725.1552562730.0131130211.1912050214.7144079273.932502757.2173185329.0598272320.0409030912.501154947.9020500237.6510276837.9086570712.3594179231.5776882234.5925788954.8636016832.221141829.5120773341.0882034314.9643545219.52896517.6061801921.5084857950.0931472858.0580673221.2176036826.04597473143.2830352814.612008092.297291165.339872362.516377214.429696083.375233893.84918070.772371894.141925332.370493894.704895024.330640321.174091462.404198411.158712511.842793352.14328171.076111084.204265594.728209021.021512392.26996168.907902720.950198598.651722387.86558396.9320120811.397716528.546212212.77925112.1794581412.8175020213.566510216.1055793812.14000136.837533958.058779726.483417996.114914424.724839214.6631984711.5387258510.869438177.619067198.8846139926.084644324.0285711321.2403368515.0489530614.4000549332.9244346623.426080734.296161658.4363660826.5941410130.14231340.7584075925.940269479.9997625420.0274066912.3937406515.8317279810.6886558511.0060567935.451282541.2963676516.3212223119.44610596113.0974197410.4368858338.9991170825.262899421.5813236265.0662765538.5232734753.7263717715.9629907647.0083885246.5789909483.7835540849.7853012113.590505639.4169387818.8464717931.7057590520.686462419.5355377274.3000106886.8188476633.6672439634.0826683235.7351989716.74190331OpenBenchmarking.org

Apache Spark TPC-H

This is a benchmark of Apache Spark using TPC-H data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration using spark-submit. The test makes use of https://github.com/ssavvides/tpch-spark/ for facilitating the TPC-H benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Geometric Mean Of All Queriesabc0.51691.03381.55072.06762.5845SE +/- 0.01846436, N = 61.926817781.876711952.29729116MIN: 0.83 / MAX: 7.62MIN: 0.83 / MAX: 7.27MIN: 0.95 / MAX: 8.91
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Geometric Mean Of All Queriesabc246810Min: 1.86 / Avg: 1.93 / Max: 2

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 10 - Geometric Mean Of All Queriesabc246810SE +/- 0.09138457, N = 36.649610276.584106438.65172238MIN: 3.57 / MAX: 20.64MIN: 3.52 / MAX: 19.9MIN: 4.03 / MAX: 26.08
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 10 - Geometric Mean Of All Queriesabc3691215Min: 6.48 / Avg: 6.65 / Max: 6.79

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 50 - Geometric Mean Of All Queriesabc510152025SE +/- 0.08, N = 316.1015.8821.24MIN: 6.98 / MAX: 76.43MIN: 7.22 / MAX: 73.93MIN: 10 / MAX: 113.1
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 50 - Geometric Mean Of All Queriesabc510152025Min: 15.93 / Avg: 16.1 / Max: 16.18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 100 - Geometric Mean Of All Queriesabc918273645SE +/- 0.30, N = 527.6529.0639.00MIN: 9.13 / MAX: 150.71MIN: 9.51 / MAX: 143.28MIN: 13.59 / MAX: 235.74
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 100 - Geometric Mean Of All Queriesabc816243240Min: 26.51 / Avg: 27.65 / Max: 28.22