Apache Spark TPC-DS This is a benchmark of Apache Spark using the TPC-DS data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration and leverages the https://github.com/databricks/tpcds-kit and https://github.com/IBM/spark-tpc-ds-performance-test/ projects for testing.
To run this test with the Phoronix Test Suite , the basic command is: phoronix-test-suite benchmark spark-tpcds .
Use with caution this test profile is currently marked Experimental .
Test Created 3 January 2024
Test Type System
Average Install Time 22 Seconds
Average Run Time 2 Hours, 26 Minutes, 11 Seconds
Test Dependencies Java + Python + C/C++ Compiler Toolchain + Git + Bison + Flex
Accolades 10k+ Downloads Public Result Uploads * Reported Installs ** Reported Test Completions ** Test Profile Page Views OpenBenchmarking.org Events Apache Spark TPC-DS Popularity Statistics pts/spark-tpcds 2024.01 2024.02 2024.03 2024.04 2024.05 2024.06 2024.07 2024.08 2024.09 2024.10 2024.11 2024.12 2K 4K 6K 8K 10K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly. ** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform. Data updated weekly as of 23 December 2024.
10 34.9% 100 15.1% 50 29.1% 1 20.9% Scale Factor Option Popularity OpenBenchmarking.org
Revision Historypts/spark-tpcds-1.0.0 [View Source ] Wed, 03 Jan 2024 14:14:48 GMT Initial commit for Spark TPC-DS benchmarking.
Performance MetricsAnalyze Test Configuration: pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q66 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q57 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q62 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q88 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q10 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q87 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q99 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q83 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q45 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q36 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q02 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q03 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q95 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q79 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q39 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q77 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q89 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q92 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q32 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q48 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q60 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q76 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q22 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q31 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q86 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q90 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q28 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q27 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q33 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q13 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q58 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q63 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q91 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q59 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q07 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q09 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q21 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q18 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q98 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q19 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q73 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q70 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q53 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q38 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q08 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q34 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q35 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q01 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q26 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q15 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q75 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q68 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q69 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q52 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q05 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q74 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q85 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q94 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q44 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q96 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q46 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q51 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q56 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q41 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q81 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q43 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q84 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q71 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q42 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q55 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q61 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q37 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q30 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q12 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q47 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q20 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q97 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q65 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q82 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q40 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q86 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q61 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q02 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q13 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q83 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q31 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q21 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q34 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q71 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q58 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q88 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q15 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q53 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q81 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q62 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q09 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q27 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q56 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q26 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q57 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q07 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q43 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q63 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q66 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q49 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q08 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q79 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q32 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q52 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q91 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q70 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q33 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q89 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q28 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q03 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q76 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q19 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q46 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q18 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q68 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q42 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q39 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q55 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q90 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q60 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q30 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q44 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q99 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q59 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q78 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q77 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q45 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q10 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q92 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q69 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q96 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q36 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q93 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q12 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q14 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q50 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q41 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q48 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q35 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q54 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q01 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q24 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q73 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q84 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q98 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q20 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q80 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q47 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q22 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q04 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q06 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q54 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q11 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q95 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q87 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q14 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q37 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q82 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q94 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q38 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q23 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q85 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q05 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q75 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q40 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q25 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q29 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q64 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q17 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q67 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q49 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q65 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q97 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q06 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q20 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q32 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q17 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q88 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q82 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q14 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q02 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q11 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q39 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q30 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q95 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q99 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q35 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q62 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q28 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q33 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q55 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q40 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q87 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q59 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q86 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q23 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q64 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q74 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q16 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q01 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q84 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q83 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q71 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q69 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q97 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q44 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q22 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q24 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q03 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q93 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q50 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q15 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q65 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q31 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q19 pts/spark-tpcds-1.0.x - Scale Factor: 10 - Q72 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q38 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q04 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q43 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q47 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q53 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q91 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q90 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q10 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q07 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q08 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q05 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q49 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q18 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q25 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q41 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q58 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q73 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q72 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q37 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q92 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q94 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q54 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q29 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q67 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q27 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q96 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q66 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q26 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q36 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q48 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q42 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q52 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q61 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q75 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q46 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q51 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q70 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q80 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q89 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q09 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q78 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q85 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q12 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q60 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q45 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q13 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q34 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q56 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q63 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q77 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q21 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q98 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q57 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q79 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q81 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q68 pts/spark-tpcds-1.0.x - Scale Factor: 1 - Q76 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q64 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q93 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q51 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q09 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q48 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q45 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q76 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q88 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q53 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q90 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q42 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q12 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q21 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q80 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q15 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q41 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q36 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q31 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q56 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q99 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q60 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q30 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q52 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q26 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q58 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q63 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q66 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q03 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q28 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q34 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q70 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q71 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q20 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q62 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q19 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q98 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q86 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q33 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q08 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q32 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q61 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q27 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q07 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q92 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q44 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q81 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q18 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q82 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q73 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q02 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q37 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q40 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q83 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q91 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q55 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q67 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q77 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q50 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q39 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q69 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q43 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q57 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q01 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q46 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q79 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q89 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q59 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q96 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q10 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q06 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q25 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q04 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q78 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q84 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q72 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q17 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q29 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q35 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q24 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q74 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q47 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q22 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q13 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q23 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q68 pts/spark-tpcds-1.0.x - Scale Factor: 50 - Q11 pts/spark-tpcds-1.0.x - Scale Factor: 100 - Q06 Apache Spark TPC-DS 3.5 Scale Factor: 10 - Q66 OpenBenchmarking.org metrics for this test profile configuration based on 64 public results since 3 January 2024 with the latest data as of 14 April 2024 .
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Percentile Rank
# Compatible Public Results
Seconds (Average)
Detailed Performance Overview OpenBenchmarking.org Distribution Of Public Results - Scale Factor: 10 - Q66 64 Results Range From 2 To 17 Seconds 2 4 6 8 10 12 14 16 18 20 22 24 26 6 12 18 24 30
Based on OpenBenchmarking.org data, the selected test / test configuration (Apache Spark TPC-DS 3.5 - Scale Factor: 10 - Q66 ) has an average run-time of 1 hour, 57 minutes . By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.
OpenBenchmarking.org Minutes Time Required To Complete Benchmark Scale Factor: 10 - Q66 Run-Time 80 160 240 320 400 Min: 35 / Avg: 116.67 / Max: 425
Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 2.2% .
OpenBenchmarking.org Percent, Fewer Is Better Average Deviation Between Runs Scale Factor: 10 - Q66 Deviation 3 6 9 12 15 Min: 0 / Avg: 2.21 / Max: 8
Tested CPU Architectures This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.
CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
aarch64
ARMv8 Cortex-A76 4-Core, Rockchip ARMv8 Cortex-A76 4-Core, rk1-mainline-nvme
Recent Test Results
3 Systems - 797 Benchmark Results