tr 2950X

AMD Ryzen Threadripper 2950X 16-Core testing with a MSI MEG X399 CREATION (MS-7B92) v1.0 (1.30 BIOS) and AMD FirePro V4900 1GB on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2208075-NE-TR2950X6958
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
A
August 06 2022
  6 Hours, 44 Minutes
BN
August 06 2022
  1 Day, 17 Hours, 45 Minutes
C
August 07 2022
  1 Day, 28 Minutes
Invert Hiding All Results Option
  1 Day, 19 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


tr 2950XOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads)MSI MEG X399 CREATION (MS-7B92) v1.0 (1.30 BIOS)AMD 17h32GBSamsung SSD 970 EVO 250GBAMD FirePro V4900 1GBRealtek ALC1220DELL S2409W2 x Intel I211 + Intel-AC 9260Ubuntu 22.045.19.0-051900rc7-generic (x86_64)GNOME Shell 42.2X Server + Wayland3.3 Mesa 22.0.1 (LLVM 13.0.1)1.2.204GCC 11.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionTr 2950X BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x800820d- OpenJDK Runtime Environment (build 11.0.15+10-Ubuntu-0ubuntu0.22.04.1)- Python 3.10.4- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

ABNCResult OverviewPhoronix Test Suite100%104%107%111%114%Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache Spark1000000 - 2000 - R.T.T1000000 - 100 - I.J.T.T1000000 - 100 - B.I.J.T.T20000000 - 1000 - S.5.B.T40000000 - 1000 - S.5.B.T10000000 - 2000 - B.I.J.T.T10000000 - 500 - I.J.T.T1000000 - 1000 - S.5.B.T1000000 - 2000 - B.I.J.T.T20000000 - 1000 - B.I.J.T.T1000000 - 1000 - B.I.J.T.T40000000 - 2000 - Group By Test Time10000000 - 1000 - I.J.T.T1000000 - 500 - B.I.J.T.T20000000 - 1000 - R.T.T10000000 - 1000 - B.I.J.T.T1000000 - 1000 - R.T.T10000000 - 2000 - Group By Test Time1000000 - 500 - I.J.T.T1000000 - 100 - R.T.T1000000 - 500 - S.5.B.T40000000 - 1000 - B.I.J.T.TPreset 10 - Bosphorus 1080p40000000 - 100 - B.I.J.T.T40000000 - 100 - R.T.T40000000 - 100 - S.5.B.T40000000 - 2000 - I.J.T.T10000000 - 100 - I.J.T.T1000000 - 500 - R.T.T40000000 - 500 - B.I.J.T.T1000000 - 1000 - Group By Test Time10000000 - 1000 - Group By Test Time10000000 - 2000 - I.J.T.T40000000 - 2000 - S.5.B.T20000000 - 500 - R.T.T20000000 - 2000 - B.I.J.T.T40000000 - 500 - I.J.T.T

tr 2950Xsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 10 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 10 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080pspark: 1000000 - 100 - SHA-512 Benchmark Timespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 100 - Group By Test Timespark: 1000000 - 100 - Repartition Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 500 - SHA-512 Benchmark Timespark: 1000000 - 500 - Calculate Pi Benchmarkspark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 500 - Group By Test Timespark: 1000000 - 500 - Repartition Test Timespark: 1000000 - 500 - Inner Join Test Timespark: 1000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 1000 - SHA-512 Benchmark Timespark: 1000000 - 1000 - Calculate Pi Benchmarkspark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 1000 - Group By Test Timespark: 1000000 - 1000 - Repartition Test Timespark: 1000000 - 1000 - Inner Join Test Timespark: 1000000 - 1000 - Broadcast Inner Join Test Timespark: 1000000 - 2000 - SHA-512 Benchmark Timespark: 1000000 - 2000 - Calculate Pi Benchmarkspark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 2000 - Group By Test Timespark: 1000000 - 2000 - Repartition Test Timespark: 1000000 - 2000 - Inner Join Test Timespark: 1000000 - 2000 - Broadcast Inner Join Test Timespark: 10000000 - 100 - SHA-512 Benchmark Timespark: 10000000 - 100 - Calculate Pi Benchmarkspark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 100 - Group By Test Timespark: 10000000 - 100 - Repartition Test Timespark: 10000000 - 100 - Inner Join Test Timespark: 10000000 - 100 - Broadcast Inner Join Test Timespark: 10000000 - 500 - SHA-512 Benchmark Timespark: 10000000 - 500 - Calculate Pi Benchmarkspark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 500 - Group By Test Timespark: 10000000 - 500 - Repartition Test Timespark: 10000000 - 500 - Inner Join Test Timespark: 10000000 - 500 - Broadcast Inner Join Test Timespark: 20000000 - 100 - SHA-512 Benchmark Timespark: 20000000 - 100 - Calculate Pi Benchmarkspark: 20000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 100 - Group By Test Timespark: 20000000 - 100 - Repartition Test Timespark: 20000000 - 100 - Inner Join Test Timespark: 20000000 - 100 - Broadcast Inner Join Test Timespark: 20000000 - 500 - SHA-512 Benchmark Timespark: 20000000 - 500 - Calculate Pi Benchmarkspark: 20000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 500 - Group By Test Timespark: 20000000 - 500 - Repartition Test Timespark: 20000000 - 500 - Inner Join Test Timespark: 20000000 - 500 - Broadcast Inner Join Test Timespark: 40000000 - 100 - SHA-512 Benchmark Timespark: 40000000 - 100 - Calculate Pi Benchmarkspark: 40000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - Group By Test Timespark: 40000000 - 100 - Repartition Test Timespark: 40000000 - 100 - Inner Join Test Timespark: 40000000 - 100 - Broadcast Inner Join Test Timespark: 40000000 - 500 - SHA-512 Benchmark Timespark: 40000000 - 500 - Calculate Pi Benchmarkspark: 40000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 500 - Group By Test Timespark: 40000000 - 500 - Repartition Test Timespark: 40000000 - 500 - Inner Join Test Timespark: 40000000 - 500 - Broadcast Inner Join Test Timespark: 10000000 - 1000 - SHA-512 Benchmark Timespark: 10000000 - 1000 - Calculate Pi Benchmarkspark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 1000 - Group By Test Timespark: 10000000 - 1000 - Repartition Test Timespark: 10000000 - 1000 - Inner Join Test Timespark: 10000000 - 1000 - Broadcast Inner Join Test Timespark: 10000000 - 2000 - SHA-512 Benchmark Timespark: 10000000 - 2000 - Calculate Pi Benchmarkspark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Group By Test Timespark: 10000000 - 2000 - Repartition Test Timespark: 10000000 - 2000 - Inner Join Test Timespark: 10000000 - 2000 - Broadcast Inner Join Test Timespark: 20000000 - 1000 - SHA-512 Benchmark Timespark: 20000000 - 1000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 1000 - Group By Test Timespark: 20000000 - 1000 - Repartition Test Timespark: 20000000 - 1000 - Inner Join Test Timespark: 20000000 - 1000 - Broadcast Inner Join Test Timespark: 20000000 - 2000 - SHA-512 Benchmark Timespark: 20000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - Group By Test Timespark: 20000000 - 2000 - Repartition Test Timespark: 20000000 - 2000 - Inner Join Test Timespark: 20000000 - 2000 - Broadcast Inner Join Test Timespark: 40000000 - 1000 - SHA-512 Benchmark Timespark: 40000000 - 1000 - Calculate Pi Benchmarkspark: 40000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 1000 - Group By Test Timespark: 40000000 - 1000 - Repartition Test Timespark: 40000000 - 1000 - Inner Join Test Timespark: 40000000 - 1000 - Broadcast Inner Join Test Timespark: 40000000 - 2000 - SHA-512 Benchmark Timespark: 40000000 - 2000 - Calculate Pi Benchmarkspark: 40000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 2000 - Group By Test Timespark: 40000000 - 2000 - Repartition Test Timespark: 40000000 - 2000 - Inner Join Test Timespark: 40000000 - 2000 - Broadcast Inner Join Test TimeABNC1.38431.99561.38889.7523.59375.963162.279221.1044.530063798108.4197816326.7832715585.8769422442.7002640512.101.9725177984.37108.2259551586.776856025.5046102132.652.1709950551.700073414.34109.8071745416.7991982475.372.872.431.924.904759563108.5972891086.846.172.973.092.3213.931141663108.6883670266.819.4397525169.4710.76469753310.66224323713.198824567109.2303116876.7592589548.6210252099.0910.44485307510.01652585324.428886208109.1085387156.8013.32962639217.15439022820.68373462220.75454159522.754111465109.6124672876.81274462911.89008500516.64063657718.78581923518.42867468646.523112355110.5236575666.8432.42304331334.18555970540.83527638340.08974714445.815407438109.2318351666.7231.8082204431.75970946238.91663164437.8601277214.004523565109.5223568656.709.569.3510.22690810310.41215390814.139350937109.911051716.769.809.3010.9970723579.9623.235006524110.7301282356.87533699313.18056373515.89295816519.68243866819.23762799523.247350909109.439766916.7713.2260123616.43163640320.39371697219.05687729944.777573634109.8964218626.8629.12648346431.44832351637.54260010236.81888062443.859768868110.0852855476.8625.81836339930.64805419837.99194315536.6972444821.37932.12960.84689.4603.53076.005158.929223.4424.62110.1662071476.896.012.812.371.884.54109.9074079896.815.572.722.251.774.65109.6802051036.825.482.942.452.054.99110.0398388176.796.273.383.172.4114.19109.3570334076.809.599.3110.4710.6913.09109.3298560126.788.498.939.739.7524.63109.5769064466.8213.4017.3820.3520.8022.58109.9719429486.8011.9916.1619.2918.3746.40109.7469973316.7932.1132.9939.9841.2746.27109.9404536506.8631.2632.5637.9438.9914.34109.9681954486.809.679.5910.7810.6614.04110.2509737566.789.899.4510.8310.8324.89110.2586475716.8013.2016.4019.9519.6123.69109.8969844056.7912.9016.6920.5519.2743.90110.3946157966.8729.3431.5136.5236.7343.42110.5510390636.8427.2231.5438.8035.821.37932.02160.94289.3663.56675.225156.492219.6164.50109.8700240986.865.972.732.131.754.43110.3578639466.815.442.742.261.794.64110.0577830686.845.552.822.432.034.92110.126.816.313.393.122.4814.01110.4113768026.859.689.3010.4110.7213.29110.5390732206.828.509.1210.199.8825.02109.6167761406.7713.3517.3720.6021.2222.64109.9779792186.8611.7716.3319.0618.6948.05111.436.9232.4933.2940.1239.8146.14110.396.8431.4532.5539.0639.1314.30110.1052805906.819.879.4610.8010.8714.22109.966.8410.219.5110.6610.5425.45109.9596909746.8812.9916.6719.8520.5523.55109.916059716.7713.0516.3020.3019.6241.003127286110.2734909356.7429.4331.0236.5835.4544.72110.5881199196.7627.26790608931.2739.3136.74OpenBenchmarking.org

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 4KCBNA0.31140.62280.93421.24561.557SE +/- 0.001, N = 3SE +/- 0.004, N = 31.3791.3791.3841. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 4KCBNA246810Min: 1.38 / Avg: 1.38 / Max: 1.38Min: 1.37 / Avg: 1.38 / Max: 1.391. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 4KCBNA714212835SE +/- 0.08, N = 3SE +/- 0.10, N = 332.0232.1332.001. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 4KCBNA714212835Min: 31.86 / Avg: 32.02 / Max: 32.11Min: 31.97 / Avg: 32.13 / Max: 32.311. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 4KCBNA1428425670SE +/- 0.53, N = 3SE +/- 0.21, N = 360.9460.8561.391. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 4KCBNA1224364860Min: 59.92 / Avg: 60.94 / Max: 61.67Min: 60.44 / Avg: 60.85 / Max: 61.171. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 4KCBNA20406080100SE +/- 0.47, N = 3SE +/- 0.46, N = 389.3789.4689.751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 4KCBNA20406080100Min: 88.54 / Avg: 89.37 / Max: 90.17Min: 88.81 / Avg: 89.46 / Max: 90.341. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 1080pCBNA0.80841.61682.42523.23364.042SE +/- 0.014, N = 3SE +/- 0.015, N = 33.5663.5303.5931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 1080pCBNA246810Min: 3.54 / Avg: 3.57 / Max: 3.59Min: 3.5 / Avg: 3.53 / Max: 3.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 1080pCBNA20406080100SE +/- 0.10, N = 3SE +/- 0.37, N = 375.2376.0175.961. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 1080pCBNA1530456075Min: 75.04 / Avg: 75.22 / Max: 75.35Min: 75.32 / Avg: 76.01 / Max: 76.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 1080pCBNA4080120160200SE +/- 1.66, N = 4SE +/- 1.56, N = 3156.49158.93162.281. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 1080pCBNA306090120150Min: 153.58 / Avg: 156.49 / Max: 161.02Min: 156.61 / Avg: 158.93 / Max: 161.891. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 1080pCBNA50100150200250SE +/- 1.25, N = 3SE +/- 1.68, N = 3219.62223.44221.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 1080pCBNA4080120160200Min: 217.33 / Avg: 219.62 / Max: 221.64Min: 220.08 / Avg: 223.44 / Max: 225.141. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA1.03952.0793.11854.1585.1975SE +/- 0.055483981, N = 4SE +/- 0.034411464, N = 34.5000000004.6200000004.530063798
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA246810Min: 4.35 / Avg: 4.5 / Max: 4.61Min: 4.57 / Avg: 4.62 / Max: 4.68

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.10, N = 4SE +/- 0.21, N = 3109.87110.17108.42
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100Min: 109.63 / Avg: 109.87 / Max: 110.04Min: 109.91 / Avg: 110.17 / Max: 110.59

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.022438723, N = 4SE +/- 0.068811394, N = 36.8600000006.8900000006.783271558
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.81 / Avg: 6.86 / Max: 6.91Min: 6.8 / Avg: 6.89 / Max: 7.02

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test TimeCBNA246810SE +/- 0.080220571, N = 4SE +/- 0.060621777, N = 35.9700000006.0100000005.876942244
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test TimeCBNA246810Min: 5.79 / Avg: 5.97 / Max: 6.14Min: 5.89 / Avg: 6.01 / Max: 6.09

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test TimeCBNA0.63231.26461.89692.52923.1615SE +/- 0.052181616, N = 4SE +/- 0.018430805, N = 32.7300000002.8100000002.700264051
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test TimeCBNA246810Min: 2.62 / Avg: 2.73 / Max: 2.87Min: 2.78 / Avg: 2.81 / Max: 2.84

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test TimeCBNA0.53331.06661.59992.13322.6665SE +/- 0.05, N = 4SE +/- 0.07, N = 32.132.372.10
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test TimeCBNA246810Min: 2.04 / Avg: 2.13 / Max: 2.26Min: 2.28 / Avg: 2.37 / Max: 2.52

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA0.44380.88761.33141.77522.219SE +/- 0.055547846, N = 4SE +/- 0.059135782, N = 31.7500000001.8800000001.972517798
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA246810Min: 1.62 / Avg: 1.75 / Max: 1.87Min: 1.8 / Avg: 1.88 / Max: 2

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA1.02152.0433.06454.0865.1075SE +/- 0.05, N = 3SE +/- 0.04, N = 84.434.544.37
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA246810Min: 4.33 / Avg: 4.43 / Max: 4.51Min: 4.36 / Avg: 4.54 / Max: 4.7

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.32, N = 3SE +/- 0.12, N = 8110.36109.91108.23
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100Min: 109.73 / Avg: 110.36 / Max: 110.67Min: 109.38 / Avg: 109.91 / Max: 110.42

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.02772713, N = 3SE +/- 0.02582423, N = 86.810000006.810000006.77685602
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.75 / Avg: 6.81 / Max: 6.85Min: 6.72 / Avg: 6.81 / Max: 6.94

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Group By Test TimeCBNA1.25332.50663.75995.01326.2665SE +/- 0.043659720, N = 3SE +/- 0.029315415, N = 85.4400000005.5700000005.504610213
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Group By Test TimeCBNA246810Min: 5.36 / Avg: 5.44 / Max: 5.51Min: 5.39 / Avg: 5.57 / Max: 5.65

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Repartition Test TimeCBNA0.61651.2331.84952.4663.0825SE +/- 0.05, N = 3SE +/- 0.04, N = 82.742.722.65
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Repartition Test TimeCBNA246810Min: 2.69 / Avg: 2.74 / Max: 2.83Min: 2.62 / Avg: 2.72 / Max: 2.88

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Inner Join Test TimeCBNA0.50851.0171.52552.0342.5425SE +/- 0.110292282, N = 3SE +/- 0.028445371, N = 82.2600000002.2500000002.170995055
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Inner Join Test TimeCBNA246810Min: 2.14 / Avg: 2.26 / Max: 2.48Min: 2.15 / Avg: 2.25 / Max: 2.37

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA0.40280.80561.20841.61122.014SE +/- 0.04087612, N = 3SE +/- 0.05474021, N = 81.790000001.770000001.70007341
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA246810Min: 1.71 / Avg: 1.79 / Max: 1.85Min: 1.63 / Avg: 1.77 / Max: 2.14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA1.04632.09263.13894.18525.2315SE +/- 0.06, N = 3SE +/- 0.05, N = 34.644.654.34
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA246810Min: 4.55 / Avg: 4.64 / Max: 4.74Min: 4.56 / Avg: 4.65 / Max: 4.72

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.15, N = 3SE +/- 0.38, N = 3110.06109.68109.81
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100Min: 109.77 / Avg: 110.06 / Max: 110.3Min: 108.94 / Avg: 109.68 / Max: 110.22

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.025947993, N = 3SE +/- 0.031303906, N = 36.8400000006.8200000006.799198247
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.79 / Avg: 6.84 / Max: 6.88Min: 6.76 / Avg: 6.82 / Max: 6.86

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Group By Test TimeCBNA1.24882.49763.74644.99526.244SE +/- 0.02, N = 3SE +/- 0.04, N = 35.555.485.37
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Group By Test TimeCBNA246810Min: 5.53 / Avg: 5.55 / Max: 5.6Min: 5.41 / Avg: 5.48 / Max: 5.54

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Repartition Test TimeCBNA0.66151.3231.98452.6463.3075SE +/- 0.04, N = 3SE +/- 0.03, N = 32.822.942.87
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Repartition Test TimeCBNA246810Min: 2.75 / Avg: 2.82 / Max: 2.89Min: 2.88 / Avg: 2.94 / Max: 2.99

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Inner Join Test TimeCBNA0.55131.10261.65392.20522.7565SE +/- 0.04, N = 3SE +/- 0.05, N = 32.432.452.43
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Inner Join Test TimeCBNA246810Min: 2.39 / Avg: 2.43 / Max: 2.5Min: 2.37 / Avg: 2.45 / Max: 2.52

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA0.46130.92261.38391.84522.3065SE +/- 0.06, N = 3SE +/- 0.06, N = 32.032.051.92
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA246810Min: 1.93 / Avg: 2.03 / Max: 2.12Min: 1.93 / Avg: 2.05 / Max: 2.11

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA1.12282.24563.36844.49125.614SE +/- 0.049353750, N = 3SE +/- 0.048557793, N = 64.9200000004.9900000004.904759563
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA246810Min: 4.82 / Avg: 4.92 / Max: 4.99Min: 4.88 / Avg: 4.99 / Max: 5.21

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.24, N = 3SE +/- 0.17, N = 6110.12110.04108.60
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100Min: 109.64 / Avg: 110.12 / Max: 110.42Min: 109.53 / Avg: 110.04 / Max: 110.77

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.05, N = 3SE +/- 0.02, N = 66.816.796.84
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.73 / Avg: 6.81 / Max: 6.89Min: 6.71 / Avg: 6.79 / Max: 6.85

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Group By Test TimeCBNA246810SE +/- 0.10, N = 3SE +/- 0.04, N = 66.316.276.17
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Group By Test TimeCBNA3691215Min: 6.19 / Avg: 6.31 / Max: 6.51Min: 6.15 / Avg: 6.27 / Max: 6.42

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Repartition Test TimeCBNA0.76281.52562.28843.05123.814SE +/- 0.02, N = 3SE +/- 0.04, N = 63.393.382.97
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Repartition Test TimeCBNA246810Min: 3.35 / Avg: 3.39 / Max: 3.41Min: 3.27 / Avg: 3.38 / Max: 3.54

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Inner Join Test TimeCBNA0.71331.42662.13992.85323.5665SE +/- 0.09, N = 3SE +/- 0.04, N = 63.123.173.09
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Inner Join Test TimeCBNA246810Min: 3.02 / Avg: 3.12 / Max: 3.3Min: 3.05 / Avg: 3.17 / Max: 3.31

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA0.5581.1161.6742.2322.79SE +/- 0.07, N = 3SE +/- 0.05, N = 62.482.412.32
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA246810Min: 2.34 / Avg: 2.48 / Max: 2.58Min: 2.23 / Avg: 2.41 / Max: 2.57

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA48121620SE +/- 0.10, N = 3SE +/- 0.07, N = 314.0114.1913.93
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA48121620Min: 13.82 / Avg: 14.01 / Max: 14.14Min: 14.08 / Avg: 14.19 / Max: 14.32

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.10, N = 3SE +/- 0.17, N = 3110.41109.36108.69
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100Min: 110.26 / Avg: 110.41 / Max: 110.6Min: 109.01 / Avg: 109.36 / Max: 109.57

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.03, N = 3SE +/- 0.00, N = 36.856.806.81
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.82 / Avg: 6.85 / Max: 6.9Min: 6.8 / Avg: 6.8 / Max: 6.81

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Group By Test TimeCBNA3691215SE +/- 0.055018199, N = 3SE +/- 0.023359039, N = 39.6800000009.5900000009.439752516
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Group By Test TimeCBNA3691215Min: 9.59 / Avg: 9.68 / Max: 9.78Min: 9.55 / Avg: 9.59 / Max: 9.63

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Repartition Test TimeCBNA3691215SE +/- 0.09, N = 3SE +/- 0.16, N = 39.309.319.47
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Repartition Test TimeCBNA3691215Min: 9.14 / Avg: 9.3 / Max: 9.42Min: 9.03 / Avg: 9.31 / Max: 9.58

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Inner Join Test TimeCBNA3691215SE +/- 0.18, N = 3SE +/- 0.26, N = 310.4110.4710.76
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Inner Join Test TimeCBNA3691215Min: 10.17 / Avg: 10.41 / Max: 10.75Min: 9.98 / Avg: 10.47 / Max: 10.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA3691215SE +/- 0.11, N = 3SE +/- 0.24, N = 310.7210.6910.66
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA3691215Min: 10.5 / Avg: 10.72 / Max: 10.85Min: 10.32 / Avg: 10.69 / Max: 11.15

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA3691215SE +/- 0.13, N = 6SE +/- 0.14, N = 313.2913.0913.20
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA48121620Min: 13.07 / Avg: 13.29 / Max: 13.92Min: 12.95 / Avg: 13.09 / Max: 13.37

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.25, N = 6SE +/- 0.30, N = 3110.54109.33109.23
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100Min: 110.05 / Avg: 110.54 / Max: 111.7Min: 109.01 / Avg: 109.33 / Max: 109.92

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.025564809, N = 6SE +/- 0.003533182, N = 36.8200000006.7800000006.759258954
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.74 / Avg: 6.82 / Max: 6.9Min: 6.78 / Avg: 6.78 / Max: 6.79

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Group By Test TimeCBNA246810SE +/- 0.074190780, N = 6SE +/- 0.069704950, N = 38.5000000008.4900000008.621025209
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Group By Test TimeCBNA3691215Min: 8.26 / Avg: 8.5 / Max: 8.73Min: 8.36 / Avg: 8.49 / Max: 8.6

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Repartition Test TimeCBNA3691215SE +/- 0.10, N = 6SE +/- 0.19, N = 39.128.939.09
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Repartition Test TimeCBNA3691215Min: 8.74 / Avg: 9.12 / Max: 9.42Min: 8.68 / Avg: 8.93 / Max: 9.29

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Inner Join Test TimeCBNA3691215SE +/- 0.144346648, N = 6SE +/- 0.118870708, N = 310.1900000009.73000000010.444853075
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Inner Join Test TimeCBNA3691215Min: 9.82 / Avg: 10.19 / Max: 10.75Min: 9.5 / Avg: 9.73 / Max: 9.9

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA3691215SE +/- 0.094306283, N = 6SE +/- 0.085017131, N = 39.8800000009.75000000010.016525853
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA3691215Min: 9.56 / Avg: 9.88 / Max: 10.19Min: 9.63 / Avg: 9.75 / Max: 9.92

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA612182430SE +/- 0.27, N = 3SE +/- 0.03, N = 325.0224.6324.43
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA612182430Min: 24.59 / Avg: 25.02 / Max: 25.53Min: 24.59 / Avg: 24.63 / Max: 24.68

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.14, N = 3SE +/- 0.21, N = 3109.62109.58109.11
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100Min: 109.38 / Avg: 109.62 / Max: 109.86Min: 109.25 / Avg: 109.58 / Max: 109.97

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.03, N = 3SE +/- 0.01, N = 36.776.826.80
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.72 / Avg: 6.77 / Max: 6.83Min: 6.81 / Avg: 6.82 / Max: 6.83

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Group By Test TimeCBNA3691215SE +/- 0.07, N = 3SE +/- 0.20, N = 313.3513.4013.33
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Group By Test TimeCBNA48121620Min: 13.23 / Avg: 13.35 / Max: 13.47Min: 13.18 / Avg: 13.4 / Max: 13.8

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Repartition Test TimeCBNA48121620SE +/- 0.07, N = 3SE +/- 0.11, N = 317.3717.3817.15
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Repartition Test TimeCBNA48121620Min: 17.24 / Avg: 17.37 / Max: 17.49Min: 17.16 / Avg: 17.38 / Max: 17.53

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Inner Join Test TimeCBNA510152025SE +/- 0.24, N = 3SE +/- 0.71, N = 320.6020.3520.68
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Inner Join Test TimeCBNA510152025Min: 20.26 / Avg: 20.6 / Max: 21.06Min: 19.51 / Avg: 20.35 / Max: 21.76

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA510152025SE +/- 0.25, N = 3SE +/- 0.24, N = 321.2220.8020.75
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA510152025Min: 20.89 / Avg: 21.22 / Max: 21.7Min: 20.32 / Avg: 20.8 / Max: 21.12

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA510152025SE +/- 0.27, N = 3SE +/- 0.30, N = 322.6422.5822.75
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA510152025Min: 22.14 / Avg: 22.64 / Max: 23.06Min: 22.19 / Avg: 22.58 / Max: 23.18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.17, N = 3SE +/- 0.13, N = 3109.98109.97109.61
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100Min: 109.67 / Avg: 109.98 / Max: 110.27Min: 109.72 / Avg: 109.97 / Max: 110.1

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.012838149, N = 3SE +/- 0.034639869, N = 36.8600000006.8000000006.812744629
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.84 / Avg: 6.86 / Max: 6.88Min: 6.75 / Avg: 6.8 / Max: 6.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Group By Test TimeCBNA3691215SE +/- 0.07, N = 3SE +/- 0.11, N = 311.7711.9911.89
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Group By Test TimeCBNA3691215Min: 11.64 / Avg: 11.77 / Max: 11.86Min: 11.79 / Avg: 11.99 / Max: 12.17

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Repartition Test TimeCBNA48121620SE +/- 0.17, N = 3SE +/- 0.26, N = 316.3316.1616.64
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Repartition Test TimeCBNA48121620Min: 16.11 / Avg: 16.33 / Max: 16.67Min: 15.73 / Avg: 16.16 / Max: 16.63

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Inner Join Test TimeCBNA510152025SE +/- 0.15, N = 3SE +/- 0.35, N = 319.0619.2918.79
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Inner Join Test TimeCBNA510152025Min: 18.81 / Avg: 19.06 / Max: 19.33Min: 18.62 / Avg: 19.29 / Max: 19.83

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA510152025SE +/- 0.12, N = 3SE +/- 0.30, N = 318.6918.3718.43
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA510152025Min: 18.47 / Avg: 18.69 / Max: 18.86Min: 17.89 / Avg: 18.37 / Max: 18.91

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA1122334455SE +/- 0.33, N = 3SE +/- 0.41, N = 948.0546.4046.52
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark TimeCBNA1020304050Min: 47.51 / Avg: 48.05 / Max: 48.64Min: 45.47 / Avg: 46.4 / Max: 48.58

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.92, N = 3SE +/- 0.15, N = 9111.43109.75110.52
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi BenchmarkCBNA20406080100Min: 110.29 / Avg: 111.43 / Max: 113.26Min: 109.08 / Avg: 109.75 / Max: 110.43

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.06, N = 3SE +/- 0.01, N = 96.926.796.84
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.8 / Avg: 6.92 / Max: 6.98Min: 6.75 / Avg: 6.79 / Max: 6.85

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Group By Test TimeCBNA816243240SE +/- 0.61, N = 3SE +/- 0.07, N = 932.4932.1132.42
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Group By Test TimeCBNA714212835Min: 31.62 / Avg: 32.49 / Max: 33.66Min: 31.78 / Avg: 32.11 / Max: 32.44

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Repartition Test TimeCBNA816243240SE +/- 0.48, N = 3SE +/- 0.04, N = 933.2932.9934.19
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Repartition Test TimeCBNA714212835Min: 32.7 / Avg: 33.29 / Max: 34.24Min: 32.79 / Avg: 32.99 / Max: 33.15

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Inner Join Test TimeCBNA918273645SE +/- 0.17, N = 3SE +/- 0.28, N = 940.1239.9840.84
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Inner Join Test TimeCBNA816243240Min: 39.82 / Avg: 40.12 / Max: 40.41Min: 38.49 / Avg: 39.98 / Max: 40.86

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA918273645SE +/- 0.52, N = 3SE +/- 0.37, N = 939.8141.2740.09
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test TimeCBNA918273645Min: 38.99 / Avg: 39.81 / Max: 40.78Min: 39.74 / Avg: 41.27 / Max: 42.75

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA1020304050SE +/- 0.47, N = 9SE +/- 0.47, N = 546.1446.2745.82
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark TimeCBNA918273645Min: 43.72 / Avg: 46.14 / Max: 47.69Min: 44.76 / Avg: 46.27 / Max: 47.66

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.09, N = 9SE +/- 0.12, N = 5110.39109.94109.23
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi BenchmarkCBNA20406080100Min: 109.77 / Avg: 110.39 / Max: 110.74Min: 109.66 / Avg: 109.94 / Max: 110.25

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.04, N = 9SE +/- 0.02, N = 56.846.866.72
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.71 / Avg: 6.84 / Max: 7.11Min: 6.82 / Avg: 6.86 / Max: 6.95

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Group By Test TimeCBNA714212835SE +/- 0.11, N = 9SE +/- 0.10, N = 531.4531.2631.81
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Group By Test TimeCBNA714212835Min: 30.96 / Avg: 31.45 / Max: 31.92Min: 30.95 / Avg: 31.26 / Max: 31.56

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Repartition Test TimeCBNA816243240SE +/- 0.04, N = 9SE +/- 0.16, N = 532.5532.5631.76
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Repartition Test TimeCBNA714212835Min: 32.33 / Avg: 32.55 / Max: 32.74Min: 32.01 / Avg: 32.56 / Max: 32.95

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Inner Join Test TimeCBNA918273645SE +/- 0.39, N = 9SE +/- 0.49, N = 539.0637.9438.92
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Inner Join Test TimeCBNA816243240Min: 36.7 / Avg: 39.06 / Max: 40.57Min: 36.26 / Avg: 37.94 / Max: 39.13

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA918273645SE +/- 0.24, N = 9SE +/- 0.14, N = 539.1338.9937.86
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test TimeCBNA816243240Min: 38.03 / Avg: 39.13 / Max: 40.02Min: 38.5 / Avg: 38.99 / Max: 39.33

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA48121620SE +/- 0.11, N = 12SE +/- 0.14, N = 1214.3014.3414.00
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA48121620Min: 14.03 / Avg: 14.3 / Max: 15.41Min: 13.77 / Avg: 14.34 / Max: 15.38

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.15, N = 12SE +/- 0.13, N = 12110.11109.97109.52
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100Min: 108.67 / Avg: 110.11 / Max: 110.53Min: 109.14 / Avg: 109.97 / Max: 110.66

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.01, N = 12SE +/- 0.01, N = 126.816.806.70
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.77 / Avg: 6.81 / Max: 6.84Min: 6.73 / Avg: 6.8 / Max: 6.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Group By Test TimeCBNA3691215SE +/- 0.06, N = 12SE +/- 0.05, N = 129.879.679.56
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Group By Test TimeCBNA3691215Min: 9.5 / Avg: 9.87 / Max: 10.18Min: 9.4 / Avg: 9.67 / Max: 9.99

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Repartition Test TimeCBNA3691215SE +/- 0.06, N = 12SE +/- 0.07, N = 129.469.599.35
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Repartition Test TimeCBNA3691215Min: 9.05 / Avg: 9.46 / Max: 9.75Min: 9.23 / Avg: 9.59 / Max: 9.97

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Inner Join Test TimeCBNA3691215SE +/- 0.13, N = 12SE +/- 0.13, N = 1210.8010.7810.23
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Inner Join Test TimeCBNA3691215Min: 10.15 / Avg: 10.8 / Max: 11.71Min: 10.12 / Avg: 10.78 / Max: 11.64

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA3691215SE +/- 0.11, N = 12SE +/- 0.11, N = 1210.8710.6610.41
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA3691215Min: 9.91 / Avg: 10.87 / Max: 11.28Min: 10.04 / Avg: 10.66 / Max: 11.14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA48121620SE +/- 0.07, N = 3SE +/- 0.02, N = 314.2214.0414.14
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA48121620Min: 14.1 / Avg: 14.22 / Max: 14.36Min: 13.99 / Avg: 14.04 / Max: 14.07

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.22, N = 3SE +/- 0.63, N = 3109.96110.25109.91
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100Min: 109.51 / Avg: 109.96 / Max: 110.24Min: 109.24 / Avg: 110.25 / Max: 111.4

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.07, N = 3SE +/- 0.02, N = 36.846.786.76
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.71 / Avg: 6.84 / Max: 6.93Min: 6.76 / Avg: 6.78 / Max: 6.82

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Group By Test TimeCBNA3691215SE +/- 0.19, N = 3SE +/- 0.02, N = 310.219.899.80
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Group By Test TimeCBNA3691215Min: 9.97 / Avg: 10.21 / Max: 10.58Min: 9.86 / Avg: 9.89 / Max: 9.93

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Repartition Test TimeCBNA3691215SE +/- 0.06, N = 3SE +/- 0.06, N = 39.519.459.30
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Repartition Test TimeCBNA3691215Min: 9.44 / Avg: 9.51 / Max: 9.64Min: 9.39 / Avg: 9.45 / Max: 9.57

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Inner Join Test TimeCBNA3691215SE +/- 0.14, N = 3SE +/- 0.15, N = 310.6610.8311.00
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Inner Join Test TimeCBNA3691215Min: 10.38 / Avg: 10.66 / Max: 10.84Min: 10.56 / Avg: 10.83 / Max: 11.06

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA3691215SE +/- 0.50, N = 3SE +/- 0.35, N = 310.5410.839.96
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA3691215Min: 9.56 / Avg: 10.54 / Max: 11.19Min: 10.26 / Avg: 10.83 / Max: 11.47

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA612182430SE +/- 0.11, N = 325.4524.8923.24
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA612182430Min: 24.66 / Avg: 24.89 / Max: 25.01

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.19, N = 3109.96110.26110.73
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100Min: 110.04 / Avg: 110.26 / Max: 110.63

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.046089856, N = 36.8800000006.8000000006.875336993
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.71 / Avg: 6.8 / Max: 6.86

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Group By Test TimeCBNA3691215SE +/- 0.15, N = 312.9913.2013.18
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Group By Test TimeCBNA48121620Min: 12.91 / Avg: 13.2 / Max: 13.4

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Repartition Test TimeCBNA48121620SE +/- 0.18, N = 316.6716.4015.89
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Repartition Test TimeCBNA48121620Min: 16.11 / Avg: 16.4 / Max: 16.73

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Inner Join Test TimeCBNA510152025SE +/- 0.31, N = 319.8519.9519.68
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Inner Join Test TimeCBNA510152025Min: 19.35 / Avg: 19.95 / Max: 20.36

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA510152025SE +/- 0.21, N = 320.5519.6119.24
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA510152025Min: 19.31 / Avg: 19.61 / Max: 20.03

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA612182430SE +/- 0.16, N = 1223.5523.6923.25
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA612182430Min: 23.18 / Avg: 23.69 / Max: 24.86

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.12, N = 12109.92109.90109.44
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100Min: 109.26 / Avg: 109.9 / Max: 110.64

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.01, N = 126.776.796.77
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.71 / Avg: 6.79 / Max: 6.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Group By Test TimeCBNA3691215SE +/- 0.06, N = 1213.0512.9013.23
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Group By Test TimeCBNA48121620Min: 12.53 / Avg: 12.9 / Max: 13.35

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Repartition Test TimeCBNA48121620SE +/- 0.10, N = 1216.3016.6916.43
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Repartition Test TimeCBNA48121620Min: 16.33 / Avg: 16.69 / Max: 17.2

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Inner Join Test TimeCBNA510152025SE +/- 0.19, N = 1220.3020.5520.39
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Inner Join Test TimeCBNA510152025Min: 19.65 / Avg: 20.55 / Max: 21.7

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA510152025SE +/- 0.17, N = 1219.6219.2719.06
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA510152025Min: 18.2 / Avg: 19.27 / Max: 20

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA1020304050SE +/- 0.53, N = 941.0043.9044.78
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark TimeCBNA918273645Min: 41.3 / Avg: 43.9 / Max: 45.23

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.19, N = 9110.27110.39109.90
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi BenchmarkCBNA20406080100Min: 109.58 / Avg: 110.39 / Max: 111.46

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.03, N = 96.746.876.86
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.79 / Avg: 6.87 / Max: 7.08

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Group By Test TimeCBNA714212835SE +/- 0.28, N = 929.4329.3429.13
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Group By Test TimeCBNA714212835Min: 28.1 / Avg: 29.34 / Max: 31.01

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Repartition Test TimeCBNA714212835SE +/- 0.18, N = 931.0231.5131.45
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Repartition Test TimeCBNA714212835Min: 30.28 / Avg: 31.51 / Max: 32.18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Inner Join Test TimeCBNA918273645SE +/- 0.26, N = 936.5836.5237.54
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Inner Join Test TimeCBNA816243240Min: 35.43 / Avg: 36.52 / Max: 37.49

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA816243240SE +/- 0.21, N = 935.4536.7336.82
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test TimeCBNA816243240Min: 35.44 / Avg: 36.73 / Max: 37.78

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA1020304050SE +/- 0.49, N = 944.7243.4243.86
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark TimeCBNA918273645Min: 41.6 / Avg: 43.42 / Max: 45.49

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100SE +/- 0.21, N = 9110.59110.55110.09
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi BenchmarkCBNA20406080100Min: 109.21 / Avg: 110.55 / Max: 111.18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA246810SE +/- 0.02, N = 96.766.846.86
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeCBNA3691215Min: 6.77 / Avg: 6.84 / Max: 6.9

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Group By Test TimeCBNA612182430SE +/- 0.38, N = 927.2727.2225.82
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Group By Test TimeCBNA612182430Min: 26.01 / Avg: 27.22 / Max: 28.97

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Repartition Test TimeCBNA714212835SE +/- 0.09, N = 931.2731.5430.65
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Repartition Test TimeCBNA714212835Min: 31.16 / Avg: 31.54 / Max: 32.13

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Inner Join Test TimeCBNA918273645SE +/- 0.21, N = 939.3138.8037.99
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Inner Join Test TimeCBNA816243240Min: 37.86 / Avg: 38.8 / Max: 39.59

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA816243240SE +/- 0.15, N = 936.7435.8236.70
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test TimeCBNA816243240Min: 35.17 / Avg: 35.82 / Max: 36.44

120 Results Shown

SVT-AV1:
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 10 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 10 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
Apache Spark:
  1000000 - 100 - SHA-512 Benchmark Time
  1000000 - 100 - Calculate Pi Benchmark
  1000000 - 100 - Calculate Pi Benchmark Using Dataframe
  1000000 - 100 - Group By Test Time
  1000000 - 100 - Repartition Test Time
  1000000 - 100 - Inner Join Test Time
  1000000 - 100 - Broadcast Inner Join Test Time
  1000000 - 500 - SHA-512 Benchmark Time
  1000000 - 500 - Calculate Pi Benchmark
  1000000 - 500 - Calculate Pi Benchmark Using Dataframe
  1000000 - 500 - Group By Test Time
  1000000 - 500 - Repartition Test Time
  1000000 - 500 - Inner Join Test Time
  1000000 - 500 - Broadcast Inner Join Test Time
  1000000 - 1000 - SHA-512 Benchmark Time
  1000000 - 1000 - Calculate Pi Benchmark
  1000000 - 1000 - Calculate Pi Benchmark Using Dataframe
  1000000 - 1000 - Group By Test Time
  1000000 - 1000 - Repartition Test Time
  1000000 - 1000 - Inner Join Test Time
  1000000 - 1000 - Broadcast Inner Join Test Time
  1000000 - 2000 - SHA-512 Benchmark Time
  1000000 - 2000 - Calculate Pi Benchmark
  1000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  1000000 - 2000 - Group By Test Time
  1000000 - 2000 - Repartition Test Time
  1000000 - 2000 - Inner Join Test Time
  1000000 - 2000 - Broadcast Inner Join Test Time
  10000000 - 100 - SHA-512 Benchmark Time
  10000000 - 100 - Calculate Pi Benchmark
  10000000 - 100 - Calculate Pi Benchmark Using Dataframe
  10000000 - 100 - Group By Test Time
  10000000 - 100 - Repartition Test Time
  10000000 - 100 - Inner Join Test Time
  10000000 - 100 - Broadcast Inner Join Test Time
  10000000 - 500 - SHA-512 Benchmark Time
  10000000 - 500 - Calculate Pi Benchmark
  10000000 - 500 - Calculate Pi Benchmark Using Dataframe
  10000000 - 500 - Group By Test Time
  10000000 - 500 - Repartition Test Time
  10000000 - 500 - Inner Join Test Time
  10000000 - 500 - Broadcast Inner Join Test Time
  20000000 - 100 - SHA-512 Benchmark Time
  20000000 - 100 - Calculate Pi Benchmark
  20000000 - 100 - Calculate Pi Benchmark Using Dataframe
  20000000 - 100 - Group By Test Time
  20000000 - 100 - Repartition Test Time
  20000000 - 100 - Inner Join Test Time
  20000000 - 100 - Broadcast Inner Join Test Time
  20000000 - 500 - SHA-512 Benchmark Time
  20000000 - 500 - Calculate Pi Benchmark
  20000000 - 500 - Calculate Pi Benchmark Using Dataframe
  20000000 - 500 - Group By Test Time
  20000000 - 500 - Repartition Test Time
  20000000 - 500 - Inner Join Test Time
  20000000 - 500 - Broadcast Inner Join Test Time
  40000000 - 100 - SHA-512 Benchmark Time
  40000000 - 100 - Calculate Pi Benchmark
  40000000 - 100 - Calculate Pi Benchmark Using Dataframe
  40000000 - 100 - Group By Test Time
  40000000 - 100 - Repartition Test Time
  40000000 - 100 - Inner Join Test Time
  40000000 - 100 - Broadcast Inner Join Test Time
  40000000 - 500 - SHA-512 Benchmark Time
  40000000 - 500 - Calculate Pi Benchmark
  40000000 - 500 - Calculate Pi Benchmark Using Dataframe
  40000000 - 500 - Group By Test Time
  40000000 - 500 - Repartition Test Time
  40000000 - 500 - Inner Join Test Time
  40000000 - 500 - Broadcast Inner Join Test Time
  10000000 - 1000 - SHA-512 Benchmark Time
  10000000 - 1000 - Calculate Pi Benchmark
  10000000 - 1000 - Calculate Pi Benchmark Using Dataframe
  10000000 - 1000 - Group By Test Time
  10000000 - 1000 - Repartition Test Time
  10000000 - 1000 - Inner Join Test Time
  10000000 - 1000 - Broadcast Inner Join Test Time
  10000000 - 2000 - SHA-512 Benchmark Time
  10000000 - 2000 - Calculate Pi Benchmark
  10000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  10000000 - 2000 - Group By Test Time
  10000000 - 2000 - Repartition Test Time
  10000000 - 2000 - Inner Join Test Time
  10000000 - 2000 - Broadcast Inner Join Test Time
  20000000 - 1000 - SHA-512 Benchmark Time
  20000000 - 1000 - Calculate Pi Benchmark
  20000000 - 1000 - Calculate Pi Benchmark Using Dataframe
  20000000 - 1000 - Group By Test Time
  20000000 - 1000 - Repartition Test Time
  20000000 - 1000 - Inner Join Test Time
  20000000 - 1000 - Broadcast Inner Join Test Time
  20000000 - 2000 - SHA-512 Benchmark Time
  20000000 - 2000 - Calculate Pi Benchmark
  20000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  20000000 - 2000 - Group By Test Time
  20000000 - 2000 - Repartition Test Time
  20000000 - 2000 - Inner Join Test Time
  20000000 - 2000 - Broadcast Inner Join Test Time
  40000000 - 1000 - SHA-512 Benchmark Time
  40000000 - 1000 - Calculate Pi Benchmark
  40000000 - 1000 - Calculate Pi Benchmark Using Dataframe
  40000000 - 1000 - Group By Test Time
  40000000 - 1000 - Repartition Test Time
  40000000 - 1000 - Inner Join Test Time
  40000000 - 1000 - Broadcast Inner Join Test Time
  40000000 - 2000 - SHA-512 Benchmark Time
  40000000 - 2000 - Calculate Pi Benchmark
  40000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  40000000 - 2000 - Group By Test Time
  40000000 - 2000 - Repartition Test Time
  40000000 - 2000 - Inner Join Test Time
  40000000 - 2000 - Broadcast Inner Join Test Time