spark svt

AMD EPYC 7551 32-Core testing with a GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) and ASPEED on Debian 11 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2208045-HA-SPARKSVT093
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
A
August 04
  6 Hours, 51 Minutes
B
August 04
  6 Hours, 48 Minutes
C
August 04
  6 Hours, 44 Minutes
D
August 04
  6 Hours, 47 Minutes
Invert Hiding All Results Option
  6 Hours, 48 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):


spark svtOpenBenchmarking.orgPhoronix Test Suite 10.8.4AMD EPYC 7551 32-Core @ 2.00GHz (32 Cores / 64 Threads)GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS)AMD 17h8 x 4 GB DDR4-2667MT/s 9ASF51272PZ-2G6E1Samsung SSD 960 EVO 500GB + 31GB SanDisk 3.2Gen1ASPEEDRealtek RTL8111/8168/8411 + 2 x Broadcom NetXtreme II BCM57810 10Debian 115.10.0-9-amd64 (x86_64)GCC 10.2.1 20210110ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSpark Svt BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8001227- OpenJDK Runtime Environment (build 11.0.12+7-post-Debian-2)- Python 3.9.2- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

ABCDResult OverviewPhoronix Test Suite 10.8.4100%126%153%179%205%Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkSVT-AV1Apache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache SparkApache Spark1000000 - 100 - R.T.T1000000 - 1000 - R.T.T1000000 - 2000 - B.I.J.T.T1000000 - 100 - B.I.J.T.T1000000 - 500 - B.I.J.T.T1000000 - 500 - R.T.T1000000 - 100 - I.J.T.T10000000 - 100 - R.T.T1000000 - 1000 - B.I.J.T.T40000000 - 100 - S.5.B.T10000000 - 500 - Group By Test Time20000000 - 100 - S.5.B.T1000000 - 500 - I.J.T.T1000000 - 1000 - I.J.T.T10000000 - 2000 - B.I.J.T.T1000000 - 2000 - R.T.T20000000 - 1000 - Group By Test Time20000000 - 500 - R.T.TPreset 10 - Bosphorus 4K10000000 - 500 - R.T.T10000000 - 1000 - Group By Test Time10000000 - 100 - Group By Test TimePreset 8 - Bosphorus 4K20000000 - 100 - R.T.T1000000 - 1000 - S.5.B.T10000000 - 2000 - I.J.T.T10000000 - 2000 - Group By Test Time10000000 - 1000 - B.I.J.T.T10000000 - 500 - I.J.T.TPreset 10 - Bosphorus 1080p20000000 - 1000 - S.5.B.T20000000 - 2000 - R.T.T40000000 - 2000 - I.J.T.TPreset 12 - Bosphorus 1080p10000000 - 100 - I.J.T.T20000000 - 100 - I.J.T.T20000000 - 100 - B.I.J.T.T10000000 - 100 - S.5.B.T40000000 - 1000 - S.5.B.T10000000 - 500 - B.I.J.T.T20000000 - 100 - Group By Test Time1000000 - 2000 - I.J.T.T1000000 - 500 - S.5.B.TPreset 12 - Bosphorus 4K10000000 - 1000 - R.T.T40000000 - 100 - R.T.T40000000 - 100 - B.I.J.T.T10000000 - 2000 - S.5.B.T1000000 - 2000 - S.5.B.T40000000 - 500 - S.5.B.T20000000 - 500 - Group By Test Time20000000 - 1000 - R.T.T20000000 - 500 - B.I.J.T.T40000000 - 1000 - Group By Test Time10000000 - 100 - B.I.J.T.T40000000 - 100 - Group By Test Time10000000 - 1000 - I.J.T.T20000000 - 500 - S.5.B.T40000000 - 2000 - R.T.TPreset 8 - Bosphorus 1080p1000000 - 1000 - Group By Test Time40000000 - 2000 - S.5.B.T40000000 - 2000 - Group By Test Time20000000 - 500 - I.J.T.T1000000 - 2000 - Group By Test Time1000000 - 1000 - C.P.B.U.D10000000 - 2000 - R.T.T20000000 - 2000 - S.5.B.T1000000 - 500 - Group By Test Time1000000 - 100 - S.5.B.T10000000 - 1000 - S.5.B.T1000000 - 100 - Group By Test Time10000000 - 500 - C.P.B.U.DPreset 4 - Bosphorus 4K1000000 - 500 - C.P.B.U.D40000000 - 2000 - C.P.B.U.D20000000 - 500 - C.P.B.U.D40000000 - 2000 - B.I.J.T.T1000000 - 2000 - C.P.B.U.D40000000 - 500 - I.J.T.T20000000 - 2000 - I.J.T.T10000000 - 1000 - C.P.B.U.D20000000 - 2000 - Group By Test Time1000000 - 100 - C.P.B.U.D40000000 - 1000 - B.I.J.T.T40000000 - 500 - Group By Test Time40000000 - 1000 - C.P.B.U.D20000000 - 2000 - B.I.J.T.T40000000 - 500 - R.T.TPreset 4 - Bosphorus 1080p10000000 - 2000 - C.P.B.U.D40000000 - 100 - I.J.T.T40000000 - 1000 - I.J.T.T20000000 - 1000 - I.J.T.T20000000 - 1000 - C.P.B.U.D20000000 - 1000 - B.I.J.T.T40000000 - 500 - C.P.B.U.D40000000 - 100 - C.P.B.U.D40000000 - 500 - B.I.J.T.T20000000 - 2000 - C.P.B.U.D40000000 - 1000 - R.T.T

spark svtspark: 40000000 - 2000 - Broadcast Inner Join Test Timespark: 40000000 - 2000 - Inner Join Test Timespark: 40000000 - 2000 - Repartition Test Timespark: 40000000 - 2000 - Group By Test Timespark: 40000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 2000 - Calculate Pi Benchmarkspark: 40000000 - 2000 - SHA-512 Benchmark Timespark: 40000000 - 500 - Broadcast Inner Join Test Timespark: 40000000 - 500 - Inner Join Test Timespark: 40000000 - 500 - Repartition Test Timespark: 40000000 - 500 - Group By Test Timespark: 40000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 500 - Calculate Pi Benchmarkspark: 40000000 - 500 - SHA-512 Benchmark Timespark: 40000000 - 100 - Broadcast Inner Join Test Timespark: 40000000 - 100 - Inner Join Test Timespark: 40000000 - 100 - Repartition Test Timespark: 40000000 - 100 - Group By Test Timespark: 40000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - Calculate Pi Benchmarkspark: 40000000 - 100 - SHA-512 Benchmark Timespark: 40000000 - 1000 - Broadcast Inner Join Test Timespark: 40000000 - 1000 - Inner Join Test Timespark: 40000000 - 1000 - Repartition Test Timespark: 40000000 - 1000 - Group By Test Timespark: 40000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 1000 - Calculate Pi Benchmarkspark: 40000000 - 1000 - SHA-512 Benchmark Timespark: 20000000 - 2000 - Broadcast Inner Join Test Timespark: 20000000 - 2000 - Inner Join Test Timespark: 20000000 - 2000 - Repartition Test Timespark: 20000000 - 2000 - Group By Test Timespark: 20000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 2000 - Calculate Pi Benchmarkspark: 20000000 - 2000 - SHA-512 Benchmark Timespark: 20000000 - 1000 - Broadcast Inner Join Test Timespark: 20000000 - 1000 - Inner Join Test Timespark: 20000000 - 1000 - Repartition Test Timespark: 20000000 - 1000 - Group By Test Timespark: 20000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 1000 - Calculate Pi Benchmarkspark: 20000000 - 1000 - SHA-512 Benchmark Timespark: 20000000 - 100 - Broadcast Inner Join Test Timespark: 20000000 - 100 - Inner Join Test Timespark: 20000000 - 100 - Repartition Test Timespark: 20000000 - 100 - Group By Test Timespark: 20000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 100 - Calculate Pi Benchmarkspark: 20000000 - 100 - SHA-512 Benchmark Timespark: 20000000 - 500 - Broadcast Inner Join Test Timespark: 20000000 - 500 - Inner Join Test Timespark: 20000000 - 500 - Repartition Test Timespark: 20000000 - 500 - Group By Test Timespark: 20000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 20000000 - 500 - Calculate Pi Benchmarkspark: 20000000 - 500 - SHA-512 Benchmark Timespark: 10000000 - 2000 - Broadcast Inner Join Test Timespark: 10000000 - 2000 - Inner Join Test Timespark: 10000000 - 2000 - Repartition Test Timespark: 10000000 - 2000 - Group By Test Timespark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Calculate Pi Benchmarkspark: 10000000 - 2000 - SHA-512 Benchmark Timespark: 10000000 - 1000 - Broadcast Inner Join Test Timespark: 10000000 - 1000 - Inner Join Test Timespark: 10000000 - 1000 - Repartition Test Timespark: 10000000 - 1000 - Group By Test Timespark: 10000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 1000 - Calculate Pi Benchmarkspark: 10000000 - 1000 - SHA-512 Benchmark Timespark: 10000000 - 100 - Broadcast Inner Join Test Timespark: 10000000 - 100 - Inner Join Test Timespark: 10000000 - 100 - Repartition Test Timespark: 10000000 - 100 - Group By Test Timespark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 100 - Calculate Pi Benchmarkspark: 10000000 - 100 - SHA-512 Benchmark Timespark: 10000000 - 500 - Broadcast Inner Join Test Timespark: 10000000 - 500 - Inner Join Test Timespark: 10000000 - 500 - Repartition Test Timespark: 10000000 - 500 - Group By Test Timespark: 10000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 500 - Calculate Pi Benchmarkspark: 10000000 - 500 - SHA-512 Benchmark Timesvt-av1: Preset 4 - Bosphorus 4Kspark: 1000000 - 2000 - Broadcast Inner Join Test Timespark: 1000000 - 2000 - Inner Join Test Timespark: 1000000 - 2000 - Repartition Test Timespark: 1000000 - 2000 - Group By Test Timespark: 1000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 2000 - Calculate Pi Benchmarkspark: 1000000 - 2000 - SHA-512 Benchmark Timespark: 1000000 - 1000 - Broadcast Inner Join Test Timespark: 1000000 - 1000 - Inner Join Test Timespark: 1000000 - 1000 - Repartition Test Timespark: 1000000 - 1000 - Group By Test Timespark: 1000000 - 1000 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 1000 - Calculate Pi Benchmarkspark: 1000000 - 1000 - SHA-512 Benchmark Timespark: 1000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 500 - Inner Join Test Timespark: 1000000 - 500 - Repartition Test Timespark: 1000000 - 500 - Group By Test Timespark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 500 - Calculate Pi Benchmarkspark: 1000000 - 500 - SHA-512 Benchmark Timespark: 1000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Repartition Test Timespark: 1000000 - 100 - Group By Test Timespark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 1000000 - 100 - SHA-512 Benchmark Timesvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 10 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 10 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080pABCD38.3237.3034.2945.706.0380.6163.5435.7235.6635.7046.766.0780.6963.0839.4138.2237.6142.586.0680.3979.4837.3637.9235.8245.876.3380.9671.6721.6023.0223.4323.476.1080.4239.2820.1721.8822.4221.576.0480.7238.6319.7021.7623.1621.056.0379.1636.1518.5019.96169719119.1821.826.2980.5337.1114.7117.0813.8719.096.1980.7423.0012.9713.8715.3717.096.1880.8622.5611.6713.5112.3114.556.4078.8022.3812.2812.5615.1315.306.2479.6821.910.9455.625.746.1910.056.5778.848.313.024.535.439.996.0878.887.763.164.405.099.856.0278.348.573.103.654.649.246.0578.687.622.43228.87649.1762.04261.782129.462193.67239.5442.9936.6946.886.4180.4668.3836.8935.8634.1645.476.2681.2065.0635.0436.8533.4342.596.0980.8861.7336.6337.5435.2743.706.0480.7963.0322.2422.8820.3023.716.0179.8139.1919.4721.3223.2822.626.0979.7341.1519.1720.0020.0820.296.0379.7335.8418.1219.4623.4919.576.1779.9137.9512.9714.9514.2617.985.9380.6725.0311.1313.7613.6516.506.2880.0622.1410.5611.7916.7215.106.2779.5021.4311.2312.1713.7219.546.1479.4422.511.0087.745.877.1910.776.2079.738.614.065.015.6810.816.4078.847.433.564.585.989.306.4279.117.572.565.013.878.936.3680.097.162.53924.23540.56660.30657.433119.495170.27839.5041.5534.3343.426.0980.0165.0036.3937.6535.6444.616.1880.4366.5737.2936.6834.6838.985.9079.7160.3836.1236.4234.7741.486.2479.9163.3621.4222.1520.3122.795.9278.6536.5519.4521.0622.8423.786.1179.4435.6321.9022.9021.4118.535.9779.1934.0320.0820.9522.4120.646.0780.0240.0311.8215.3813.4618.476.1679.9122.3111.9514.4014.8515.066.5079.2721.8511.1213.1115.7115.186.3178.4424.0712.2914.1512.6415.006.2279.2722.000.9744.576.525.7610.136.2178.707.713.255.475.3010.426.5478.568.754.474.437.299.536.2678.547.712.053.974.779.256.2679.567.692.49225.16942.50654.82262.241131.751196.22940.6940.0537.2345.966.0279.7763.3236.0936.9434.3545.736.0480.0770.3836.8737.7036.6940.396.1179.7271.7735.5836.8234.9442.196.2680.3965.1922.3923.3422.0322.556.0879.0937.4119.7721.8324.9019.236.2779.0436.3720.3422.5919.5718.986.0279.2544.0618.7920.1719.2021.595.9179.7636.6811.7514.5513.2616.306.1880.0622.8911.7113.1914.3414.206.3779.8421.0210.9313.3516.3417.516.4378.8924.3910.8113.2315.2615.506.5679.2221.950.9845.715.756.9710.016.3278.508.563.284.339.2210.156.1178.627.813.115.625.839.996.3078.647.822.913.527.949.566.2678.797.552.52925.41546.59155.32460.95138.694195.506OpenBenchmarking.org

Apache Spark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test TimeDCBA91827364540.6939.5039.5438.32

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Inner Join Test TimeDCBA102030405040.0541.5542.9937.30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Repartition Test TimeDCBA91827364537.2334.3336.6934.29

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Group By Test TimeDCBA112233445545.9643.4246.8845.70

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeDCBA2468106.026.096.416.03

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi BenchmarkDCBA2040608010079.7780.0180.4680.61

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark TimeDCBA153045607563.3265.0068.3863.54

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Broadcast Inner Join Test TimeDCBA81624324036.0936.3936.8935.72

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Inner Join Test TimeDCBA91827364536.9437.6535.8635.66

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Repartition Test TimeDCBA81624324034.3535.6434.1635.70

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Group By Test TimeDCBA112233445545.7344.6145.4746.76

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeDCBA2468106.046.186.266.07

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi BenchmarkDCBA2040608010080.0780.4381.2080.69

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark TimeDCBA163248648070.3866.5765.0663.08

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test TimeDCBA91827364536.8737.2935.0439.41

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Inner Join Test TimeDCBA91827364537.7036.6836.8538.22

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Repartition Test TimeDCBA91827364536.6934.6833.4337.61

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Group By Test TimeDCBA102030405040.3938.9842.5942.58

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeDCBA2468106.115.906.096.06

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi BenchmarkDCBA2040608010079.7279.7180.8880.39

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark TimeDCBA2040608010071.7760.3861.7379.48

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Broadcast Inner Join Test TimeDCBA91827364535.5836.1236.6337.36

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Inner Join Test TimeDCBA91827364536.8236.4237.5437.92

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Repartition Test TimeDCBA81624324034.9434.7735.2735.82

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Group By Test TimeDCBA102030405042.1941.4843.7045.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeDCBA2468106.266.246.046.33

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - Calculate Pi BenchmarkDCBA2040608010080.3979.9180.7980.96

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 1000 - SHA-512 Benchmark TimeDCBA163248648065.1963.3663.0371.67

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Broadcast Inner Join Test TimeDCBA51015202522.3921.4222.2421.60

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Inner Join Test TimeDCBA61218243023.3422.1522.8823.02

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Repartition Test TimeDCBA61218243022.0320.3120.3023.43

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Group By Test TimeDCBA61218243022.5522.7923.7123.47

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeDCBA2468106.085.926.016.10

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - Calculate Pi BenchmarkDCBA2040608010079.0978.6579.8180.42

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 2000 - SHA-512 Benchmark TimeDCBA91827364537.4136.5539.1939.28

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Broadcast Inner Join Test TimeDCBA51015202519.7719.4519.4720.17

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Inner Join Test TimeDCBA51015202521.8321.0621.3221.88

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Repartition Test TimeDCBA61218243024.9022.8423.2822.42

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Group By Test TimeDCBA61218243019.2323.7822.6221.57

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeDCBA2468106.276.116.096.04

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - Calculate Pi BenchmarkDCBA2040608010079.0479.4479.7380.72

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 1000 - SHA-512 Benchmark TimeDCBA91827364536.3735.6341.1538.63

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Broadcast Inner Join Test TimeDCBA51015202520.3421.9019.1719.70

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Inner Join Test TimeDCBA51015202522.5922.9020.0021.76

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Repartition Test TimeDCBA61218243019.5721.4120.0823.16

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Group By Test TimeDCBA51015202518.9818.5320.2921.05

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeDCBA2468106.025.976.036.03

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - Calculate Pi BenchmarkDCBA2040608010079.2579.1979.7379.16

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 100 - SHA-512 Benchmark TimeDCBA102030405044.0634.0335.8436.15

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Broadcast Inner Join Test TimeDCBA51015202518.7920.0818.1218.50

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Inner Join Test TimeDCBA51015202520.1720.9519.4619.96

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Repartition Test TimeDCBA61218243019.2022.4123.4919.18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Group By Test TimeDCBA51015202521.5920.6419.5721.82

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeDCBA2468105.916.076.176.29

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - Calculate Pi BenchmarkDCBA2040608010079.7680.0279.9180.53

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 20000000 - Partitions: 500 - SHA-512 Benchmark TimeDCBA91827364536.6840.0337.9537.11

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test TimeDCBA4812162011.7511.8212.9714.71

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Inner Join Test TimeDCBA4812162014.5515.3814.9517.08

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Repartition Test TimeDCBA4812162013.2613.4614.2613.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Group By Test TimeDCBA51015202516.3018.4717.9819.09

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeDCBA2468106.186.165.936.19

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi BenchmarkDCBA2040608010080.0679.9180.6780.74

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark TimeDCBA61218243022.8922.3125.0323.00

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Broadcast Inner Join Test TimeDCBA369121511.7111.9511.1312.97

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Inner Join Test TimeDCBA4812162013.1914.4013.7613.87

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Repartition Test TimeDCBA4812162014.3414.8513.6515.37

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Group By Test TimeDCBA4812162014.2015.0616.5017.09

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeDCBA2468106.376.506.286.18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - Calculate Pi BenchmarkDCBA2040608010079.8479.2780.0680.86

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 1000 - SHA-512 Benchmark TimeDCBA51015202521.0221.8522.1422.56

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test TimeDCBA369121510.9311.1210.5611.67

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Inner Join Test TimeDCBA369121513.3513.1111.7913.51

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Repartition Test TimeDCBA4812162016.3415.7116.7212.31

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Group By Test TimeDCBA4812162017.5115.1815.1014.55

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeDCBA2468106.436.316.276.40

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi BenchmarkDCBA2040608010078.8978.4479.5078.80

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark TimeDCBA61218243024.3924.0721.4322.38

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Broadcast Inner Join Test TimeDCBA369121510.8112.2911.2312.28

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Inner Join Test TimeDCBA4812162013.2314.1512.1712.56

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Repartition Test TimeDCBA4812162015.2612.6413.7215.13

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Group By Test TimeDCBA51015202515.5015.0019.5415.30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeDCBA2468106.566.226.146.24

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - Calculate Pi BenchmarkDCBA2040608010079.2279.2779.4479.68

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 500 - SHA-512 Benchmark TimeDCBA51015202521.9522.0022.5121.91

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 4KDCBA0.22680.45360.68040.90721.1340.9840.9741.0080.9451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache Spark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Broadcast Inner Join Test TimeDCBA2468105.714.577.745.62

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Inner Join Test TimeDCBA2468105.756.525.875.74

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Repartition Test TimeDCBA2468106.975.767.196.19

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Group By Test TimeDCBA369121510.0110.1310.7710.05

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeDCBA2468106.326.216.206.57

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - Calculate Pi BenchmarkDCBA2040608010078.5078.7079.7378.84

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 2000 - SHA-512 Benchmark TimeDCBA2468108.567.718.618.31

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Broadcast Inner Join Test TimeDCBA0.91351.8272.74053.6544.56753.283.254.063.02

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Inner Join Test TimeDCBA1.23082.46163.69244.92326.1544.335.475.014.53

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Repartition Test TimeDCBA36912159.225.305.685.43

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Group By Test TimeDCBA369121510.1510.4210.819.99

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi Benchmark Using DataframeDCBA2468106.116.546.406.08

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - Calculate Pi BenchmarkDCBA2040608010078.6278.5678.8478.88

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 1000 - SHA-512 Benchmark TimeDCBA2468107.818.757.437.76

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test TimeDCBA1.00582.01163.01744.02325.0293.114.473.563.16

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Inner Join Test TimeDCBA1.26452.5293.79355.0586.32255.624.434.584.40

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Repartition Test TimeDCBA2468105.837.295.985.09

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Group By Test TimeDCBA36912159.999.539.309.85

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeDCBA2468106.306.266.426.02

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi BenchmarkDCBA2040608010078.6478.5479.1178.34

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark TimeDCBA2468107.827.717.578.57

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test TimeDCBA0.69751.3952.09252.793.48752.912.052.563.10

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test TimeDCBA1.12732.25463.38194.50925.63653.523.975.013.65

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test TimeDCBA2468107.944.773.874.64

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test TimeDCBA36912159.569.258.939.24

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeDCBA2468106.266.266.366.05

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkDCBA2040608010078.7979.5680.0978.68

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeDCBA2468107.557.697.167.62

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 1080pDCBA0.57131.14261.71392.28522.85652.5292.4922.5392.4321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 4KDCBA71421283525.4225.1724.2428.881. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 4KDCBA112233445546.5942.5140.5749.171. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 4KDCBA142842567055.3254.8260.3162.041. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 1080pDCBA142842567060.9562.2457.4361.781. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 1080pDCBA306090120150138.69131.75119.50129.461. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 1080pDCBA4080120160200195.51196.23170.28193.671. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq