rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd

rk1-mainline-emmc testing on Ubuntu 22.04 via the Phoronix Test Suite. rk1-mainline-nvme: rk1-mainline-nvme testing on Ubuntu 22.04 via the Phoronix Test Suite. rok1: Rockchip ARMv8 Cortex-A76 testing with a Turing Machines RK1 and rockchipdrmfb on Ubuntu 22.04 via the Phoronix Test Suite. pi5-compilation: ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite. pi4-raspbian-sd: ARMv8 Cortex-A72 testing on Debian 12 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2405141-NE-RK1EMMCCO86,2405147-NE-RK1MAINLI70,2405142-NE-ROK12186375,2402267-NE-PI5COMPIL39,2402287-NE-PI4RASPBI24&cts=1&ppt=D&sor&grr.

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdProcessorMotherboardMemoryDiskGraphicsNetworkChipsetOSKernelVulkanCompilerFile-SystemScreen ResolutionDisplay Serverrk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdrk1-mainline-emmc @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB1000GB CT1000P3PSSD8 + 31GB BJTD4RUbuntu 22.046.7.0 (aarch64)1.3.255GCC 11.4.0ext4rk1-mainline-nvme @ 1.80GHz (4 Cores / 8 Threads)500GB CT500P3SSD8 + 31GB BJTD4Rrk1-rok-emmc @ 1.80GHz (4 Cores / 8 Threads)rockchipdrmfb5.10.160-rockchip (aarch64)1920x1080Rockchip ARMv8 Cortex-A76 @ 1.80GHz (4 Cores / 8 Threads)ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.04096MB500GB CT500P3SSD8Device 1de4:0001Debian 126.1.0-rpi7-rpi-2712 (aarch64)GCC 12.2.0ARMv8 Cortex-A72 @ 1.80GHz (4 Cores)BCM2835 Raspberry Pi 400 Rev 1.0Broadcom BCM271164GB SR64G6.1.0-rpi6-rpi-v8 (aarch64)X ServerOpenBenchmarking.orgKernel Details- rk1-mainline-emmc: Transparent Huge Pages: madvise- rk1-mainline-nvme: Transparent Huge Pages: madvise- pi4-raspbian-sd: snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0 cfg80211.ieee80211_regdom=USCompiler Details- rk1-mainline-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi5-raspbian-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi4-raspbian-sd: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- rk1-mainline-emmc: Scaling Governor: rockchip-cpufreq ondemand- rk1-mainline-nvme: Scaling Governor: rockchip-cpufreq performance- rk1-rok-emmc: Scaling Governor: cpufreq-dt performance- rk1-rok-nvme: Scaling Governor: cpufreq-dt performance- pi5-raspbian-nvme: Scaling Governor: cpufreq-dt ondemand- pi4-raspbian-sd: Scaling Governor: cpufreq-dt ondemandPython Details- rk1-mainline-emmc: Python 3.10.12- rk1-mainline-nvme: Python 3.10.12- rk1-rok-emmc: Python 3.10.12- rk1-rok-nvme: Python 3.10.12- pi5-raspbian-nvme: Python 3.11.2- pi4-raspbian-sd: Python 3.11.2Security Details- rk1-mainline-emmc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-emmc: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-nvme: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi5-raspbian-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - pi4-raspbian-sd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdspark-tpcds: 3000rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.org

Apache Spark TPC-DS

Scale Factor Comparison (Q99)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q99)11050100510152025SE +/- 0.02, N = 2SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.64, N = 2SE +/- 0.22, N = 2SE +/- 0.36, N = 3SE +/- 0.29, N = 37.6210.2016.3722.457.8310.2316.261. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 100)

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 100)Q12Q20Q98Q41Q61Q90Q91Q96Q84Q86Q62Q83Q92Q45Q42Q55Q81Q43Q52Q30Q03Q63Q53Q01Q26Q21Q37Q73Q08Q99Q32Q39Q48Q89Q06Q34Q40Q44Q85Q19Q82Q15Q95Q69Q02Q56Q10Q66Q18Q94Q13Q27Q76Q33Q07Q46Q79Q60Q36Q68Q71Q57Q77Q54Q70Q58Q59Q35Q24Q09Q25Q17Q49Q29Q47Q31Q88Q22Q05Q38Q87Q28Q65Q97Q50Q75Q80Q14Q51Q74Q11Q72Q93Q64Q78Q04Q67Q2350100150200250SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.22, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.17, N = 2SE +/- 0.18, N = 3SE +/- 0.28, N = 3SE +/- 0.20, N = 3SE +/- 0.33, N = 3SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.57, N = 3SE +/- 0.09, N = 3SE +/- 0.24, N = 3SE +/- 0.46, N = 3SE +/- 0.28, N = 3SE +/- 0.64, N = 2SE +/- 0.17, N = 3SE +/- 1.30, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 2SE +/- 0.66, N = 3SE +/- 0.30, N = 3SE +/- 0.67, N = 3SE +/- 0.16, N = 3SE +/- 0.30, N = 3SE +/- 0.06, N = 3SE +/- 0.33, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.08, N = 3SE +/- 0.44, N = 3SE +/- 0.54, N = 3SE +/- 0.28, N = 3SE +/- 0.50, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.45, N = 3SE +/- 0.64, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.71, N = 3SE +/- 0.49, N = 3SE +/- 0.84, N = 3SE +/- 0.15, N = 3SE +/- 0.74, N = 3SE +/- 0.30, N = 3SE +/- 0.19, N = 3SE +/- 0.83, N = 3SE +/- 0.53, N = 3SE +/- 0.85, N = 3SE +/- 0.17, N = 3SE +/- 0.74, N = 3SE +/- 0.49, N = 3SE +/- 0.33, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.70, N = 3SE +/- 1.29, N = 3SE +/- 0.29, N = 3SE +/- 0.44, N = 3SE +/- 0.66, N = 3SE +/- 0.15, N = 3SE +/- 2.08, N = 3SE +/- 1.31, N = 3SE +/- 0.24, N = 3SE +/- 0.82, N = 3SE +/- 0.98, N = 3SE +/- 1.28, N = 3SE +/- 2.66, N = 3SE +/- 1.20, N = 3SE +/- 1.38, N = 3SE +/- 0.56, N = 3SE +/- 1.63, N = 3SE +/- 1.70, N = 3SE +/- 2.48, N = 3SE +/- 2.62, N = 3SE +/- 1.16, N = 3SE +/- 1.23, N = 3SE +/- 0.08, N = 35.225.325.347.297.5112.1112.2113.5313.5715.5715.6615.7516.2416.8617.7218.2218.7018.7118.8719.5119.5119.9320.0620.1320.4420.5720.9921.9222.2422.4522.6522.7723.0023.2223.7423.9524.0825.2225.2325.5726.0626.1926.6526.7627.5527.5927.5927.6827.8827.9728.1928.4629.1429.1729.3230.0430.3330.6931.0431.3131.4431.6733.6733.8335.1535.6136.2136.6039.9941.1941.9742.9244.0047.4750.0551.4955.6860.7566.7467.3867.9768.1773.3878.0781.0696.42100.24101.62101.72112.49121.65135.02140.11151.38186.01192.45205.56223.121. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q98)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q98)110501001.20152.4033.60454.8066.0075SE +/- 0.02, N = 4SE +/- 0.08, N = 2SE +/- 0.14, N = 2SE +/- 0.05, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 4SE +/- 0.04, N = 34.855.045.265.344.875.005.161. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q97)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q97)1105010020406080100SE +/- 0.07, N = 3SE +/- 0.17, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 4SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 39.7116.9948.419.8317.2347.0878.071. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q96)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q96)110501003691215SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 35.736.6410.1813.535.757.1610.911. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q95)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q95)11050100612182430SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 2SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 4SE +/- 0.36, N = 37.2610.1618.1026.657.4610.2118.231. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q94)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q94)11050100714212835SE +/- 0.03, N = 4SE +/- 0.09, N = 3SE +/- 0.44, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 36.0910.1218.9627.976.119.9319.041. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q93)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q93)11050100306090120150SE +/- 0.02, N = 2SE +/- 0.26, N = 4SE +/- 0.71, N = 3SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 2.38, N = 3SE +/- 1.70, N = 37.7127.1585.827.7527.0785.15140.111. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q92)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q92)1105050010048121620SE +/- 0.06, N = 3SE +/- 0.05, N = 4SE +/- 0.07, N = 3SE +/- 0.08, N = 4SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.44, N = 3SE +/- 0.13, N = 37.589.0712.357.799.0113.1816.0416.241. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q91)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q91)110501003691215SE +/- 0.06, N = 4SE +/- 0.25, N = 2SE +/- 0.27, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 2SE +/- 0.02, N = 3SE +/- 0.18, N = 38.1910.0010.7312.218.329.7810.921. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q90)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q90)110505001003691215SE +/- 0.06, N = 4SE +/- 0.13, N = 3SE +/- 0.37, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 4SE +/- 0.37, N = 36.637.529.8212.1012.116.767.469.971. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q89)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q89)11050100500612182430SE +/- 0.01, N = 2SE +/- 0.10, N = 4SE +/- 0.22, N = 3SE +/- 0.10, N = 4SE +/- 0.06, N = 3SE +/- 0.51, N = 3SE +/- 0.16, N = 3SE +/- 0.42, N = 38.7011.0117.658.8110.7817.7023.2223.461. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q88)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q88)110505001001326395265SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 1.14, N = 3SE +/- 0.43, N = 3SE +/- 1.29, N = 3SE +/- 0.14, N = 2SE +/- 0.39, N = 4SE +/- 0.85, N = 311.3917.4836.1453.7055.6811.8317.1836.301. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q87)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q87)110501005001530456075SE +/- 0.05, N = 4SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.15, N = 3SE +/- 0.70, N = 3SE +/- 0.01, N = 3SE +/- 0.72, N = 3SE +/- 0.51, N = 310.0718.0443.6067.9768.1910.0917.6644.421. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q86)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q86)1105050010048121620SE +/- 0.11, N = 4SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.31, N = 38.049.2812.3015.4015.578.139.1712.231. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q85)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q85)11050500100612182430SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.47, N = 2SE +/- 0.20, N = 3SE +/- 0.30, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.28, N = 311.8614.5620.2224.6025.2312.0014.8519.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q84)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q84)110505001003691215SE +/- 0.05, N = 3SE +/- 0.07, N = 4SE +/- 0.21, N = 3SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 37.139.1311.687.309.1511.7013.5513.571. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q83)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q83)1105010048121620SE +/- 0.06, N = 3SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 39.2110.7413.639.2410.7913.2615.751. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q82)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q82)11050010050918273645SE +/- 0.07, N = 4SE +/- 0.19, N = 3SE +/- 0.43, N = 3SE +/- 0.16, N = 3SE +/- 0.80, N = 3SE +/- 0.10, N = 2SE +/- 0.22, N = 4SE +/- 0.08, N = 38.8616.6426.0226.0638.468.8816.9940.311. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q81)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q81)11050100510152025SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 38.7611.5415.868.8711.4615.6018.701. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q80)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q80)11010050306090120150SE +/- 0.04, N = 3SE +/- 0.46, N = 4SE +/- 2.12, N = 3SE +/- 0.10, N = 4SE +/- 0.75, N = 3SE +/- 1.28, N = 3SE +/- 1.43, N = 313.4548.08154.5313.5247.18100.24154.371. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q79)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q79)11050500100714212835SE +/- 0.06, N = 4SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.49, N = 3SE +/- 0.27, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 4SE +/- 0.10, N = 38.4411.9921.0430.2730.338.5111.9121.241. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q78)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q78)110501004080120160200SE +/- 0.08, N = 3SE +/- 0.31, N = 4SE +/- 0.64, N = 3SE +/- 0.07, N = 4SE +/- 0.13, N = 3SE +/- 2.63, N = 3SE +/- 2.62, N = 314.0344.14145.2914.3343.40145.20186.011. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q77)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q77)11050100816243240SE +/- 0.08, N = 3SE +/- 0.24, N = 4SE +/- 0.16, N = 3SE +/- 0.05, N = 4SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.30, N = 311.2415.2524.6611.3914.5724.2433.671. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q76)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q76)11050500100714212835SE +/- 0.10, N = 4SE +/- 0.13, N = 2SE +/- 0.40, N = 3SE +/- 0.72, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 2SE +/- 0.21, N = 3SE +/- 0.40, N = 38.7812.3020.5928.5929.148.8212.5220.501. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q75)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q75)1105010020406080100SE +/- 0.13, N = 4SE +/- 0.38, N = 3SE +/- 1.20, N = 3SE +/- 0.98, N = 3SE +/- 0.15, N = 3SE +/- 0.35, N = 4SE +/- 0.38, N = 314.2627.0459.3796.4214.4327.4959.601. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q74)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q74)11050100306090120150SE +/- 0.08, N = 3SE +/- 0.13, N = 4SE +/- 1.15, N = 3SE +/- 0.05, N = 4SE +/- 0.09, N = 3SE +/- 0.64, N = 3SE +/- 1.38, N = 311.7219.8097.5211.9519.7495.45112.491. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q73)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q73)11050500100510152025SE +/- 0.07, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 2SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.46, N = 38.3011.1916.298.3111.1516.6521.3021.921. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q72)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q72)11010050100200300400500SE +/- 0.25, N = 4SE +/- 0.40, N = 3SE +/- 1.63, N = 3SE +/- 11.04, N = 3SE +/- 0.12, N = 3SE +/- 1.21, N = 4SE +/- 5.27, N = 319.11118.08135.02419.7919.61118.28445.111. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q71)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q71)11050500100714212835SE +/- 0.08, N = 3SE +/- 0.21, N = 4SE +/- 1.15, N = 2SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.38, N = 3SE +/- 0.82, N = 3SE +/- 0.15, N = 38.9913.1222.279.0412.7123.1930.9131.441. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q70)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q70)11050100500816243240SE +/- 0.01, N = 3SE +/- 0.14, N = 4SE +/- 0.35, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.53, N = 3SE +/- 0.83, N = 3SE +/- 1.37, N = 310.2913.4423.7610.3513.7122.9535.1535.881. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q69)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q69)11050500100612182430SE +/- 0.18, N = 4SE +/- 0.02, N = 3SE +/- 0.21, N = 2SE +/- 0.42, N = 3SE +/- 0.33, N = 3SE +/- 0.28, N = 3SE +/- 0.17, N = 4SE +/- 0.29, N = 310.9513.9720.1726.0826.7611.0713.8220.281. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q68)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q68)11050500100714212835SE +/- 0.09, N = 3SE +/- 0.14, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.27, N = 3SE +/- 0.47, N = 3SE +/- 0.26, N = 3SE +/- 0.84, N = 38.4612.5121.688.5312.8122.6030.4831.311. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q67)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q67)1105010050100150200250SE +/- 0.13, N = 4SE +/- 0.11, N = 3SE +/- 0.51, N = 3SE +/- 1.23, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 4SE +/- 0.63, N = 312.0832.61106.30205.5612.3133.19106.611. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q66)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q66)11050500100714212835SE +/- 0.08, N = 3SE +/- 0.18, N = 4SE +/- 0.17, N = 2SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.24, N = 3SE +/- 0.43, N = 3SE +/- 0.44, N = 311.2714.0320.0711.2713.7520.6227.0827.681. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q65)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q65)110501001632486480SE +/- 0.02, N = 3SE +/- 0.84, N = 4SE +/- 0.84, N = 3SE +/- 0.06, N = 4SE +/- 0.21, N = 3SE +/- 0.48, N = 3SE +/- 1.31, N = 310.1018.6442.4210.2718.1242.6973.381. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q64)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q64)110100504080120160200SE +/- 0.18, N = 3SE +/- 0.32, N = 4SE +/- 1.53, N = 3SE +/- 0.19, N = 4SE +/- 0.51, N = 3SE +/- 2.48, N = 3SE +/- 3.02, N = 317.1551.48170.8517.1950.33151.38165.961. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q63)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q63)11050500100510152025SE +/- 0.05, N = 3SE +/- 0.13, N = 4SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 2SE +/- 0.31, N = 3SE +/- 0.33, N = 37.799.5515.017.889.8314.7319.8619.931. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q62)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q62)1105050010048121620SE +/- 0.10, N = 4SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 37.639.1912.977.838.9812.6115.6115.661. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q61)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q61)11010050500246810SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.39, N = 26.497.037.517.657.716.547.107.701. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q60)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q60)11050100500714212835SE +/- 0.10, N = 3SE +/- 0.51, N = 3SE +/- 0.21, N = 3SE +/- 0.71, N = 3SE +/- 0.70, N = 3SE +/- 0.04, N = 3SE +/- 0.34, N = 4SE +/- 0.32, N = 310.1914.3222.5730.6931.1710.2514.2123.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q59)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q59)11050500100816243240SE +/- 0.15, N = 2SE +/- 0.10, N = 4SE +/- 0.13, N = 3SE +/- 0.04, N = 4SE +/- 0.23, N = 2SE +/- 0.53, N = 3SE +/- 1.04, N = 3SE +/- 0.85, N = 39.0913.1024.119.1112.5125.2436.0636.211. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q58)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q58)11050500100816243240SE +/- 0.05, N = 2SE +/- 0.34, N = 3SE +/- 0.28, N = 3SE +/- 1.31, N = 3SE +/- 0.53, N = 3SE +/- 0.04, N = 2SE +/- 0.09, N = 4SE +/- 0.54, N = 39.9214.7424.2034.2135.6110.1713.8424.381. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q57)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q57)11050500100714212835SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.60, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.61, N = 3SE +/- 0.74, N = 310.6416.4824.4410.7616.3824.7831.6331.671. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q56)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q56)11050100500714212835SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.24, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 4SE +/- 0.09, N = 39.8712.8021.1027.5928.059.8813.0220.671. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q55)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q55)1105050010048121620SE +/- 0.06, N = 4SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.34, N = 3SE +/- 0.36, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.23, N = 36.578.7013.6017.9518.226.808.6313.931. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q54)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q54)11010050050918273645SE +/- 0.10, N = 4SE +/- 0.42, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 2SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 310.8917.0733.8333.9936.9611.1616.9737.771. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q53)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q53)11050500100510152025SE +/- 0.13, N = 3SE +/- 0.08, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.11, N = 3SE +/- 0.25, N = 3SE +/- 0.11, N = 3SE +/- 0.21, N = 37.889.7515.367.909.4614.9419.9620.061. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q52)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q52)11050100500510152025SE +/- 0.02, N = 4SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 4SE +/- 0.36, N = 36.738.6513.2218.8719.146.788.7613.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q51)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q51)1105010020406080100SE +/- 0.19, N = 4SE +/- 0.17, N = 2SE +/- 0.65, N = 3SE +/- 1.20, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 4SE +/- 0.66, N = 313.2226.2858.63101.7213.3026.3259.461. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q50)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q50)1105010020406080100SE +/- 0.02, N = 3SE +/- 0.25, N = 4SE +/- 0.37, N = 3SE +/- 0.14, N = 4SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.82, N = 38.5622.0050.088.7521.9049.3681.061. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q49)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q49)110501001020304050SE +/- 0.08, N = 4SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 2SE +/- 0.11, N = 4SE +/- 0.37, N = 310.7719.5139.3444.0011.1418.9340.271. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q48)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q48)11050100500612182430SE +/- 0.07, N = 4SE +/- 0.09, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 4SE +/- 0.24, N = 37.6510.0016.6723.0023.137.8910.4916.971. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q47)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q47)110505001001122334455SE +/- 0.16, N = 4SE +/- 0.08, N = 3SE +/- 0.40, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 4SE +/- 0.22, N = 312.4319.0833.7349.4450.0512.5919.1033.341. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q46)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q46)11050500100714212835SE +/- 0.11, N = 3SE +/- 0.16, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.26, N = 38.6712.6622.298.6912.4721.8729.8730.041. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q45)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q45)1105010050048121620SE +/- 0.01, N = 3SE +/- 0.13, N = 4SE +/- 0.13, N = 3SE +/- 0.03, N = 4SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 37.539.7613.157.609.8413.4616.8616.901. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q44)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q44)10501500100612182430SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 4SE +/- 0.23, N = 3SE +/- 0.66, N = 3SE +/- 0.04, N = 4SE +/- 0.06, N = 3SE +/- 0.13, N = 36.407.848.6125.0325.226.547.748.641. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q43)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q43)11050100500510152025SE +/- 0.09, N = 4SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.17, N = 2SE +/- 0.32, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 4SE +/- 0.34, N = 37.158.4213.7718.7119.237.248.5514.171. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q42)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q42)1105050010048121620SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.30, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.25, N = 3SE +/- 0.15, N = 36.708.6913.566.728.4413.2517.6117.721. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q41)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q41)11050100500246810SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 36.227.097.287.297.326.237.177.371. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q40)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q40)110100501020304050SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 2SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 38.0017.3824.0841.438.0717.6842.821. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q39)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q39)11050100500612182430SE +/- 0.12, N = 4SE +/- 0.20, N = 3SE +/- 0.36, N = 3SE +/- 1.30, N = 3SE +/- 0.37, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 4SE +/- 0.36, N = 33.7210.7515.1922.7724.993.7610.4215.191. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q38)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q38)110501005001530456075SE +/- 0.05, N = 4SE +/- 0.11, N = 3SE +/- 0.89, N = 3SE +/- 0.66, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 4SE +/- 0.66, N = 310.0817.4143.4867.3868.0810.1817.6943.191. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q37)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q37)11010050050510152025SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.24, N = 3SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.27, N = 4SE +/- 0.18, N = 35.0913.3620.9921.4022.745.2213.8222.761. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q36)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q36)11050500100714212835SE +/- 0.12, N = 3SE +/- 0.63, N = 3SE +/- 0.63, N = 3SE +/- 0.57, N = 3SE +/- 0.49, N = 3SE +/- 0.06, N = 2SE +/- 0.13, N = 4SE +/- 0.71, N = 38.8312.4822.3930.7331.049.2511.9222.141. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q35)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q35)11050500100816243240SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.27, N = 3SE +/- 0.08, N = 4SE +/- 0.93, N = 3SE +/- 0.22, N = 3SE +/- 0.28, N = 3SE +/- 0.17, N = 311.2215.9125.6011.4816.5725.0736.5036.601. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q34)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q34)11050500100612182430SE +/- 0.02, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 2SE +/- 0.46, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 38.4111.9117.688.6112.0417.9122.8123.951. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q33)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q33)11050500100714212835SE +/- 0.09, N = 4SE +/- 0.26, N = 3SE +/- 0.37, N = 3SE +/- 0.12, N = 3SE +/- 0.45, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 4SE +/- 0.40, N = 310.0413.6022.0029.0429.1710.2014.1022.311. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q32)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q32)11050500100510152025SE +/- 0.07, N = 3SE +/- 0.25, N = 4SE +/- 0.17, N = 3SE +/- 0.04, N = 4SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.33, N = 3SE +/- 0.17, N = 37.689.7414.407.709.3815.2922.5922.651. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q31)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q31)110505001001224364860SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 4SE +/- 0.63, N = 3SE +/- 0.41, N = 3SE +/- 0.67, N = 3SE +/- 0.70, N = 312.0818.6435.8012.2919.3333.5249.0051.491. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q30)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q30)11050500100510152025SE +/- 0.05, N = 3SE +/- 0.06, N = 4SE +/- 0.32, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.28, N = 39.0011.9115.989.2611.9016.0418.8919.511. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q29)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q29)11010050306090120150SE +/- 0.04, N = 4SE +/- 0.40, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.41, N = 4SE +/- 1.14, N = 311.1934.6947.47117.3411.6335.87118.411. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q28)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q28)110505001001530456075SE +/- 0.12, N = 3SE +/- 0.51, N = 3SE +/- 0.66, N = 3SE +/- 0.64, N = 3SE +/- 2.08, N = 3SE +/- 0.21, N = 3SE +/- 0.21, N = 4SE +/- 0.48, N = 311.0217.5441.6267.0468.1711.1417.4642.771. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q27)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q27)11050100500714212835SE +/- 0.05, N = 4SE +/- 0.27, N = 2SE +/- 0.39, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 3SE +/- 0.14, N = 3SE +/- 0.20, N = 4SE +/- 0.47, N = 38.9913.4320.6928.4629.869.1212.9222.101. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q26)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q26)11050100500510152025SE +/- 0.14, N = 4SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.61, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 4SE +/- 0.12, N = 37.8810.4816.2320.4420.597.8910.3216.021. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q25)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q25)11050010050306090120150SE +/- 0.12, N = 3SE +/- 0.27, N = 4SE +/- 1.06, N = 3SE +/- 0.11, N = 4SE +/- 0.79, N = 3SE +/- 0.28, N = 3SE +/- 0.33, N = 3SE +/- 0.72, N = 311.2135.36112.6511.2735.4741.3041.97109.511. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q24)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q24)110100501326395265SE +/- 0.05, N = 4SE +/- 0.64, N = 3SE +/- 0.74, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 4SE +/- 0.49, N = 32.6816.7939.9956.782.7217.4657.151. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q23)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q23)1105010050100150200250SE +/- 0.23, N = 4SE +/- 0.46, N = 3SE +/- 1.31, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.43, N = 4SE +/- 1.35, N = 38.0733.70173.15223.128.0833.00178.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q22)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q22)110501005001428425670SE +/- 0.18, N = 4SE +/- 0.14, N = 3SE +/- 0.38, N = 3SE +/- 0.29, N = 3SE +/- 0.40, N = 3SE +/- 0.05, N = 3SE +/- 0.40, N = 4SE +/- 0.54, N = 310.4226.9436.6660.7561.5010.7526.5736.121. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q21)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q21)11050100500510152025SE +/- 0.08, N = 4SE +/- 0.17, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 4SE +/- 0.26, N = 37.9112.1015.8320.5721.027.9912.5415.801. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q20)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q20)110505001001.1972.3943.5914.7885.985SE +/- 0.02, N = 4SE +/- 0.05, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 34.945.055.225.275.324.975.095.211. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q19)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q19)11050100500612182430SE +/- 0.05, N = 4SE +/- 0.22, N = 3SE +/- 0.37, N = 3SE +/- 0.67, N = 3SE +/- 0.52, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.18, N = 38.0211.1517.8925.5725.808.1711.8118.231. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q18)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q18)11050500100714212835SE +/- 0.08, N = 4SE +/- 0.21, N = 3SE +/- 0.21, N = 3SE +/- 0.23, N = 3SE +/- 0.54, N = 3SE +/- 0.19, N = 3SE +/- 0.12, N = 4SE +/- 0.20, N = 310.5813.8121.4127.7327.8810.5913.7820.871. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q17)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q17)11010050050306090120150SE +/- 0.10, N = 3SE +/- 0.36, N = 4SE +/- 1.40, N = 3SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 0.71, N = 3SE +/- 0.43, N = 311.7235.11119.3511.9934.6842.9243.55119.311. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q15)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q15)11050500100612182430SE +/- 0.02, N = 4SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.24, N = 37.4910.3317.5926.1126.197.5710.3917.771. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q14)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q14)1105050010020406080100SE +/- 0.33, N = 3SE +/- 0.35, N = 4SE +/- 0.35, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 3SE +/- 2.04, N = 3SE +/- 1.32, N = 3SE +/- 2.66, N = 39.0122.7675.669.0322.1977.16100.36101.621. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q13)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q13)11050100500714212835SE +/- 0.16, N = 3SE +/- 0.16, N = 4SE +/- 0.11, N = 3SE +/- 0.11, N = 4SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.50, N = 3SE +/- 0.38, N = 28.2611.8019.788.4011.4319.4528.1928.721. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q12)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q12)110501005001.18582.37163.55744.74325.929SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 2SE +/- 0.02, N = 3SE +/- 0.04, N = 4SE +/- 0.08, N = 34.905.145.215.225.234.955.145.271. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q11)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q11)11050100306090120150SE +/- 0.05, N = 4SE +/- 0.37, N = 3SE +/- 0.53, N = 3SE +/- 0.56, N = 3SE +/- 0.10, N = 3SE +/- 0.27, N = 4SE +/- 0.28, N = 312.7035.90101.84121.6512.7535.77103.281. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q10)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q10)11050100500714212835SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.37, N = 3SE +/- 0.16, N = 4SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 1.72, N = 211.4514.1420.1611.5314.3320.2427.5927.691. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q09)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q09)11050500100918273645SE +/- 0.05, N = 4SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.61, N = 2SE +/- 0.49, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 4SE +/- 0.25, N = 37.9011.8324.4639.8041.198.1912.0524.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q08)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q08)11050100500510152025SE +/- 0.12, N = 3SE +/- 0.13, N = 4SE +/- 0.44, N = 3SE +/- 0.01, N = 4SE +/- 0.14, N = 3SE +/- 0.26, N = 3SE +/- 0.28, N = 3SE +/- 0.13, N = 28.7511.8317.208.8011.8417.2722.2422.661. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q07)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q07)11050500100714212835SE +/- 0.04, N = 4SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 1.17, N = 2SE +/- 0.64, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 4SE +/- 0.48, N = 38.4612.7620.7227.8329.328.4812.5821.521. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q06)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q06)110500100501122334455SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.91, N = 3SE +/- 0.05, N = 4SE +/- 0.30, N = 3SE +/- 0.05, N = 2SE +/- 0.17, N = 3SE +/- 0.46, N = 39.1118.8149.099.3319.4023.6123.7447.671. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q05)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q05)110501001530456075SE +/- 0.11, N = 4SE +/- 0.60, N = 3SE +/- 1.08, N = 3SE +/- 0.44, N = 3SE +/- 0.19, N = 3SE +/- 0.37, N = 4SE +/- 0.56, N = 311.7923.3843.7466.7412.1123.8543.171. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q04)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q04)110501004080120160200SE +/- 0.10, N = 4SE +/- 0.31, N = 3SE +/- 0.72, N = 3SE +/- 1.16, N = 3SE +/- 0.22, N = 3SE +/- 0.36, N = 4SE +/- 0.56, N = 315.0448.88153.78192.4515.1650.14154.311. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q03)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q03)11050500100510152025SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.17, N = 3SE +/- 0.28, N = 3SE +/- 0.21, N = 2SE +/- 0.20, N = 36.758.4814.186.799.0214.1219.4819.511. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q02)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q02)11050100500714212835SE +/- 0.06, N = 4SE +/- 0.36, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.07, N = 2SE +/- 0.14, N = 3SE +/- 0.25, N = 4SE +/- 0.12, N = 39.6911.6317.5827.5527.909.7711.3217.551. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q01)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q01)11050100510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 4SE +/- 0.04, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 38.9311.2915.858.9811.2315.4120.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 50)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 50)Q98Q20Q12Q41Q61Q44Q90Q96Q91Q84Q86Q92Q62Q45Q52Q42Q83Q55Q43Q03Q32Q63Q53Q39Q01Q81Q21Q30Q26Q99Q73Q48Q08Q02Q15Q89Q34Q19Q95Q94Q13Q85Q66Q10Q69Q76Q56Q27Q07Q18Q79Q68Q46Q33Q36Q71Q60Q37Q70Q59Q09Q58Q77Q57Q35Q47Q31Q22Q88Q54Q82Q49Q40Q28Q65Q05Q38Q87Q97Q06Q50Q24Q51Q75Q14Q93Q74Q11Q67Q25Q29Q17Q78Q04Q80Q64Q23Q72100200300400500SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.39, N = 2SE +/- 0.06, N = 3SE +/- 0.37, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.30, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.23, N = 3SE +/- 0.34, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.42, N = 3SE +/- 0.32, N = 3SE +/- 0.12, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 2SE +/- 0.24, N = 3SE +/- 0.44, N = 3SE +/- 0.12, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.24, N = 3SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.28, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 2SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 3SE +/- 0.18, N = 3SE +/- 0.47, N = 3SE +/- 0.71, N = 3SE +/- 1.15, N = 2SE +/- 0.27, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.32, N = 3SE +/- 0.35, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.54, N = 3SE +/- 0.60, N = 3SE +/- 0.16, N = 3SE +/- 0.27, N = 3SE +/- 0.22, N = 3SE +/- 0.17, N = 3SE +/- 0.54, N = 3SE +/- 0.85, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 3SE +/- 0.08, N = 3SE +/- 0.84, N = 3SE +/- 0.48, N = 3SE +/- 0.58, N = 3SE +/- 0.56, N = 3SE +/- 0.66, N = 3SE +/- 0.51, N = 3SE +/- 0.27, N = 3SE +/- 0.91, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.66, N = 3SE +/- 0.38, N = 3SE +/- 0.35, N = 3SE +/- 0.71, N = 3SE +/- 1.15, N = 3SE +/- 0.28, N = 3SE +/- 0.63, N = 3SE +/- 1.06, N = 3SE +/- 1.14, N = 3SE +/- 1.40, N = 3SE +/- 0.64, N = 3SE +/- 0.56, N = 3SE +/- 2.12, N = 3SE +/- 1.53, N = 3SE +/- 1.35, N = 3SE +/- 5.27, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 2SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.27, N = 3SE +/- 0.43, N = 3SE +/- 0.10, N = 3SE +/- 0.34, N = 3SE +/- 0.04, N = 3SE +/- 0.28, N = 3SE +/- 0.12, N = 3SE +/- 0.30, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 2SE +/- 0.25, N = 3SE +/- 0.36, N = 3SE +/- 0.41, N = 3SE +/- 0.20, N = 3SE +/- 0.16, N = 3SE +/- 0.34, N = 3SE +/- 0.07, N = 3SE +/- 0.30, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.32, N = 3SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.51, N = 3SE +/- 0.37, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 2SE +/- 0.44, N = 3SE +/- 0.17, N = 3SE +/- 0.21, N = 2SE +/- 0.47, N = 2SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.24, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.63, N = 3SE +/- 0.21, N = 3SE +/- 0.47, N = 3SE +/- 0.11, N = 3SE +/- 0.53, N = 3SE +/- 0.38, N = 3SE +/- 0.28, N = 3SE +/- 0.31, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.53, N = 3SE +/- 0.41, N = 3SE +/- 0.40, N = 3SE +/- 1.14, N = 3SE +/- 0.38, N = 3SE +/- 0.12, N = 3SE +/- 0.80, N = 3SE +/- 0.10, N = 3SE +/- 0.37, N = 3SE +/- 0.66, N = 3SE +/- 0.48, N = 3SE +/- 0.89, N = 3SE +/- 0.36, N = 3SE +/- 1.08, N = 3SE +/- 0.11, N = 3SE +/- 0.46, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.65, N = 3SE +/- 1.20, N = 3SE +/- 2.04, N = 3SE +/- 2.38, N = 3SE +/- 0.64, N = 3SE +/- 0.53, N = 3SE +/- 0.51, N = 3SE +/- 0.72, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 2.63, N = 3SE +/- 0.72, N = 3SE +/- 1.43, N = 3SE +/- 3.02, N = 3SE +/- 1.31, N = 3SE +/- 11.04, N = 35.165.215.277.377.707.749.9710.9110.9211.6812.2312.3512.9713.1513.5613.5913.6313.9314.1714.1814.4015.0115.1915.3615.8015.8515.8615.9816.0216.2616.2916.9717.2017.5517.6517.6817.7718.2318.2319.0419.5919.7820.0720.1620.2820.5020.6720.8721.2421.5221.6822.1022.1422.2722.2922.3122.7623.5923.7624.1124.1324.3824.4424.6625.6033.3435.8036.1236.3037.7740.2740.3142.4242.7742.8243.1743.1944.4248.4149.0950.0857.1559.4659.6075.6685.8297.52103.28106.61112.65118.41119.35145.29154.31154.53170.85178.13445.115.215.265.277.287.657.849.8210.1810.7311.7012.3012.6113.1813.2213.2513.2613.4613.6013.7714.1214.7314.9415.1915.2915.4115.6015.8316.0416.2316.3716.6516.6717.2717.5817.5917.7017.8917.9118.1018.9619.4520.1720.2220.2420.5920.6220.6920.7221.0421.1021.4121.8722.0022.3922.5722.6022.7422.9523.1924.2024.2424.4624.7825.0725.2433.5233.7336.1436.6636.9638.4639.3441.4341.6242.6943.4843.6043.7447.0847.6749.3656.7858.6359.3777.1685.1595.45101.84106.30109.51117.34119.31145.20153.78154.37165.96173.15419.791. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 10)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 10)Q98Q20Q12Q44Q96Q61Q41Q90Q43Q42Q03Q55Q52Q62Q92Q84Q86Q32Q53Q63Q45Q91Q94Q48Q95Q99Q26Q15Q39Q83Q89Q73Q19Q01Q02Q13Q81Q09Q08Q30Q79Q34Q36Q21Q76Q46Q68Q59Q07Q71Q56Q27Q37Q70Q33Q66Q18Q69Q58Q10Q60Q85Q77Q35Q57Q82Q24Q54Q97Q88Q40Q38Q28Q87Q65Q31Q06Q49Q47Q74Q50Q14Q05Q51Q22Q75Q93Q67Q23Q17Q29Q25Q11Q78Q80Q04Q64Q72306090120150SE +/- 0.02, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 4SE +/- 0.25, N = 3SE +/- 0.07, N = 4SE +/- 0.03, N = 4SE +/- 0.03, N = 4SE +/- 0.09, N = 4SE +/- 0.14, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.25, N = 4SE +/- 0.08, N = 4SE +/- 0.13, N = 4SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 4SE +/- 0.36, N = 3SE +/- 0.27, N = 4SE +/- 0.21, N = 4SE +/- 0.31, N = 4SE +/- 0.10, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.10, N = 4SE +/- 0.14, N = 4SE +/- 0.25, N = 4SE +/- 0.17, N = 3SE +/- 0.16, N = 4SE +/- 0.21, N = 4SE +/- 0.13, N = 4SE +/- 0.14, N = 4SE +/- 0.22, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.14, N = 4SE +/- 0.21, N = 3SE +/- 0.17, N = 4SE +/- 0.32, N = 4SE +/- 0.16, N = 4SE +/- 0.20, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.21, N = 4SE +/- 0.14, N = 4SE +/- 0.12, N = 4SE +/- 0.17, N = 4SE +/- 0.27, N = 4SE +/- 0.09, N = 4SE +/- 0.18, N = 4SE +/- 0.16, N = 4SE +/- 0.12, N = 4SE +/- 0.34, N = 4SE +/- 0.03, N = 4SE +/- 0.24, N = 4SE +/- 0.12, N = 4SE +/- 0.07, N = 4SE +/- 0.07, N = 4SE +/- 0.17, N = 4SE +/- 0.22, N = 4SE +/- 0.39, N = 4SE +/- 0.21, N = 4SE +/- 0.11, N = 4SE +/- 0.72, N = 3SE +/- 0.11, N = 4SE +/- 0.28, N = 4SE +/- 0.84, N = 4SE +/- 0.26, N = 3SE +/- 0.14, N = 4SE +/- 0.11, N = 4SE +/- 0.16, N = 4SE +/- 0.13, N = 4SE +/- 0.25, N = 4SE +/- 0.35, N = 4SE +/- 0.37, N = 4SE +/- 0.18, N = 4SE +/- 0.40, N = 4SE +/- 0.26, N = 4SE +/- 0.35, N = 4SE +/- 0.43, N = 4SE +/- 0.13, N = 4SE +/- 0.36, N = 4SE +/- 0.27, N = 4SE +/- 0.27, N = 4SE +/- 0.41, N = 4SE +/- 0.31, N = 4SE +/- 0.46, N = 4SE +/- 0.36, N = 4SE +/- 0.32, N = 4SE +/- 1.21, N = 4SE +/- 0.08, N = 2SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.23, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 2SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 3SE +/- 0.46, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 2SE +/- 0.34, N = 3SE +/- 0.63, N = 3SE +/- 0.23, N = 2SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 2SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.02, N = 3SE +/- 0.51, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.15, N = 3SE +/- 0.34, N = 3SE +/- 0.16, N = 3SE +/- 0.93, N = 3SE +/- 0.19, N = 3SE +/- 0.64, N = 3SE +/- 0.42, N = 3SE +/- 0.33, N = 3SE +/- 0.26, N = 3SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.51, N = 3SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.63, N = 3SE +/- 0.30, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.58, N = 3SE +/- 0.60, N = 3SE +/- 0.17, N = 2SE +/- 0.14, N = 3SE +/- 0.38, N = 3SE +/- 0.41, N = 3SE +/- 0.11, N = 3SE +/- 0.46, N = 3SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 0.79, N = 3SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.75, N = 3SE +/- 0.31, N = 3SE +/- 0.51, N = 3SE +/- 0.40, N = 35.005.095.146.547.107.167.177.468.488.558.638.698.769.079.139.179.199.559.749.759.769.789.9310.2110.2310.3210.3910.4210.4910.7411.0111.1911.2911.3211.5411.8011.8111.8311.9111.9111.9111.9212.0512.5112.5212.5412.5812.6612.9213.0213.1013.1213.4413.7813.8213.8213.8414.0314.1014.1414.2114.8515.2515.9116.4816.9716.9916.9917.1817.4617.4617.6617.6817.6918.6418.6418.8118.9319.1019.8022.0022.7623.8526.3226.5727.1527.4933.0033.1935.1135.3635.7735.8744.1448.0850.1451.48118.285.045.055.146.406.647.037.097.528.428.448.658.708.989.019.029.159.289.389.469.839.8410.0010.0010.1210.1610.2010.3310.4810.7510.7810.7911.1511.1511.2311.4311.4611.6311.8311.8411.9011.9912.0412.1012.3012.4712.4812.5112.7112.7612.8012.8113.3613.4313.6013.7113.7513.8113.9714.3214.3314.5614.5714.7416.3816.5716.6416.7917.0717.2317.3817.4117.4817.5418.0418.1219.0819.3319.4019.5119.7421.9022.1923.3826.2826.9427.0427.0732.6133.7034.6834.6935.4735.9043.4047.1848.8850.33118.081. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 500)

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 500)Q20Q12Q41Q61Q90Q84Q86Q62Q92Q45Q42Q55Q30Q52Q43Q03Q63Q53Q26Q21Q73Q37Q32Q08Q34Q48Q89Q06Q85Q39Q44Q19Q82Q69Q15Q66Q10Q18Q07Q02Q56Q76Q13Q33Q27Q46Q79Q68Q36Q71Q60Q57Q54Q58Q70Q59Q35Q09Q25Q17Q31Q47Q88Q22Q28Q38Q87Q1420406080100SE +/- 0.02, N = 2SE +/- 0.09, N = 2SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.44, N = 3SE +/- 0.37, N = 3SE +/- 0.25, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.21, N = 2SE +/- 0.31, N = 3SE +/- 0.11, N = 3SE +/- 0.61, N = 3SE +/- 0.28, N = 3SE +/- 0.37, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.13, N = 2SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.42, N = 3SE +/- 0.05, N = 2SE +/- 0.20, N = 3SE +/- 0.37, N = 3SE +/- 0.23, N = 3SE +/- 0.52, N = 3SE +/- 0.43, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.43, N = 3SE +/- 1.72, N = 2SE +/- 0.23, N = 3SE +/- 1.17, N = 2SE +/- 0.07, N = 2SE +/- 0.14, N = 3SE +/- 0.72, N = 3SE +/- 0.38, N = 2SE +/- 0.12, N = 3SE +/- 0.46, N = 3SE +/- 0.29, N = 3SE +/- 0.49, N = 3SE +/- 0.26, N = 3SE +/- 0.57, N = 3SE +/- 0.82, N = 3SE +/- 0.70, N = 3SE +/- 0.61, N = 3SE +/- 0.13, N = 2SE +/- 1.31, N = 3SE +/- 1.37, N = 3SE +/- 1.04, N = 3SE +/- 0.28, N = 3SE +/- 0.61, N = 2SE +/- 0.28, N = 3SE +/- 0.71, N = 3SE +/- 0.67, N = 3SE +/- 0.43, N = 3SE +/- 0.43, N = 3SE +/- 0.40, N = 3SE +/- 0.64, N = 3SE +/- 0.18, N = 3SE +/- 0.70, N = 3SE +/- 1.32, N = 35.225.237.327.7112.1013.5515.4015.6116.0416.9017.6117.9518.8919.1419.2319.4819.8619.9620.5921.0221.3021.4022.5922.6622.8123.1323.4623.6124.6024.9925.0325.8026.0226.0826.1127.0827.6927.7327.8327.9028.0528.5928.7229.0429.8629.8730.2730.4830.7330.9131.1731.6333.9934.2135.8836.0636.5039.8041.3043.5549.0049.4453.7061.5067.0468.0868.19100.361. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 1)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 1)Q24Q39Q98Q12Q20Q37Q96Q94Q41Q16Q61Q55Q90Q42Q52Q03Q84Q43Q95Q15Q45Q92Q99Q62Q48Q32Q93Q63Q53Q26Q09Q21Q40Q19Q86Q23Q91Q13Q73Q34Q79Q68Q07Q50Q44Q46Q89Q08Q81Q76Q36Q82Q01Q71Q27Q30Q14Q59Q06Q83Q02Q97Q56Q58Q33Q87Q38Q65Q60Q70Q22Q18Q57Q49Q54Q69Q28Q29Q25Q35Q77Q66Q88Q10Q74Q17Q05Q85Q67Q31Q47Q11Q51Q80Q78Q75Q04Q64Q72510152025SE +/- 0.05, N = 4SE +/- 0.12, N = 4SE +/- 0.02, N = 4SE +/- 0.02, N = 4SE +/- 0.02, N = 4SE +/- 0.09, N = 3SE +/- 0.03, N = 4SE +/- 0.03, N = 4SE +/- 0.05, N = 4SE +/- 0.10, N = 4SE +/- 0.01, N = 3SE +/- 0.06, N = 4SE +/- 0.06, N = 4SE +/- 0.03, N = 4SE +/- 0.02, N = 4SE +/- 0.07, N = 4SE +/- 0.09, N = 4SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.03, N = 4SE +/- 0.02, N = 2SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 3SE +/- 0.08, N = 4SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.14, N = 4SE +/- 0.07, N = 4SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.23, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.07, N = 4SE +/- 0.03, N = 4SE +/- 0.13, N = 2SE +/- 0.06, N = 3SE +/- 0.14, N = 4SE +/- 0.10, N = 4SE +/- 0.01, N = 4SE +/- 0.10, N = 4SE +/- 0.12, N = 3SE +/- 0.07, N = 4SE +/- 0.08, N = 3SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.04, N = 4SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.05, N = 2SE +/- 0.09, N = 4SE +/- 0.05, N = 4SE +/- 0.05, N = 4SE +/- 0.10, N = 3SE +/- 0.06, N = 4SE +/- 0.15, N = 3SE +/- 0.18, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.10, N = 4SE +/- 0.18, N = 4SE +/- 0.12, N = 3SE +/- 0.04, N = 4SE +/- 0.13, N = 3SE +/- 0.11, N = 4SE +/- 0.12, N = 3SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.16, N = 4SE +/- 0.11, N = 4SE +/- 0.19, N = 3SE +/- 0.05, N = 4SE +/- 0.12, N = 4SE +/- 0.13, N = 4SE +/- 0.14, N = 4SE +/- 0.16, N = 4SE +/- 0.05, N = 4SE +/- 0.19, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.07, N = 4SE +/- 0.10, N = 4SE +/- 0.19, N = 4SE +/- 0.25, N = 4SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 2SE +/- 0.05, N = 3SE +/- 0.22, N = 2SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 2SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 2SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 2SE +/- 0.10, N = 2SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.33, N = 3SE +/- 0.15, N = 2SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 2SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 2SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 2SE +/- 0.21, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 2SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 32.683.724.854.904.945.095.736.096.226.296.496.576.636.726.736.797.157.267.307.497.607.627.657.707.757.797.837.887.887.907.907.918.008.028.048.078.198.318.408.448.468.538.618.618.698.758.788.808.818.838.868.878.988.999.039.049.119.249.269.339.699.839.879.9210.0410.0710.0810.1910.2710.3510.4210.5810.7610.7710.8910.9511.0211.1911.2711.2711.3911.3911.4811.5311.7911.8611.9511.9912.0812.2912.4312.7013.2213.5214.2614.3315.0417.1919.112.723.764.874.954.975.225.756.116.236.316.546.706.756.766.786.807.137.247.467.537.577.587.637.687.717.797.837.887.897.897.998.078.088.138.178.198.268.308.328.418.468.488.518.568.648.678.708.758.768.828.888.938.999.009.019.099.119.129.219.259.719.779.8810.0910.1010.1710.1810.2010.2510.2910.5910.6410.7511.0711.1411.1411.1611.2111.2211.2411.2711.4511.6311.7211.7211.8312.0012.0812.1112.3112.5912.7513.3013.4514.0314.4315.1617.1519.611. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q16)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q16)1246810SE +/- 0.10, N = 4SE +/- 0.16, N = 36.296.311. (CC) gcc options: -O3 -fcommon -lm

Timed Linux Kernel Compilation

Build Comparison

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build Comparisondefconfigallmodconfig2K4K6K8K10KSE +/- 2.04, N = 3SE +/- 2.80, N = 3SE +/- 5.72, N = 3SE +/- 1.83, N = 3SE +/- 1.28, N = 3SE +/- 1.62, N = 3SE +/- 1.10, N = 3SE +/- 4.42, N = 3SE +/- 9.15, N = 3SE +/- 14.83, N = 31131.975371.021138.205375.951160.505536.031199.615759.511904.559463.57

Timed Node.js Compilation

Comparison

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1ComparisonTime To Compile7001400210028003500SE +/- 1.20, N = 3SE +/- 0.29, N = 3SE +/- 3.73, N = 3SE +/- 2.91, N = 33261.913283.243289.073378.82

Timed GCC Compilation

Comparison

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2ComparisonTime To Compile9001800270036004500SE +/- 12.28, N = 34406.83

Timed LLVM Compilation

Build System Comparison

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System ComparisonNinjaUnix Makefiles8001600240032004000SE +/- 1.23, N = 3SE +/- 2.47, N = 3SE +/- 3.31, N = 3SE +/- 6.63, N = 3SE +/- 1.73, N = 3SE +/- 3.39, N = 3SE +/- 5.47, N = 3SE +/- 5.63, N = 33468.303511.133480.733524.743524.423577.043662.543722.37

Timed Gem5 Compilation

Comparison

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1ComparisonTime To Compile5001000150020002500SE +/- 0.96, N = 3SE +/- 2.55, N = 3SE +/- 0.90, N = 3SE +/- 3.08, N = 32220.182222.422257.242329.03

Apache CouchDB

Bulk Size Comparison (Inserts: 3000 - Rounds: 30)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 3000 - Rounds: 30)1003005005001000150020002500SE +/- 1.88, N = 3SE +/- 31.00, N = 9SE +/- 11.33, N = 3SE +/- 0.84, N = 3SE +/- 2.19, N = 3SE +/- 1.95, N = 3SE +/- 10.18, N = 3SE +/- 2.59, N = 3SE +/- 13.77, N = 3SE +/- 1.11, N = 3SE +/- 14.88, N = 5SE +/- 0.87, N = 3855.611492.532083.07860.531314.732158.52871.541444.002140.74887.891412.822261.831. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 300 - - Rounds: 30)

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 300 - - Rounds: 30)1000300030060090012001500SE +/- 3.79, N = 3SE +/- 2.19, N = 3SE +/- 2.78, N = 3SE +/- 14.88, N = 5SE +/- 1.83, N = 3SE +/- 31.00, N = 9SE +/- 0.91, N = 3SE +/- 2.59, N = 3366.671314.73377.971412.82384.071492.53394.741444.001. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 300 - Inserts: 3000)

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 3000)3030060090012001500SE +/- 2.19, N = 3SE +/- 14.88, N = 5SE +/- 2.59, N = 3SE +/- 31.00, N = 91314.731412.821444.001492.531. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 500 - - Rounds: 30)

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 500 - - Rounds: 30)100030005001000150020002500SE +/- 0.51, N = 3SE +/- 1.95, N = 3SE +/- 0.74, N = 3SE +/- 0.87, N = 3SE +/- 3.77, N = 3SE +/- 11.33, N = 3SE +/- 2.58, N = 3SE +/- 13.77, N = 3438.302158.52464.692261.83676.092083.07679.402140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 500 - Inserts: 3000)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 3000)305001000150020002500SE +/- 11.33, N = 3SE +/- 13.77, N = 3SE +/- 1.95, N = 3SE +/- 0.87, N = 32083.072140.742158.522261.831. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 100 - - Rounds: 30)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 100 - - Rounds: 30)100030002004006008001000SE +/- 2.31, N = 3SE +/- 0.84, N = 3SE +/- 2.59, N = 6SE +/- 10.18, N = 3SE +/- 3.82, N = 9SE +/- 1.11, N = 3SE +/- 2.80, N = 9SE +/- 1.88, N = 3247.76860.53258.52871.54262.44887.89266.25855.611. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 100 - Inserts: 3000)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 3000)302004006008001000SE +/- 1.88, N = 3SE +/- 0.84, N = 3SE +/- 10.18, N = 3SE +/- 1.11, N = 3855.61860.53871.54887.891. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Bulk Size Comparison (Inserts: 1000 - Rounds: 30)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 1000 - Rounds: 30)100300500150300450600750SE +/- 2.31, N = 3SE +/- 3.79, N = 3SE +/- 0.51, N = 3SE +/- 2.59, N = 6SE +/- 0.91, N = 3SE +/- 2.58, N = 3SE +/- 3.82, N = 9SE +/- 2.78, N = 3SE +/- 0.74, N = 3SE +/- 2.80, N = 9SE +/- 1.83, N = 3SE +/- 3.77, N = 3247.76366.67438.30258.52394.74679.40262.44377.97464.69266.25384.07676.091. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 100 - Inserts: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 1000)3060120180240300SE +/- 2.31, N = 3SE +/- 2.59, N = 6SE +/- 3.82, N = 9SE +/- 2.80, N = 9247.76258.52262.44266.251. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 500 - Inserts: 1000)

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 1000)30150300450600750SE +/- 0.51, N = 3SE +/- 0.74, N = 3SE +/- 3.77, N = 3SE +/- 2.58, N = 3438.30464.69676.09679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 300 - Inserts: 1000)

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 1000)3090180270360450SE +/- 3.79, N = 3SE +/- 2.78, N = 3SE +/- 1.83, N = 3SE +/- 0.91, N = 3366.67377.97384.07394.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Timed Godot Game Engine Compilation

Comparison

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0ComparisonTime To Compile8001600240032004000SE +/- 4.83, N = 3SE +/- 6.78, N = 3SE +/- 4.62, N = 3SE +/- 7.67, N = 3SE +/- 3.05, N = 31835.921844.361852.591922.643498.30

Apache Spark

Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.07, N = 5SE +/- 0.21, N = 3SE +/- 0.55, N = 3SE +/- 0.60, N = 3SE +/- 0.08, N = 3SE +/- 0.62, N = 3SE +/- 0.59, N = 3SE +/- 0.10, N = 3SE +/- 0.71, N = 3SE +/- 0.43, N = 3SE +/- 2.32, N = 3SE +/- 0.09, N = 4SE +/- 0.25, N = 3SE +/- 0.19, N = 35.4542.8574.60150.055.5043.1973.605.6944.2679.21159.015.7247.1082.03

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)500100020001004080120160200SE +/- 0.76, N = 3SE +/- 1.46, N = 3SE +/- 0.50, N = 3SE +/- 0.60, N = 3SE +/- 0.85, N = 3SE +/- 1.89, N = 3SE +/- 0.25, N = 3SE +/- 2.32, N = 3147.55147.55148.66150.05157.08157.25158.24159.01

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 100)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 100)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.38, N = 3SE +/- 0.58, N = 3SE +/- 0.87, N = 3SE +/- 0.10, N = 3SE +/- 3.33, N = 3SE +/- 0.42, N = 3SE +/- 0.60, N = 3SE +/- 1.45, N = 3SE +/- 0.82, N = 3SE +/- 0.68, N = 3SE +/- 0.23, N = 3SE +/- 2.29, N = 3SE +/- 1.31, N = 3SE +/- 1.75, N = 3SE +/- 2.32, N = 3SE +/- 0.84, N = 3SE +/- 1.80, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 8.88, N = 331.57177.81579.9831.7988.01131.38150.05152.87178.89581.1932.0887.32137.28157.88159.01190.03694.6233.63195.45724.99

Apache Spark

Row Count Comparison (Partitions: 100 - Inner Join Test Time)

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.044993077, N = 5SE +/- 1.372283254, N = 3SE +/- 0.475686548, N = 3SE +/- 1.445788055, N = 3SE +/- 0.004165140, N = 3SE +/- 0.120293064, N = 3SE +/- 0.323667212, N = 3SE +/- 1.752337079, N = 3SE +/- 0.294062371, N = 3SE +/- 1.642152192, N = 3SE +/- 1.129567495, N = 3SE +/- 0.134671456, N = 4SE +/- 0.257232291, N = 3SE +/- 0.574015178, N = 36.04000000043.71000000076.870000000152.8725572196.25000000043.58000000080.900000000157.8800000006.54000000043.88000000075.6800000006.59000000047.52000000083.980000000

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)100020005001004080120160200SE +/- 1.83, N = 3SE +/- 1.01, N = 3SE +/- 1.02, N = 3SE +/- 1.45, N = 3SE +/- 1.75, N = 3SE +/- 0.39, N = 3SE +/- 1.46, N = 3SE +/- 1.92, N = 3151.54151.60152.21152.87157.88158.11159.12162.01

Apache Spark

Row Count Comparison (Partitions: 100 - Repartition Test Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.07, N = 3SE +/- 0.76, N = 3SE +/- 2.01, N = 3SE +/- 0.03, N = 5SE +/- 0.43, N = 3SE +/- 0.15, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 1.31, N = 3SE +/- 0.03, N = 4SE +/- 0.56, N = 3SE +/- 0.55, N = 38.6238.5872.358.7537.0768.12131.388.7938.2971.59137.289.0841.2874.32

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)10020001000500306090120150SE +/- 0.42, N = 3SE +/- 0.77, N = 3SE +/- 0.93, N = 3SE +/- 0.84, N = 3SE +/- 1.31, N = 3SE +/- 0.91, N = 3SE +/- 0.58, N = 3SE +/- 0.83, N = 3131.38131.39131.43131.53137.28137.45138.04138.87

Apache Spark

Row Count Comparison (Partitions: 100 - Group By Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.13, N = 3SE +/- 3.06, N = 3SE +/- 0.73, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 2.29, N = 3SE +/- 0.02, N = 4SE +/- 0.30, N = 3SE +/- 0.45, N = 3SE +/- 0.08, N = 5SE +/- 0.24, N = 3SE +/- 0.47, N = 3SE +/- 3.33, N = 38.7526.6234.668.8123.5035.5187.329.0725.0537.119.0923.9034.4188.01

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Group By Test Time)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Group By Test Time)1000200050010020406080100SE +/- 0.85, N = 3SE +/- 3.36, N = 3SE +/- 1.17, N = 3SE +/- 3.33, N = 3SE +/- 4.77, N = 3SE +/- 2.29, N = 3SE +/- 2.33, N = 3SE +/- 4.05, N = 379.6081.6182.3588.0183.8787.3288.0289.23

Apache Spark

Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.06, N = 4SE +/- 1.25, N = 3SE +/- 0.83, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 1.46, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.51, N = 36.9040.9075.966.9941.9880.64158.247.0539.2276.66147.557.2943.4784.01

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 1000)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 1000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.16, N = 3SE +/- 0.77, N = 3SE +/- 0.56, N = 3SE +/- 0.10, N = 3SE +/- 0.85, N = 3SE +/- 0.93, N = 3SE +/- 1.46, N = 3SE +/- 1.83, N = 3SE +/- 0.48, N = 3SE +/- 1.66, N = 3SE +/- 0.16, N = 3SE +/- 2.33, N = 3SE +/- 0.83, N = 3SE +/- 0.25, N = 3SE +/- 1.92, N = 3SE +/- 0.13, N = 3SE +/- 6.51, N = 3SE +/- 0.22, N = 3SE +/- 0.54, N = 3SE +/- 14.94, N = 331.54172.45581.6931.6179.60131.43147.55151.54172.19581.6032.4088.02138.87158.24162.01183.35697.9033.51189.73721.00

Apache Spark

Row Count Comparison (Partitions: 1000 - Inner Join Test Time)

rk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.108422107, N = 3SE +/- 0.211182878, N = 3SE +/- 0.524371080, N = 3SE +/- 1.834767926, N = 3SE +/- 0.035374915, N = 3SE +/- 0.136942862, N = 3SE +/- 0.420756743, N = 3SE +/- 1.923212084, N = 3SE +/- 0.105150363, N = 3SE +/- 0.399790551, N = 3SE +/- 0.315382741, N = 3SE +/- 0.633875719, N = 4SE +/- 0.557375853, N = 3SE +/- 0.855084002, N = 37.81000000041.49000000079.290000000151.5438619978.01000000044.00000000081.350000000162.0100000008.33000000045.60000000085.1200000008.63000000043.30000000078.420000000

Apache Spark

Row Count Comparison (Partitions: 1000 - Repartition Test Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.07, N = 4SE +/- 0.54, N = 3SE +/- 1.03, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.93, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.83, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 39.7439.3172.989.9536.7268.54131.4310.0538.6171.70138.8710.0639.9675.18

Apache Spark

Row Count Comparison (Partitions: 1000 - Group By Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.08, N = 4SE +/- 0.36, N = 3SE +/- 2.03, N = 3SE +/- 0.02, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 2.33, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.85, N = 3SE +/- 0.03, N = 3SE +/- 0.35, N = 3SE +/- 0.79, N = 310.9322.4435.8311.1022.2935.2788.0211.1822.6234.7079.6011.3923.8937.31

Apache Spark

Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.01, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 1.89, N = 3SE +/- 0.13, N = 9SE +/- 0.24, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.89, N = 3SE +/- 0.50, N = 3SE +/- 0.18, N = 3SE +/- 0.27, N = 3SE +/- 0.57, N = 38.0442.9081.25157.258.3740.938.4141.1677.56148.668.5844.5983.94

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 2000)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 2000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.14, N = 3SE +/- 3.36, N = 3SE +/- 0.77, N = 3SE +/- 0.50, N = 3SE +/- 1.01, N = 3SE +/- 0.47, N = 3SE +/- 1.28, N = 3SE +/- 0.10, N = 3SE +/- 0.42, N = 3SE +/- 0.49, N = 3SE +/- 0.31, N = 3SE +/- 4.77, N = 3SE +/- 0.91, N = 3SE +/- 1.89, N = 3SE +/- 1.46, N = 3SE +/- 0.21, N = 3SE +/- 8.50, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 16.56, N = 331.3281.61131.39148.66151.60175.24579.5531.65175.84580.8632.2083.87137.45157.25159.12185.51695.1733.79192.81710.71

Apache Spark

Row Count Comparison (Partitions: 2000 - Inner Join Test Time)

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.31, N = 3SE +/- 1.46, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.40, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 1.01, N = 3SE +/- 0.50, N = 9SE +/- 1.45, N = 310.6845.7483.64159.1210.6947.6786.4310.8944.2380.41151.6011.0647.61

Apache Spark

Row Count Comparison (Partitions: 2000 - Repartition Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.04, N = 9SE +/- 0.66, N = 3SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 3SE +/- 0.91, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.77, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 310.5739.3310.7139.2272.28137.4510.8537.9469.09131.3911.0140.5075.44

Apache Spark

Row Count Comparison (Partitions: 2000 - Group By Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.13, N = 9SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.46, N = 3SE +/- 4.77, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 3SE +/- 0.39, N = 3SE +/- 0.41, N = 3SE +/- 3.36, N = 312.8324.1012.8624.0936.7283.8713.0224.8537.3513.3124.1337.1681.61

Apache Spark

Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.063047733, N = 3SE +/- 0.416062930, N = 3SE +/- 0.043071403, N = 3SE +/- 0.103211248, N = 3SE +/- 0.236232308, N = 3SE +/- 0.489603948, N = 3SE +/- 0.852271154, N = 3SE +/- 0.486110869, N = 3SE +/- 0.448087864, N = 3SE +/- 0.730826056, N = 3SE +/- 0.764058299, N = 3SE +/- 0.094366471, N = 3SE +/- 0.236866720, N = 3SE +/- 0.300364443, N = 36.12000000039.16000000075.2300000006.29000000040.95000000080.770000000157.0800000006.51000000038.35000000076.270000000147.5485311946.62000000042.68000000083.530000000

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 500)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 500)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.11, N = 3SE +/- 0.48, N = 3SE +/- 0.86, N = 3SE +/- 0.09, N = 3SE +/- 1.17, N = 3SE +/- 0.84, N = 3SE +/- 0.76, N = 3SE +/- 1.02, N = 3SE +/- 1.56, N = 3SE +/- 0.55, N = 3SE +/- 0.36, N = 3SE +/- 4.05, N = 3SE +/- 0.58, N = 3SE +/- 0.85, N = 3SE +/- 0.39, N = 3SE +/- 0.55, N = 3SE +/- 4.60, N = 3SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 6.99, N = 331.51172.06580.3031.7182.35131.53147.55152.21172.69579.0131.9689.23138.04157.08158.11183.20690.6233.77189.39728.26

Apache Spark

Row Count Comparison (Partitions: 500 - Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.103943425, N = 3SE +/- 0.391685283, N = 3SE +/- 0.747944666, N = 3SE +/- 0.391834664, N = 3SE +/- 0.043852959, N = 3SE +/- 0.324188438, N = 3SE +/- 0.097366593, N = 3SE +/- 1.021947894, N = 3SE +/- 0.056766652, N = 3SE +/- 0.422261678, N = 3SE +/- 0.562607380, N = 3SE +/- 0.517942458, N = 3SE +/- 0.798930107, N = 3SE +/- 0.488163973, N = 37.01000000042.54000000080.990000000158.1100000007.03000000040.24000000077.630000000152.2074853977.26000000044.68000000083.8400000007.53000000042.43000000078.030000000

Apache Spark

Row Count Comparison (Partitions: 500 - Repartition Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.101989022, N = 3SE +/- 1.074726167, N = 3SE +/- 0.840434214, N = 3SE +/- 0.076523207, N = 3SE +/- 0.263873750, N = 3SE +/- 0.119615928, N = 3SE +/- 0.575990239, N = 3SE +/- 0.069154351, N = 3SE +/- 0.254871419, N = 3SE +/- 0.310887433, N = 3SE +/- 0.835252655, N = 3SE +/- 0.037643391, N = 3SE +/- 0.579061882, N = 3SE +/- 0.150029474, N = 39.00000000038.92000000070.9000000009.10000000038.21000000071.300000000138.0400000009.21000000036.44000000067.860000000131.5311326779.46000000040.16000000073.220000000

Apache Spark

Row Count Comparison (Partitions: 500 - Group By Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.15, N = 3SE +/- 1.78, N = 3SE +/- 4.59, N = 3SE +/- 0.19, N = 3SE +/- 0.51, N = 3SE +/- 0.72, N = 3SE +/- 4.05, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 1.17, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.10, N = 39.8423.8239.269.9522.3736.3789.2310.0322.3835.9982.3510.1323.2837.00

Apache Spark

Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)1000000040000000200000001000000816243240SE +/- 0.29, N = 3SE +/- 0.38, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 5SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.12, N = 4SE +/- 0.10, N = 331.4931.5731.8131.8431.6231.6331.7931.9732.0832.1432.2432.3533.6333.7333.7634.02

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)20005001000100816243240SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.38, N = 3SE +/- 0.10, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 331.3231.6131.7131.7931.5131.5431.5731.6531.9632.0832.2032.4033.5133.6333.7733.79

Apache Spark

Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)4000000010000000200000001000000160320480640800SE +/- 0.87, N = 3SE +/- 1.38, N = 3SE +/- 1.54, N = 3SE +/- 1.47, N = 3SE +/- 0.70, N = 3SE +/- 0.68, N = 3SE +/- 0.46, N = 5SE +/- 3.74, N = 3SE +/- 7.97, N = 3SE +/- 1.77, N = 3SE +/- 8.48, N = 3SE +/- 1.80, N = 3SE +/- 8.94, N = 3SE +/- 3.83, N = 3SE +/- 8.88, N = 3SE +/- 9.68, N = 4579.98580.52581.45581.85580.29581.19581.85582.87681.48694.41694.61694.62713.91722.90724.99727.52

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)50020001001000160320480640800SE +/- 0.55, N = 3SE +/- 1.28, N = 3SE +/- 0.68, N = 3SE +/- 1.66, N = 3SE +/- 0.87, N = 3SE +/- 0.86, N = 3SE +/- 0.49, N = 3SE +/- 0.56, N = 3SE +/- 4.60, N = 3SE +/- 1.80, N = 3SE +/- 8.50, N = 3SE +/- 6.51, N = 3SE +/- 16.56, N = 3SE +/- 14.94, N = 3SE +/- 8.88, N = 3SE +/- 6.99, N = 3579.01579.55581.19581.60579.98580.30580.86581.69690.62694.62695.17697.90710.71721.00724.99728.26

Apache Spark

Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.58, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.84, N = 3SE +/- 0.10, N = 5SE +/- 0.39, N = 3SE +/- 0.67, N = 3SE +/- 0.82, N = 3SE +/- 0.11, N = 4SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.34, N = 39.3452.6988.81177.819.5055.2893.79190.039.5652.8889.48178.8910.0157.0596.68195.45

Apache Spark

Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)500100020001004080120160200SE +/- 0.48, N = 3SE +/- 0.77, N = 3SE +/- 0.42, N = 3SE +/- 0.58, N = 3SE +/- 0.48, N = 3SE +/- 1.56, N = 3SE +/- 0.47, N = 3SE +/- 0.82, N = 3SE +/- 0.55, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.84, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 0.40, N = 3SE +/- 0.34, N = 3172.06172.45175.84177.81172.19172.69175.24178.89183.20183.35185.51190.03189.39189.73192.81195.45

Apache Spark

Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)4000000010000002000000010000000816243240SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.25, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 331.5131.7631.7931.7931.7131.7231.7431.8131.8431.9632.1732.2733.7233.7633.7733.89

Apache Spark

Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)4000000010000001000000020000000160320480640800SE +/- 0.55, N = 3SE +/- 1.70, N = 3SE +/- 0.62, N = 3SE +/- 0.67, N = 3SE +/- 1.02, N = 3SE +/- 0.86, N = 3SE +/- 0.64, N = 3SE +/- 0.79, N = 3SE +/- 4.56, N = 3SE +/- 3.78, N = 3SE +/- 3.62, N = 3SE +/- 4.60, N = 3SE +/- 3.66, N = 3SE +/- 17.41, N = 3SE +/- 6.99, N = 3SE +/- 10.10, N = 3579.01579.16581.78583.11579.55580.30580.99581.12683.57684.23685.12690.62692.06714.05728.26733.90

Apache Spark

Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.026873455, N = 3SE +/- 0.112654588, N = 3SE +/- 0.160687224, N = 3SE +/- 0.477080995, N = 3SE +/- 0.073904401, N = 3SE +/- 0.088475323, N = 3SE +/- 0.105154004, N = 3SE +/- 0.553867494, N = 3SE +/- 0.114204323, N = 3SE +/- 0.195921788, N = 3SE +/- 0.331996595, N = 3SE +/- 1.561648800, N = 3SE +/- 0.075456756, N = 3SE +/- 0.109148903, N = 3SE +/- 0.307771793, N = 3SE +/- 0.260000987, N = 39.89000000047.87000000090.560000000172.06000000010.43000000050.73000000096.850000000183.20000000010.48000000048.84000000091.240000000172.69004833111.23000000052.62000000099.640000000189.390000000

Apache Spark

Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)2000000010000000400000001000000816243240SE +/- 0.32, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 4SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.18, N = 331.2231.3631.5431.6131.5431.6631.7531.8832.0532.2432.3632.4033.3933.5133.8134.00

Apache Spark

Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)2000000010000001000000040000000160320480640800SE +/- 0.66, N = 3SE +/- 0.54, N = 4SE +/- 1.40, N = 3SE +/- 0.56, N = 3SE +/- 1.10, N = 3SE +/- 0.29, N = 3SE +/- 1.66, N = 3SE +/- 2.32, N = 3SE +/- 2.66, N = 3SE +/- 4.78, N = 3SE +/- 1.43, N = 3SE +/- 6.51, N = 3SE +/- 1.88, N = 3SE +/- 14.94, N = 3SE +/- 5.58, N = 3SE +/- 11.19, N = 3579.19580.24580.37581.69580.24580.46581.60583.50687.06690.24695.32697.90717.10721.00722.36722.93

Apache Spark

Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.77, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.54, N = 310.7849.2191.39172.4511.1449.4592.42172.1911.1851.6495.92183.3511.3853.52100.73189.73

Apache Spark

Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)4000000010000001000000020000000816243240SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 9SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 331.3231.5831.6631.6831.5631.6131.6531.6631.9232.0332.2032.2133.7933.7933.9133.96

Apache Spark

Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)1000000040000000200000001000000160320480640800SE +/- 0.51, N = 3SE +/- 1.28, N = 3SE +/- 0.28, N = 3SE +/- 0.55, N = 3SE +/- 1.08, N = 3SE +/- 0.47, N = 9SE +/- 0.49, N = 3SE +/- 0.41, N = 3SE +/- 2.10, N = 3SE +/- 8.22, N = 3SE +/- 8.50, N = 3SE +/- 6.18, N = 3SE +/- 16.56, N = 3SE +/- 13.31, N = 3SE +/- 22.40, N = 3SE +/- 5.14, N = 3577.92579.55581.10582.61579.87580.68580.86581.17681.91690.63695.17699.96710.71711.60723.32733.77

Apache Spark

Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 9SE +/- 0.36, N = 3SE +/- 0.02, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.47, N = 3SE +/- 0.14, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.40, N = 312.5553.0497.65185.5112.6350.8091.96175.8412.8851.0992.19175.2412.9655.17101.15192.81

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)10050010002000246810SE +/- 0.07, N = 5SE +/- 0.49, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 9SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 4SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 35.456.517.058.415.506.126.908.375.696.296.998.045.726.627.298.58

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 2000)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 2000)Broadcast Inner Join Test TimeRepartition Test TimeInner Join Test TimeSHA-512 Benchmark TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark160320480640800SE +/- 0.011049874, N = 3SE +/- 0.094249006, N = 3SE +/- 0.042552140, N = 3SE +/- 0.112867497, N = 3SE +/- 0.090717982, N = 3SE +/- 0.230080533, N = 3SE +/- 8.221686317, N = 3SE +/- 0.128969955, N = 9SE +/- 0.039688685, N = 9SE +/- 0.501143304, N = 9SE +/- 0.121232499, N = 9SE +/- 0.134671941, N = 9SE +/- 0.090240232, N = 9SE +/- 0.468273880, N = 9SE +/- 0.269877699, N = 3SE +/- 0.155773144, N = 3SE +/- 0.401879123, N = 3SE +/- 0.113414449, N = 3SE +/- 0.230601906, N = 3SE +/- 0.123827132, N = 3SE +/- 0.548006604, N = 3SE +/- 0.177939327, N = 3SE +/- 0.098619535, N = 3SE +/- 0.181687585, N = 3SE +/- 0.139768323, N = 3SE +/- 0.146972816, N = 3SE +/- 0.013599313, N = 3SE +/- 5.138863712, N = 38.04000000010.68000000010.71000000012.55000000012.86000000032.030000000690.6300000008.37000000010.57000000011.06000000012.63000000012.83000000031.560000000580.6800000008.41000000010.85000000010.89000000012.88000000013.31000000031.680000000582.6148947078.58000000010.69000000011.01000000012.96000000013.02000000033.790000000733.770000000

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)100500100020003691215SE +/- 0.04, N = 5SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.40, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.52, N = 3SE +/- 0.63, N = 4SE +/- 0.50, N = 9SE +/- 0.13, N = 4SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 36.047.037.8110.896.257.018.0110.686.547.538.6311.066.597.268.3310.69

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)100500100020003691215SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.04, N = 9SE +/- 0.03, N = 5SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 38.629.009.7410.578.759.219.9510.858.799.1010.0510.719.089.4610.0611.01

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Group By Test Time)

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Group By Test Time)100500100020003691215SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 9SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 4SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 5SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 38.759.8410.9312.838.819.9511.1012.869.0710.1311.3913.029.0910.0311.1813.31

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)10002000100500816243240SE +/- 0.08, N = 3SE +/- 0.09, N = 5SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 9SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 4SE +/- 0.16, N = 3SE +/- 0.01, N = 331.5431.6331.6831.7231.5631.7931.8431.8832.0332.1432.2732.3633.3933.7633.7633.79

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)50010002000100160320480640800SE +/- 1.70, N = 3SE +/- 0.46, N = 5SE +/- 0.55, N = 3SE +/- 2.32, N = 3SE +/- 0.54, N = 4SE +/- 0.47, N = 9SE +/- 0.64, N = 3SE +/- 1.54, N = 3SE +/- 3.62, N = 3SE +/- 8.22, N = 3SE +/- 1.77, N = 3SE +/- 1.43, N = 3SE +/- 1.88, N = 3SE +/- 9.68, N = 4SE +/- 5.14, N = 3SE +/- 10.10, N = 3579.16581.85582.61583.50580.24580.68580.99581.45685.12690.63694.41695.32717.10727.52733.77733.90

Apache Spark

Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)100500100020003691215SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 4SE +/- 0.12, N = 9SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 5SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 39.349.8910.7812.639.5010.4311.1812.559.5610.4811.1412.8810.0111.2311.3812.96

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)1005001000200020406080100SE +/- 0.59, N = 3SE +/- 0.04, N = 3SE +/- 0.83, N = 3SE +/- 0.55, N = 3SE +/- 0.73, N = 3SE +/- 0.20, N = 3SE +/- 0.89, N = 3SE +/- 0.43, N = 3SE +/- 0.09, N = 3SE +/- 0.49, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.51, N = 373.6075.2375.9674.6076.2776.6677.5679.2180.6480.7781.2582.0383.5383.9484.01

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 2000)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 2000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 1.08, N = 3SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.89, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.46, N = 3SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.31, N = 3SE +/- 0.37, N = 3SE +/- 2.10, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.46, N = 3SE +/- 0.57, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 22.40, N = 331.6191.96579.8731.6637.1669.0977.5680.4192.19581.1032.2136.7272.2881.2583.6497.65681.9133.9137.3575.4483.9486.43101.15723.32

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)1005001000200020406080100SE +/- 1.13, N = 3SE +/- 0.49, N = 3SE +/- 0.86, N = 3SE +/- 0.48, N = 3SE +/- 0.10, N = 3SE +/- 0.52, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.75, N = 3SE +/- 0.42, N = 3SE +/- 0.31, N = 3SE +/- 0.56, N = 3SE +/- 0.57, N = 3SE +/- 0.32, N = 3SE +/- 0.28, N = 375.6878.0378.4276.8777.6379.2980.4180.9080.9981.3583.6483.8483.9885.1286.43

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)5001001000200020406080100SE +/- 0.31, N = 3SE +/- 0.15, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3SE +/- 0.84, N = 3SE +/- 2.01, N = 3SE +/- 1.03, N = 3SE +/- 0.12, N = 3SE +/- 0.33, N = 3SE +/- 0.23, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.55, N = 3SE +/- 0.23, N = 3SE +/- 0.46, N = 367.8668.1268.5469.0970.9072.3572.9871.3071.5971.7072.2873.2274.3275.1875.44

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Group By Test Time)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Group By Test Time)10010005002000918273645SE +/- 0.47, N = 3SE +/- 0.44, N = 3SE +/- 0.13, N = 3SE +/- 0.41, N = 3SE +/- 0.73, N = 3SE +/- 2.03, N = 3SE +/- 4.59, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.72, N = 3SE +/- 0.46, N = 3SE +/- 0.10, N = 3SE +/- 0.45, N = 3SE +/- 0.79, N = 3SE +/- 0.10, N = 334.4134.7035.9937.1634.6635.8339.2635.2735.5136.3736.7237.0037.1137.3137.35

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 1000)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 1000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 0.20, N = 3SE +/- 0.20, N = 3SE +/- 0.52, N = 3SE +/- 0.10, N = 3SE +/- 1.10, N = 3SE +/- 0.14, N = 3SE +/- 2.03, N = 3SE +/- 1.03, N = 3SE +/- 0.83, N = 3SE +/- 0.86, N = 3SE +/- 0.29, N = 3SE +/- 0.66, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.20, N = 3SE +/- 2.66, N = 3SE +/- 0.19, N = 3SE +/- 0.79, N = 3SE +/- 0.23, N = 3SE +/- 0.51, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 3SE +/- 11.19, N = 331.2234.7068.5476.6679.2992.42580.2431.7535.8372.9875.9678.4291.39579.1932.0535.2771.7080.6481.3595.92687.0633.8137.3175.1884.0185.12100.73722.93

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)10002000100500816243240SE +/- 0.32, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 331.2231.6231.6631.7431.6131.7531.7631.8131.8432.0532.2132.2433.7233.7333.8133.91

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)10002000100500160320480640800SE +/- 0.66, N = 3SE +/- 1.08, N = 3SE +/- 1.38, N = 3SE +/- 0.79, N = 3SE +/- 1.10, N = 3SE +/- 0.28, N = 3SE +/- 3.74, N = 3SE +/- 0.67, N = 3SE +/- 2.10, N = 3SE +/- 4.56, N = 3SE +/- 2.66, N = 3SE +/- 8.48, N = 3SE +/- 8.94, N = 3SE +/- 17.41, N = 3SE +/- 11.19, N = 3SE +/- 22.40, N = 3579.19579.87580.52581.12580.24581.10582.87583.11681.91683.57687.06694.61713.91714.05722.93723.32

Apache Spark

Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)1005001000200020406080100SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.34, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.37, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 388.8190.5691.3991.9689.4891.2492.1992.4293.7995.9296.8597.6596.6899.64100.73101.15

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 500)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 500)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 0.73, N = 3SE +/- 0.10, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.15, N = 3SE +/- 4.59, N = 3SE +/- 0.84, N = 3SE +/- 0.04, N = 3SE +/- 0.49, N = 3SE +/- 0.16, N = 3SE +/- 0.79, N = 3SE +/- 0.22, N = 3SE +/- 0.72, N = 3SE +/- 0.12, N = 3SE +/- 0.49, N = 3SE +/- 0.75, N = 3SE +/- 0.11, N = 3SE +/- 4.56, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.56, N = 3SE +/- 0.31, N = 3SE +/- 17.41, N = 331.7435.9967.8676.2777.6391.24583.1131.7639.2670.9075.2378.0390.56581.1231.8436.3771.3080.7780.9996.85683.5733.7237.0073.2283.5383.8499.64714.05

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 100)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 100)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.18, N = 3SE +/- 0.47, N = 3SE +/- 0.15, N = 3SE +/- 0.55, N = 3SE +/- 0.48, N = 3SE +/- 0.67, N = 3SE +/- 3.74, N = 3SE +/- 0.07, N = 3SE +/- 0.73, N = 3SE +/- 2.01, N = 3SE +/- 0.59, N = 3SE +/- 1.13, N = 3SE +/- 0.12, N = 3SE +/- 1.38, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.32, N = 3SE +/- 0.34, N = 3SE +/- 8.48, N = 3SE +/- 0.32, N = 3SE +/- 0.45, N = 3SE +/- 0.55, N = 3SE +/- 0.19, N = 3SE +/- 0.57, N = 3SE +/- 0.22, N = 3SE +/- 8.94, N = 331.6234.4168.1274.6076.8789.48582.8731.8134.6672.3573.6075.6888.81580.5232.2435.5171.5979.2180.9093.79694.6133.7337.1174.3282.0383.9896.68713.91

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 100)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 100)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark160320480640800SE +/- 0.069228259, N = 5SE +/- 0.044993077, N = 5SE +/- 0.034264151, N = 5SE +/- 0.081615689, N = 5SE +/- 0.101368246, N = 5SE +/- 0.089037280, N = 5SE +/- 0.461842438, N = 5SE +/- 0.076264083, N = 3SE +/- 0.294062371, N = 3SE +/- 0.070931558, N = 3SE +/- 0.130013375, N = 3SE +/- 0.093919752, N = 3SE +/- 0.039099097, N = 3SE +/- 1.541717417, N = 3SE +/- 0.102452612, N = 3SE +/- 0.004165140, N = 3SE +/- 0.084920457, N = 3SE +/- 0.129389851, N = 3SE +/- 0.038555282, N = 3SE +/- 0.257940983, N = 3SE +/- 1.768265132, N = 3SE +/- 0.085253143, N = 4SE +/- 0.134671456, N = 4SE +/- 0.023541873, N = 4SE +/- 0.025356347, N = 4SE +/- 0.113137090, N = 4SE +/- 0.122562063, N = 4SE +/- 9.681628257, N = 45.4500000006.0400000008.7500000009.0900000009.56000000031.630000000581.8522107855.5000000006.5400000008.6200000008.7500000009.34000000031.840000000581.4500000005.6900000006.2500000008.7900000008.8100000009.50000000032.140000000694.4100000005.7200000006.5900000009.0700000009.08000000010.01000000033.760000000727.520000000

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)500100020001001122334455SE +/- 0.45, N = 3SE +/- 0.36, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.42, N = 3SE +/- 1.25, N = 3SE +/- 0.24, N = 3SE +/- 0.62, N = 3SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.28, N = 3SE +/- 0.71, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.25, N = 338.3539.2241.1642.8539.1640.9040.9343.1940.9541.9842.9044.2642.6843.4744.5947.10

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 100)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.71, N = 3SE +/- 0.14, N = 3SE +/- 7.97, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.43, N = 3SE +/- 0.21, N = 3SE +/- 1.37, N = 3SE +/- 0.39, N = 3SE +/- 0.70, N = 3SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 0.56, N = 3SE +/- 0.25, N = 3SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 3.83, N = 3SE +/- 3.06, N = 3SE +/- 0.29, N = 3SE +/- 0.76, N = 3SE +/- 0.62, N = 3SE +/- 1.64, N = 3SE +/- 0.05, N = 3SE +/- 1.47, N = 323.5032.3538.2943.5844.2655.28681.4823.9031.9737.0742.8543.7152.88580.2925.0534.0241.2847.1047.5257.05722.9026.6231.4938.5843.1943.8852.69581.85

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)500100010020001122334455SE +/- 0.32, N = 3SE +/- 0.21, N = 3SE +/- 1.37, N = 3SE +/- 0.15, N = 3SE +/- 0.80, N = 3SE +/- 0.56, N = 3SE +/- 1.64, N = 3SE +/- 1.45, N = 3SE +/- 0.39, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.42, N = 3SE +/- 0.40, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 340.2441.4943.7144.2342.4343.3043.8847.6142.5443.5844.0045.7444.6845.6047.5247.67

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)50010001002000918273645SE +/- 0.25, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.76, N = 3SE +/- 1.07, N = 3SE +/- 0.54, N = 3SE +/- 0.66, N = 3SE +/- 0.23, N = 3SE +/- 0.58, N = 3SE +/- 0.03, N = 3SE +/- 0.56, N = 336.4436.7237.0737.9438.2138.2938.6139.2238.5838.9239.3139.3339.9640.1640.5041.28

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Group By Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Group By Test Time)10005001002000612182430SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.20, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.36, N = 3SE +/- 1.78, N = 3SE +/- 0.22, N = 3SE +/- 3.06, N = 3SE +/- 0.42, N = 3SE +/- 0.35, N = 3SE +/- 0.28, N = 3SE +/- 0.30, N = 322.2922.3723.5024.0922.3822.6223.9024.1322.4423.8224.1026.6223.2823.8924.8525.05

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)10001002000500816243240SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.29, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 331.3631.5831.8131.9731.4931.6631.6631.7931.9232.1732.2432.3533.8933.9634.0034.02

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)20005001001000160320480640800SE +/- 0.51, N = 3SE +/- 0.70, N = 3SE +/- 0.29, N = 3SE +/- 0.62, N = 3SE +/- 1.02, N = 3SE +/- 1.40, N = 3SE +/- 0.41, N = 3SE +/- 1.47, N = 3SE +/- 7.97, N = 3SE +/- 3.78, N = 3SE +/- 4.78, N = 3SE +/- 6.18, N = 3SE +/- 3.66, N = 3SE +/- 13.31, N = 3SE +/- 5.58, N = 3SE +/- 3.83, N = 3577.92580.29580.46581.78579.55580.37581.17581.85681.48684.23690.24699.96692.06711.60722.36722.90

Apache Spark

Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)500100020001001326395265SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.39, N = 3SE +/- 0.32, N = 347.8749.2150.8052.6948.8449.4551.0952.8850.7351.6453.0455.2852.6253.5255.1757.05

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 2000)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 2000)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.34, N = 3SE +/- 6.18, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.66, N = 3SE +/- 0.24, N = 3SE +/- 1.45, N = 3SE +/- 0.36, N = 3SE +/- 0.41, N = 3SE +/- 0.39, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.39, N = 3SE +/- 13.31, N = 324.0931.9239.2242.9045.7453.04699.9624.1031.6639.3340.9347.6150.80581.1724.1331.5837.9441.1644.2351.09577.9224.8533.9640.5044.5947.6755.17711.60

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 1000)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 1000)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.28, N = 3SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 4.78, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.54, N = 3SE +/- 1.25, N = 3SE +/- 0.56, N = 3SE +/- 0.15, N = 3SE +/- 1.40, N = 3SE +/- 0.20, N = 3SE +/- 0.26, N = 3SE +/- 0.31, N = 3SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.29, N = 3SE +/- 0.35, N = 3SE +/- 0.18, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.22, N = 3SE +/- 5.58, N = 322.2932.2438.6141.9844.0051.64690.2422.4431.6639.3140.9043.3049.21580.3722.6231.3636.7239.2241.4949.45580.4623.8934.0039.9643.4745.6053.52722.36

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 500)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 500)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.09, N = 3SE +/- 3.78, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 3SE +/- 0.45, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 3SE +/- 0.62, N = 3SE +/- 0.42, N = 3SE +/- 0.13, N = 3SE +/- 0.58, N = 3SE +/- 0.24, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 3.66, N = 3SE +/- 1.78, N = 3SE +/- 0.11, N = 3SE +/- 1.07, N = 3SE +/- 0.42, N = 3SE +/- 0.80, N = 3SE +/- 0.11, N = 3SE +/- 1.02, N = 322.3732.1738.2140.9542.5450.73684.2322.3831.8136.4438.3540.2448.84581.7823.2833.8940.1642.6844.6852.62692.0623.8231.7938.9239.1642.4347.87579.55

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 1000)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 1000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeSHA-512 Benchmark TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark150300450600750SE +/- 0.06, N = 4SE +/- 0.63, N = 4SE +/- 0.07, N = 4SE +/- 0.12, N = 4SE +/- 0.08, N = 4SE +/- 0.05, N = 4SE +/- 0.54, N = 4SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 1.43, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 2.32, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 1.88, N = 36.908.639.7410.7810.9331.88580.246.998.0110.0511.1011.1832.36695.327.057.819.9511.1411.1831.54583.507.298.3310.0611.3811.3933.39717.10

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 500)

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 500)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark160320480640800SE +/- 0.063047733, N = 3SE +/- 0.517942458, N = 3SE +/- 0.101989022, N = 3SE +/- 0.152630685, N = 3SE +/- 0.026873455, N = 3SE +/- 0.017302603, N = 3SE +/- 0.635610275, N = 3SE +/- 0.103211248, N = 3SE +/- 0.103943425, N = 3SE +/- 0.076523207, N = 3SE +/- 0.188967987, N = 3SE +/- 0.073904401, N = 3SE +/- 0.155432056, N = 3SE +/- 3.616590948, N = 3SE +/- 0.486110869, N = 3SE +/- 0.043852959, N = 3SE +/- 0.069154351, N = 3SE +/- 0.086808001, N = 3SE +/- 0.114204323, N = 3SE +/- 0.016927629, N = 3SE +/- 1.696546131, N = 3SE +/- 0.094366471, N = 3SE +/- 0.056766652, N = 3SE +/- 0.037643391, N = 3SE +/- 0.085288962, N = 3SE +/- 0.075456756, N = 3SE +/- 0.158253119, N = 3SE +/- 10.096513371, N = 36.1200000007.5300000009.0000000009.8400000009.89000000031.790000000580.9900000006.2900000007.0100000009.1000000009.95000000010.43000000032.270000000685.1200000006.5100000007.0300000009.21000000010.03000000010.48000000031.720000000579.1606672406.6200000007.2600000009.46000000010.13000000011.23000000033.760000000733.900000000

Stockfish

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15ComparisonTotal Time1.1M2.2M3.3M4.4M5.5MSE +/- 385132.57, N = 9SE +/- 121318.23, N = 9SE +/- 138882.38, N = 7SE +/- 88074.41, N = 9SE +/- 38968.66, N = 9SE +/- 21647.79, N = 95271840487374748637654326446311657211366601. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

ClickHouse

Comparison

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5Comparison100M Rows Hits Dataset, Second Run100M Rows Hits Dataset, Third Run100M Rows Hits Dataset, First Run / Cold Cache1020304050SE +/- 0.67, N = 3SE +/- 0.37, N = 3SE +/- 0.56, N = 3SE +/- 0.71, N = 3SE +/- 0.32, N = 3SE +/- 0.29, N = 346.1545.7243.4541.8141.3738.83

etcd

Test Comparison (Connections: 50 - Clients: 100 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 6SE +/- 0.00, N = 3SE +/- 0.55, N = 9SE +/- 0.31, N = 9SE +/- 0.57, N = 9SE +/- 0.23, N = 95.55.65.65.611.112.411.312.2

etcd

Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)5010050048121620SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 6SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.23, N = 9SE +/- 0.31, N = 6SE +/- 0.09, N = 3SE +/- 0.31, N = 9SE +/- 0.26, N = 9SE +/- 0.15, N = 35.65.96.05.66.26.212.212.613.512.413.614.0

etcd

Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)10010001428425670SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 6SE +/- 0.07, N = 3SE +/- 0.23, N = 9SE +/- 1.90, N = 9SE +/- 0.31, N = 9SE +/- 1.59, N = 125.629.75.631.012.261.812.452.6

etcd

Comparison (Test: RANGE - Connections: 50 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.06, N = 3SE +/- 0.05, N = 6SE +/- 0.23, N = 9SE +/- 0.31, N = 95.65.612.212.4

etcd

Test Comparison (Connections: 50 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 103.48, N = 3SE +/- 149.49, N = 3SE +/- 170.29, N = 6SE +/- 13.84, N = 3SE +/- 580.79, N = 9SE +/- 213.67, N = 9SE +/- 548.13, N = 9SE +/- 162.99, N = 917919.7417702.5917733.5817625.649143.018026.129019.798177.71

etcd

Connections Comparison (Test: RANGE - - Clients: 100)

rk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100)501005004K8K12K16K20KSE +/- 170.29, N = 6SE +/- 51.80, N = 3SE +/- 51.41, N = 3SE +/- 149.49, N = 3SE +/- 92.45, N = 3SE +/- 32.79, N = 3SE +/- 162.99, N = 9SE +/- 186.80, N = 6SE +/- 43.16, N = 3SE +/- 213.67, N = 9SE +/- 157.07, N = 9SE +/- 90.88, N = 317733.5815844.2115796.4417702.5916784.8316375.198177.717871.697344.588026.127311.147054.62

etcd

Clients Comparison (Test: RANGE - Connections: 50)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50)10001007K14K21K28K35KSE +/- 208.41, N = 3SE +/- 149.49, N = 3SE +/- 55.90, N = 3SE +/- 170.29, N = 6SE +/- 466.92, N = 12SE +/- 213.67, N = 9SE +/- 428.03, N = 9SE +/- 162.99, N = 932275.1517702.5930789.2117733.5818635.508026.1215862.128177.71

etcd

Test Comparison (Connections: 500 - Clients: 100 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.31, N = 6SE +/- 0.25, N = 9SE +/- 0.26, N = 9SE +/- 0.26, N = 95.96.06.16.212.612.813.213.6

etcd

Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)505001003691215SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.55, N = 9SE +/- 0.26, N = 9SE +/- 0.12, N = 3SE +/- 0.57, N = 9SE +/- 0.25, N = 9SE +/- 0.15, N = 35.55.95.95.66.16.211.113.213.411.312.813.2

etcd

Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.25, N = 9SE +/- 0.71, N = 3SE +/- 0.26, N = 9SE +/- 0.73, N = 35.940.66.141.912.867.813.258.7

etcd

Comparison (Test: PUT - Connections: 500 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.25, N = 9SE +/- 0.26, N = 95.96.112.813.2

etcd

Test Comparison (Connections: 500 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 210.10, N = 3SE +/- 32.79, N = 3SE +/- 107.83, N = 3SE +/- 51.80, N = 3SE +/- 186.80, N = 6SE +/- 154.99, N = 9SE +/- 162.97, N = 9SE +/- 157.07, N = 916740.4516375.1916067.2715844.217871.697773.687555.487311.14

etcd

Connections Comparison (Test: PUT - - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100)505001004K8K12K16K20KSE +/- 103.48, N = 3SE +/- 210.10, N = 3SE +/- 121.87, N = 3SE +/- 13.84, N = 3SE +/- 107.83, N = 3SE +/- 230.09, N = 3SE +/- 580.79, N = 9SE +/- 162.97, N = 9SE +/- 59.42, N = 3SE +/- 548.13, N = 9SE +/- 154.99, N = 9SE +/- 78.80, N = 317919.7416740.4516623.4017625.6416067.2716034.339143.017555.487417.329019.797773.687525.00

etcd

Clients Comparison (Test: PUT - Connections: 500)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500)10001005K10K15K20K25KSE +/- 6.47, N = 3SE +/- 210.10, N = 3SE +/- 76.06, N = 3SE +/- 107.83, N = 3SE +/- 178.58, N = 3SE +/- 162.97, N = 9SE +/- 131.09, N = 3SE +/- 154.99, N = 922994.3816740.4521936.5416067.2716043.007555.4813947.877773.68

etcd

Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)10010001326395265SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.55, N = 9SE +/- 1.66, N = 12SE +/- 0.57, N = 9SE +/- 1.79, N = 95.529.95.630.911.150.311.359.0

etcd

Comparison (Test: PUT - Connections: 50 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.55, N = 9SE +/- 0.57, N = 95.55.611.111.3

etcd

Clients Comparison (Test: PUT - Connections: 50)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50)10001007K14K21K28K35KSE +/- 166.43, N = 3SE +/- 103.48, N = 3SE +/- 97.60, N = 3SE +/- 13.84, N = 3SE +/- 523.12, N = 12SE +/- 580.79, N = 9SE +/- 452.84, N = 9SE +/- 548.13, N = 932076.4117919.7430813.7717625.6419495.979143.0116573.199019.79

etcd

Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.31, N = 6SE +/- 0.98, N = 3SE +/- 0.26, N = 9SE +/- 1.51, N = 66.040.76.242.212.669.213.659.8

etcd

Comparison (Test: RANGE - Connections: 500 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.31, N = 6SE +/- 0.26, N = 96.06.212.613.6

etcd

Clients Comparison (Test: RANGE - Connections: 500)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500)10001005K10K15K20K25KSE +/- 44.26, N = 3SE +/- 32.79, N = 3SE +/- 41.44, N = 3SE +/- 51.80, N = 3SE +/- 379.06, N = 6SE +/- 157.07, N = 9SE +/- 181.75, N = 3SE +/- 186.80, N = 622948.3416375.1921829.1115844.2115827.127311.1413685.597871.69

etcd

Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)RANGEPUT1428425670SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 1.74, N = 12SE +/- 1.57, N = 12SE +/- 1.82, N = 9SE +/- 2.12, N = 931.631.732.632.750.953.563.064.4

etcd

Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)501005001530456075SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 1.59, N = 12SE +/- 1.57, N = 12SE +/- 1.51, N = 6SE +/- 1.90, N = 9SE +/- 2.12, N = 9SE +/- 0.98, N = 329.731.640.731.032.742.252.653.559.861.864.469.2

etcd

Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 2.12, N = 9SE +/- 0.15, N = 3SE +/- 1.57, N = 125.931.66.232.713.564.414.053.5

etcd

Comparison (Test: RANGE - Connections: 100 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 1.57, N = 12SE +/- 2.12, N = 931.632.753.564.4

etcd

Test Comparison (Connections: 100 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000)RANGEPUT6K12K18K24K30KSE +/- 136.35, N = 3SE +/- 119.58, N = 3SE +/- 97.95, N = 3SE +/- 123.00, N = 3SE +/- 530.09, N = 12SE +/- 414.34, N = 12SE +/- 392.03, N = 9SE +/- 438.82, N = 930214.1030106.8428950.5728883.9519163.3518202.3615482.1315177.05

etcd

Connections Comparison (Test: RANGE - - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000)501005007K14K21K28K35KSE +/- 208.41, N = 3SE +/- 136.35, N = 3SE +/- 44.26, N = 3SE +/- 55.90, N = 3SE +/- 123.00, N = 3SE +/- 41.44, N = 3SE +/- 466.92, N = 12SE +/- 414.34, N = 12SE +/- 379.06, N = 6SE +/- 428.03, N = 9SE +/- 438.82, N = 9SE +/- 181.75, N = 332275.1530214.1022948.3430789.2128883.9521829.1118635.5018202.3615827.1215862.1215177.0513685.59

etcd

Clients Comparison (Test: RANGE - Connections: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100)10001006K12K18K24K30KSE +/- 136.35, N = 3SE +/- 92.45, N = 3SE +/- 123.00, N = 3SE +/- 51.41, N = 3SE +/- 414.34, N = 12SE +/- 90.88, N = 3SE +/- 438.82, N = 9SE +/- 43.16, N = 330214.1016784.8328883.9515796.4418202.367054.6215177.057344.58

etcd

Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)501005001530456075SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 1.66, N = 12SE +/- 1.74, N = 12SE +/- 0.73, N = 3SE +/- 1.79, N = 9SE +/- 1.82, N = 9SE +/- 0.71, N = 329.931.740.630.932.641.950.350.958.759.063.067.8

etcd

Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 1.82, N = 9SE +/- 0.12, N = 3SE +/- 1.74, N = 125.931.76.232.613.263.013.450.9

etcd

Comparison (Test: PUT - Connections: 100 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 1.74, N = 12SE +/- 1.82, N = 931.732.650.963.0

etcd

Connections Comparison (Test: PUT - - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000)501005007K14K21K28K35KSE +/- 166.43, N = 3SE +/- 119.58, N = 3SE +/- 6.47, N = 3SE +/- 97.60, N = 3SE +/- 97.95, N = 3SE +/- 76.06, N = 3SE +/- 523.12, N = 12SE +/- 530.09, N = 12SE +/- 178.58, N = 3SE +/- 452.84, N = 9SE +/- 392.03, N = 9SE +/- 131.09, N = 332076.4130106.8422994.3830813.7728950.5721936.5419495.9719163.3516043.0016573.1915482.1313947.87

etcd

Clients Comparison (Test: PUT - Connections: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100)10001006K12K18K24K30KSE +/- 119.58, N = 3SE +/- 121.87, N = 3SE +/- 97.95, N = 3SE +/- 230.09, N = 3SE +/- 530.09, N = 12SE +/- 59.42, N = 3SE +/- 392.03, N = 9SE +/- 78.80, N = 330106.8416623.4028950.5716034.3319163.357417.3215482.137525.00

etcd

Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)RANGEPUT1428425670SE +/- 0.22, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 1.66, N = 12SE +/- 1.59, N = 12SE +/- 1.79, N = 9SE +/- 1.90, N = 929.729.930.931.050.352.659.061.8

etcd

Comparison (Test: RANGE - Connections: 50 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 1000)Average Latency1428425670SE +/- 0.22, N = 3SE +/- 0.07, N = 3SE +/- 1.59, N = 12SE +/- 1.90, N = 929.731.052.661.8

etcd

Test Comparison (Connections: 50 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000)RANGEPUT7K14K21K28K35KSE +/- 208.41, N = 3SE +/- 166.43, N = 3SE +/- 97.60, N = 3SE +/- 55.90, N = 3SE +/- 523.12, N = 12SE +/- 466.92, N = 12SE +/- 452.84, N = 9SE +/- 428.03, N = 932275.1532076.4130813.7730789.2119495.9718635.5016573.1915862.12

etcd

Comparison (Test: PUT - Connections: 50 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 1000)Average Latency1326395265SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 1.66, N = 12SE +/- 1.79, N = 929.930.950.359.0

etcd

Test Comparison (Connections: 100 - Clients: 100 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100 - Average Latency)RANGEPUT48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 35.95.96.26.213.213.513.414.0

etcd

Comparison (Test: RANGE - Connections: 100 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 100)Average Latency48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 35.96.213.514.0

etcd

Test Comparison (Connections: 100 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100)RANGEPUT4K8K12K16K20KSE +/- 92.45, N = 3SE +/- 121.87, N = 3SE +/- 230.09, N = 3SE +/- 51.41, N = 3SE +/- 78.80, N = 3SE +/- 43.16, N = 3SE +/- 59.42, N = 3SE +/- 90.88, N = 316784.8316623.4016034.3315796.447525.007344.587417.327054.62

etcd

Comparison (Test: PUT - Connections: 100 - Clients: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 100)Average Latency3691215SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 35.96.213.213.4

etcd

Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)PUTRANGE1530456075SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.73, N = 3SE +/- 1.51, N = 6SE +/- 0.71, N = 3SE +/- 0.98, N = 340.640.741.942.258.759.867.869.2

etcd

Comparison (Test: RANGE - Connections: 500 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 1.51, N = 6SE +/- 0.98, N = 340.742.259.869.2

etcd

Test Comparison (Connections: 500 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000)PUTRANGE5K10K15K20K25KSE +/- 6.47, N = 3SE +/- 44.26, N = 3SE +/- 76.06, N = 3SE +/- 41.44, N = 3SE +/- 178.58, N = 3SE +/- 379.06, N = 6SE +/- 131.09, N = 3SE +/- 181.75, N = 322994.3822948.3421936.5421829.1116043.0015827.1213947.8713685.59

etcd

Comparison (Test: PUT - Connections: 500 - Clients: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.00, N = 3SE +/- 0.21, N = 3SE +/- 0.73, N = 3SE +/- 0.71, N = 340.641.958.767.8

Build2

Comparison

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.15ComparisonTime To Compile2004006008001000SE +/- 2.22, N = 3SE +/- 3.79, N = 3SE +/- 2.62, N = 3SE +/- 1.02, N = 3SE +/- 4.32, N = 3668.87669.64673.85688.051064.90

Stargate Digital Audio Workstation

Sample Rate Comparison (Buffer Size: 512)

rk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 512)44100480000960001920000.17930.35860.53790.71720.8965SE +/- 0.000393, N = 3SE +/- 0.000207, N = 3SE +/- 0.000167, N = 3SE +/- 0.000291, N = 3SE +/- 0.006662, N = 12SE +/- 0.006668, N = 12SE +/- 0.000630, N = 3SE +/- 0.000095, N = 3SE +/- 0.000792, N = 3SE +/- 0.000670, N = 3SE +/- 0.000635, N = 3SE +/- 0.000865, N = 3SE +/- 0.010750, N = 3SE +/- 0.003804, N = 3SE +/- 0.000529, N = 3SE +/- 0.000288, N = 3SE +/- 0.000267, N = 3SE +/- 0.000305, N = 3SE +/- 0.000135, N = 3SE +/- 0.000076, N = 30.7970650.7642510.5633470.3732820.7762970.7477070.5912680.3928780.7757920.7437710.5491470.3643850.7705080.7620930.5902210.3917290.3355090.3218430.2255670.1451091. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 192000)

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 192000)10245120.08870.17740.26610.35480.4435SE +/- 0.000760, N = 3SE +/- 0.000288, N = 3SE +/- 0.000095, N = 3SE +/- 0.003917, N = 3SE +/- 0.000285, N = 3SE +/- 0.000291, N = 3SE +/- 0.000191, N = 3SE +/- 0.000865, N = 3SE +/- 0.000090, N = 3SE +/- 0.000076, N = 30.3942900.3917290.3928780.3911850.3907500.3732820.3815700.3643850.1666060.1451091. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate Comparison (Buffer Size: 1024)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 1024)44100480000960001920000.18480.36960.55440.73920.924SE +/- 0.000098, N = 3SE +/- 0.001050, N = 3SE +/- 0.000195, N = 3SE +/- 0.000285, N = 3SE +/- 0.000730, N = 3SE +/- 0.000633, N = 3SE +/- 0.003479, N = 3SE +/- 0.003917, N = 3SE +/- 0.000258, N = 3SE +/- 0.000443, N = 3SE +/- 0.005146, N = 9SE +/- 0.000760, N = 3SE +/- 0.000604, N = 3SE +/- 0.000798, N = 3SE +/- 0.000339, N = 3SE +/- 0.000191, N = 3SE +/- 0.000223, N = 3SE +/- 0.000131, N = 3SE +/- 0.000279, N = 3SE +/- 0.000090, N = 30.8213730.7859610.5852210.3907500.8005280.7678290.5586620.3911850.8000440.7668230.5763900.3942900.7972600.7656160.5708350.3815700.3624480.3481210.2521970.1666061. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 96000)

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 96000)51210240.1330.2660.3990.5320.665SE +/- 0.000630, N = 3SE +/- 0.003479, N = 3SE +/- 0.000529, N = 3SE +/- 0.005146, N = 9SE +/- 0.000195, N = 3SE +/- 0.000167, N = 3SE +/- 0.000339, N = 3SE +/- 0.000635, N = 3SE +/- 0.000279, N = 3SE +/- 0.000135, N = 30.5912680.5586620.5902210.5763900.5852210.5633470.5708350.5491470.2521970.2255671. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 480000)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 480000)10245120.17680.35360.53040.70720.884SE +/- 0.001050, N = 3SE +/- 0.000207, N = 3SE +/- 0.000633, N = 3SE +/- 0.006668, N = 12SE +/- 0.000443, N = 3SE +/- 0.003804, N = 3SE +/- 0.000798, N = 3SE +/- 0.000670, N = 3SE +/- 0.000131, N = 3SE +/- 0.000305, N = 30.7859610.7642510.7678290.7477070.7668230.7620930.7656160.7437710.3481210.3218431. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 44100)

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 44100)10245120.18480.36960.55440.73920.924SE +/- 0.000098, N = 3SE +/- 0.000393, N = 3SE +/- 0.000730, N = 3SE +/- 0.006662, N = 12SE +/- 0.000258, N = 3SE +/- 0.010750, N = 3SE +/- 0.000604, N = 3SE +/- 0.000792, N = 3SE +/- 0.000223, N = 3SE +/- 0.000267, N = 30.8213730.7970650.8005280.7762970.8000440.7705080.7972600.7757920.3624480.3355091. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

asmFish

Comparison

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-23Comparison1024 Hash Memory, 26 Depth2M4M6M8M10MSE +/- 43781.35, N = 3SE +/- 65797.59, N = 9SE +/- 44374.95, N = 3SE +/- 75549.20, N = 6SE +/- 34823.82, N = 380058207817210772115975838562767131

LeelaChessZero

Backend Comparison

pi5-raspbian-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend ComparisonBLAS246810SE +/- 0.00, N = 3SE +/- 0.11, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 37665511. (CXX) g++ options: -flto -pthread

Timed GDB GNU Debugger Compilation

Comparison

rk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed GDB GNU Debugger Compilation 10.2ComparisonTime To Compile90180270360450SE +/- 1.39, N = 3SE +/- 1.63, N = 3249.25393.65

Timed PHP Compilation

Comparison

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9ComparisonTime To Compile110220330440550SE +/- 1.19, N = 3SE +/- 2.08, N = 3SE +/- 2.82, N = 3SE +/- 4.51, N = 3SE +/- 1.64, N = 3334.21343.16346.68364.44519.40

Timed FFmpeg Compilation

Comparison

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1ComparisonTime To Compile2004006008001000SE +/- 0.36, N = 3SE +/- 0.84, N = 3SE +/- 0.58, N = 3SE +/- 0.50, N = 3SE +/- 0.09, N = 3SE +/- 1.65, N = 3194.15196.60200.28209.95349.94971.00

Timed Erlang/OTP Compilation

Comparison

rk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0ComparisonTime To Compile90180270360450SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.61, N = 3SE +/- 0.74, N = 3SE +/- 0.17, N = 3298.12301.84310.70330.42405.21

m-queens

Comparison

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2ComparisonTime To Solve120240360480600SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.33, N = 3206.26206.40206.45216.46316.59567.491. (CXX) g++ options: -fopenmp -O2 -march=native

Timed CPython Compilation

Build Configuration Comparison

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration ComparisonDefaultReleased Build, PGO + LTO Optimized200400600800100059.76744.6060.52764.7261.47783.8766.13784.3093.78862.02

Apache Spark TPC-H

Scale Factor Comparison (Q22)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q22)10.73261.46522.19782.93043.663SE +/- 0.05419067, N = 3SE +/- 0.40940044, N = 82.635502583.25603971

Apache Spark TPC-H

Comparison (Scale Factor: 1)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Comparison (Scale Factor: 1)Q11Q16Q22Q06Q13Q19Q14Q15Q12Geometric Mean Of All QueriesQ20Q08Q02Q10Q07Q04Q03Q05Q17Q09Q18Q01Q2148121620SE +/- 0.00889576, N = 3SE +/- 0.04807800, N = 3SE +/- 0.05419067, N = 3SE +/- 0.06400088, N = 3SE +/- 0.05404231, N = 3SE +/- 0.08247514, N = 3SE +/- 0.09844103, N = 3SE +/- 0.01587727, N = 3SE +/- 0.07812445, N = 3SE +/- 0.02205715, N = 3SE +/- 0.16740673, N = 3SE +/- 0.06585723, N = 3SE +/- 0.07990249, N = 3SE +/- 0.12475642, N = 3SE +/- 0.01424190, N = 3SE +/- 0.17085945, N = 3SE +/- 0.15831346, N = 3SE +/- 0.08288138, N = 3SE +/- 0.11188602, N = 3SE +/- 0.03195754, N = 3SE +/- 0.02944973, N = 3SE +/- 0.17776740, N = 3SE +/- 0.45650715, N = 3SE +/- 0.02504461, N = 8SE +/- 0.04873253, N = 8SE +/- 0.02204410, N = 8SE +/- 0.02994103, N = 8SE +/- 0.40940044, N = 8SE +/- 0.04107179, N = 8SE +/- 0.08797017, N = 8SE +/- 0.02096419, N = 8SE +/- 0.07037349, N = 8SE +/- 0.03832583, N = 8SE +/- 0.02853109, N = 8SE +/- 0.01870892, N = 8SE +/- 0.10497115, N = 8SE +/- 0.08702141, N = 8SE +/- 0.12029949, N = 8SE +/- 0.15490647, N = 8SE +/- 0.07160103, N = 8SE +/- 0.06264325, N = 8SE +/- 0.05677966, N = 8SE +/- 0.06360940, N = 8SE +/- 0.15655408, N = 8SE +/- 0.10385415, N = 8SE +/- 0.09251555, N = 82.229465092.365291432.635502583.144960963.309991523.456161103.483763383.733936314.411468984.703943664.955533355.121564715.125953205.488646355.678459016.219260696.352845996.451014207.480081888.098931318.852170948.9911139818.002487182.230567372.378982932.872663113.002522233.256039713.266044203.417816823.521971974.261494314.587961214.598659945.013944215.176648265.450984965.712453195.946094636.013409676.250915597.148795847.734836888.634209878.8981046716.83148050

Apache Spark TPC-H

Scale Factor Comparison (Q21)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q21)148121620SE +/- 0.09, N = 8SE +/- 0.46, N = 316.8318.00

Apache Spark TPC-H

Scale Factor Comparison (Q20)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q20)11.1152.233.3454.465.575SE +/- 0.02853109, N = 8SE +/- 0.16740673, N = 34.598659944.95553335

Apache Spark TPC-H

Scale Factor Comparison (Q19)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q19)10.77761.55522.33283.11043.888SE +/- 0.04107179, N = 8SE +/- 0.08247514, N = 33.266044203.45616110

Apache Spark TPC-H

Scale Factor Comparison (Q18)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q18)1246810SE +/- 0.15655408, N = 8SE +/- 0.02944973, N = 38.634209878.85217094

Apache Spark TPC-H

Scale Factor Comparison (Q17)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q17)1246810SE +/- 0.05677966, N = 8SE +/- 0.11188602, N = 37.148795847.48008188

Apache Spark TPC-H

Scale Factor Comparison (Q16)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q16)10.53531.07061.60592.14122.6765SE +/- 0.04807800, N = 3SE +/- 0.04873253, N = 82.365291432.37898293

Apache Spark TPC-H

Scale Factor Comparison (Q15)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q15)10.84011.68022.52033.36044.2005SE +/- 0.02096419, N = 8SE +/- 0.01587727, N = 33.521971973.73393631

Apache Spark TPC-H

Scale Factor Comparison (Q14)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q14)10.78381.56762.35143.13523.919SE +/- 0.08797017, N = 8SE +/- 0.09844103, N = 33.417816823.48376338

Apache Spark TPC-H

Scale Factor Comparison (Q13)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q13)10.74471.48942.23412.97883.7235SE +/- 0.02994103, N = 8SE +/- 0.05404231, N = 33.002522233.30999152

Apache Spark TPC-H

Scale Factor Comparison (Q12)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q12)10.99261.98522.97783.97044.963SE +/- 0.07037349, N = 8SE +/- 0.07812445, N = 34.261494314.41146898

Apache Spark TPC-H

Scale Factor Comparison (Q11)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q11)10.50191.00381.50572.00762.5095SE +/- 0.00889576, N = 3SE +/- 0.02504461, N = 82.229465092.23056737

Apache Spark TPC-H

Scale Factor Comparison (Q10)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q10)11.23492.46983.70474.93966.1745SE +/- 0.08702141, N = 8SE +/- 0.12475642, N = 35.450984965.48864635

Apache Spark TPC-H

Scale Factor Comparison (Q09)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q09)1246810SE +/- 0.06360940, N = 8SE +/- 0.03195754, N = 37.734836888.09893131

Apache Spark TPC-H

Scale Factor Comparison (Q08)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q08)11.15332.30663.45994.61325.7665SE +/- 0.01870892, N = 8SE +/- 0.07990249, N = 35.013944215.12595320

Apache Spark TPC-H

Scale Factor Comparison (Q07)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q07)11.28532.57063.85595.14126.4265SE +/- 0.01424190, N = 3SE +/- 0.12029949, N = 85.678459015.71245319

Apache Spark TPC-H

Scale Factor Comparison (Q06)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q06)10.70761.41522.12282.83043.538SE +/- 0.02204410, N = 8SE +/- 0.06400088, N = 32.872663113.14496096

Apache Spark TPC-H

Scale Factor Comparison (Q05)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q05)1246810SE +/- 0.06264325, N = 8SE +/- 0.08288138, N = 36.250915596.45101420

Apache Spark TPC-H

Scale Factor Comparison (Q04)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q04)1246810SE +/- 0.15490647, N = 8SE +/- 0.15831346, N = 35.946094636.35284599

Apache Spark TPC-H

Scale Factor Comparison (Q03)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q03)1246810SE +/- 0.07160103, N = 8SE +/- 0.17085945, N = 36.013409676.21926069

Apache Spark TPC-H

Scale Factor Comparison (Q02)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q02)11.16472.32943.49414.65885.8235SE +/- 0.06585723, N = 3SE +/- 0.10497115, N = 85.121564715.17664826

Apache Spark TPC-H

Scale Factor Comparison (Q01)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q01)13691215SE +/- 0.10385415, N = 8SE +/- 0.17776740, N = 38.898104678.99111398

Apache Spark TPC-H

Scale Factor Comparison (Geometric Mean Of All Queries)

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Geometric Mean Of All Queries)11.05842.11683.17524.23365.292SE +/- 0.03832583, N = 8SE +/- 0.02205715, N = 34.587961214.70394366

FLAC Audio Encoding

Comparison

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4ComparisonWAV To FLAC20406080100SE +/- 0.02, N = 5SE +/- 0.14, N = 5SE +/- 0.55, N = 25SE +/- 0.33, N = 25SE +/- 0.45, N = 543.5145.3351.6054.3190.291. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

Timed Wasmer Compilation

Comparison

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Wasmer Compilation 2.3ComparisonTime To Compile80160240320400SE +/- 1.65, N = 3SE +/- 1.67, N = 3SE +/- 0.10, N = 3SE +/- 0.59, N = 3SE +/- 0.79, N = 3188.16198.46204.89215.92372.861. (CC) gcc options: -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs

WavPack Audio Encoding

Comparison

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3ComparisonWAV To WavPack4080120160200SE +/- 0.05, N = 5SE +/- 0.13, N = 5SE +/- 0.07, N = 5SE +/- 0.08, N = 594.6299.62104.04188.001. (CXX) g++ options: -rdynamic

Timed Eigen Compilation

Comparison

pi5-raspbian-nvmerk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.3.9ComparisonTime To Compile4080120160200SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 2.34, N = 3SE +/- 1.77, N = 3166.00166.90173.21192.10202.51

Timed MPlayer Compilation

Comparison

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5ComparisonTime To Compile60120180240300SE +/- 1.75, N = 3SE +/- 1.68, N = 3SE +/- 1.17, N = 3SE +/- 0.66, N = 3SE +/- 0.06, N = 3148.87150.11152.52158.06254.69

Timed ImageMagick Compilation

Comparison

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0ComparisonTime To Compile50100150200250SE +/- 0.43, N = 3SE +/- 0.41, N = 3SE +/- 0.50, N = 3SE +/- 0.66, N = 3SE +/- 0.49, N = 3112.86114.08115.09120.10211.59

Opus Codec Encoding

Comparison

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.4ComparisonWAV To Opus Encode306090120150SE +/- 0.02, N = 5SE +/- 0.31, N = 5SE +/- 0.02, N = 5SE +/- 0.17, N = 5SE +/- 0.17, N = 564.4465.4567.6271.50129.791. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

N-Queens

Comparison

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterN-Queens 1.0ComparisonElapsed Time20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.70, N = 15SE +/- 0.00, N = 3SE +/- 0.01, N = 355.7656.1856.2459.4863.00109.661. (CC) gcc options: -static -fopenmp -O3 -march=native

Monkey Audio Encoding

Comparison

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterMonkey Audio Encoding 3.99.6ComparisonWAV To APE1122334455SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.66, N = 2518.5718.6719.4820.2846.561. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt

Timed Apache Compilation

Comparison

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41ComparisonTime To Compile50100150200250SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.38, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 359.1659.3259.7660.6377.31223.03

SQLite

Threads / Copies Comparison

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies Comparison1816243240SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.28, N = 15SE +/- 0.35, N = 331.2833.2736.0736.301. (CC) gcc options: -O2 -lreadline -ltermcap -lz -lm

LevelDB

Benchmark Comparison

rk1-mainline-emmcrk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.23Benchmark ComparisonSequential FillRandom FillOverwriteFill Sync48121620SE +/- 0.12, N = 3SE +/- 0.11, N = 10SE +/- 0.11, N = 15SE +/- 0.01, N = 15SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 5SE +/- 0.01, N = 1515.014.314.20.36.05.85.80.25.85.65.50.31. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

LevelDB

Benchmark Comparison

rk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.23Benchmark ComparisonRandom ReadHot ReadSeek RandomRandom DeleteSequential FillRandom FillOverwriteFill Sync8001600240032004000SE +/- 0.015, N = 3SE +/- 0.014, N = 3SE +/- 0.013, N = 3SE +/- 1.094, N = 3SE +/- 0.648, N = 3SE +/- 0.770, N = 3SE +/- 1.898, N = 5SE +/- 80.483, N = 15SE +/- 0.015, N = 3SE +/- 0.015, N = 3SE +/- 0.008, N = 3SE +/- 0.861, N = 3SE +/- 0.569, N = 3SE +/- 0.482, N = 3SE +/- 1.262, N = 3SE +/- 9.836, N = 3SE +/- 0.032, N = 3SE +/- 0.043, N = 3SE +/- 0.148, N = 15SE +/- 0.132, N = 3SE +/- 0.405, N = 3SE +/- 0.486, N = 10SE +/- 0.512, N = 15SE +/- 124.904, N = 154.4974.5206.275142.858149.853153.493156.2673224.4744.5024.5176.273139.647147.151149.216150.3523817.4294.5934.6066.37655.52759.03161.55062.0133015.6461. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

LAME MP3 Encoding

Comparison

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100ComparisonWAV To MP3612182430SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 311.8911.9612.5013.0524.371. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm

TSCP

Comparison

pi5-raspbian-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81ComparisonAI Chess Performance200K400K600K800K1000KSE +/- 350.28, N = 5SE +/- 239.20, N = 5SE +/- 238.60, N = 5SE +/- 1140.25, N = 5SE +/- 370.48, N = 5SE +/- 463.49, N = 58877798121178109217724867385074454711. (CC) gcc options: -O3 -march=native


Phoronix Test Suite v10.8.5