rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd rk1-mainline-emmc testing on Ubuntu 22.04 via the Phoronix Test Suite.
rk1-mainline-nvme: rk1-mainline-nvme testing on Ubuntu 22.04 via the Phoronix Test Suite.
rok1: Rockchip ARMv8 Cortex-A76 testing with a Turing Machines RK1 and rockchipdrmfb on Ubuntu 22.04 via the Phoronix Test Suite.
pi5-compilation: ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.
pi4-raspbian-sd: ARMv8 Cortex-A72 testing on Debian 12 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2405141-NE-RK1EMMCCO86,2405147-NE-RK1MAINLI70,2405142-NE-ROK12186375,2402267-NE-PI5COMPIL39,2402287-NE-PI4RASPBI24&cts=1&ppt=D&sro&grw .
rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd Processor Motherboard Memory Disk Graphics Network Chipset OS Kernel Vulkan Compiler File-System Screen Resolution Display Server rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd rk1-mainline-emmc @ 1.80GHz (4 Cores / 8 Threads) Turing Machines RK1 32GB 1000GB CT1000P3PSSD8 + 31GB BJTD4R Ubuntu 22.04 6.7.0 (aarch64) 1.3.255 GCC 11.4.0 ext4 rk1-mainline-nvme @ 1.80GHz (4 Cores / 8 Threads) 500GB CT500P3SSD8 + 31GB BJTD4R rk1-rok-emmc @ 1.80GHz (4 Cores / 8 Threads) rockchipdrmfb 5.10.160-rockchip (aarch64) 1920x1080 Rockchip ARMv8 Cortex-A76 @ 1.80GHz (4 Cores / 8 Threads) ARMv8 Cortex-A76 @ 2.40GHz (4 Cores) Raspberry Pi 5 Model B Rev 1.0 4096MB 500GB CT500P3SSD8 Device 1de4:0001 Debian 12 6.1.0-rpi7-rpi-2712 (aarch64) GCC 12.2.0 ARMv8 Cortex-A72 @ 1.80GHz (4 Cores) BCM2835 Raspberry Pi 400 Rev 1.0 Broadcom BCM2711 64GB SR64G 6.1.0-rpi6-rpi-v8 (aarch64) X Server OpenBenchmarking.org Kernel Details - rk1-mainline-emmc: Transparent Huge Pages: madvise - rk1-mainline-nvme: Transparent Huge Pages: madvise - pi4-raspbian-sd: snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0 cfg80211.ieee80211_regdom=US Compiler Details - rk1-mainline-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi5-raspbian-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi4-raspbian-sd: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details - rk1-mainline-emmc: Scaling Governor: rockchip-cpufreq ondemand - rk1-mainline-nvme: Scaling Governor: rockchip-cpufreq performance - rk1-rok-emmc: Scaling Governor: cpufreq-dt performance - rk1-rok-nvme: Scaling Governor: cpufreq-dt performance - pi5-raspbian-nvme: Scaling Governor: cpufreq-dt ondemand - pi4-raspbian-sd: Scaling Governor: cpufreq-dt ondemand Python Details - rk1-mainline-emmc: Python 3.10.12 - rk1-mainline-nvme: Python 3.10.12 - rk1-rok-emmc: Python 3.10.12 - rk1-rok-nvme: Python 3.10.12 - pi5-raspbian-nvme: Python 3.11.2 - pi4-raspbian-sd: Python 3.11.2 Security Details - rk1-mainline-emmc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-emmc: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-nvme: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi5-raspbian-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - pi4-raspbian-sd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected
rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd spark-tpcds: 3000 rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org
TSCP Comparison pi4-raspbian-sd pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Nodes Per Second, More Is Better TSCP 1.81 Comparison AI Chess Performance 200K 400K 600K 800K 1000K SE +/- 463.49, N = 5 SE +/- 350.28, N = 5 SE +/- 370.48, N = 5 SE +/- 1140.25, N = 5 SE +/- 238.60, N = 5 SE +/- 239.20, N = 5 445471 887779 738507 772486 810921 812117 1. (CC) gcc options: -O3 -march=native
FLAC Audio Encoding Comparison pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.4 Comparison WAV To FLAC 20 40 60 80 100 SE +/- 0.45, N = 5 SE +/- 0.33, N = 25 SE +/- 0.14, N = 5 SE +/- 0.55, N = 25 SE +/- 0.02, N = 5 90.29 54.31 45.33 51.60 43.51 1. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm
LAME MP3 Encoding Comparison pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.100 Comparison WAV To MP3 6 12 18 24 30 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 24.37 13.05 12.50 11.89 11.96 1. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm
Monkey Audio Encoding Comparison pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Monkey Audio Encoding 3.99.6 Comparison WAV To APE 11 22 33 44 55 SE +/- 0.66, N = 25 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 46.56 20.28 19.48 18.57 18.67 1. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt
Opus Codec Encoding Comparison pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Opus Codec Encoding 1.4 Comparison WAV To Opus Encode 30 60 90 120 150 SE +/- 0.17, N = 5 SE +/- 0.17, N = 5 SE +/- 0.02, N = 5 SE +/- 0.31, N = 5 SE +/- 0.02, N = 5 129.79 71.50 67.62 65.45 64.44 1. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm
Stargate Digital Audio Workstation Sample Rate Comparison (Buffer Size: 512) pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate Comparison (Buffer Size: 512) 192000 44100 480000 96000 0.1793 0.3586 0.5379 0.7172 0.8965 SE +/- 0.000076, N = 3 SE +/- 0.000267, N = 3 SE +/- 0.000305, N = 3 SE +/- 0.000135, N = 3 SE +/- 0.000865, N = 3 SE +/- 0.000792, N = 3 SE +/- 0.000670, N = 3 SE +/- 0.000635, N = 3 SE +/- 0.000291, N = 3 SE +/- 0.000393, N = 3 SE +/- 0.000207, N = 3 SE +/- 0.000167, N = 3 SE +/- 0.000095, N = 3 SE +/- 0.006662, N = 12 SE +/- 0.006668, N = 12 SE +/- 0.000630, N = 3 SE +/- 0.000288, N = 3 SE +/- 0.010750, N = 3 SE +/- 0.003804, N = 3 SE +/- 0.000529, N = 3 0.145109 0.335509 0.321843 0.225567 0.364385 0.775792 0.743771 0.549147 0.373282 0.797065 0.764251 0.563347 0.392878 0.776297 0.747707 0.591268 0.391729 0.770508 0.762093 0.590221 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 44100) pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 44100) 1024 512 0.1848 0.3696 0.5544 0.7392 0.924 SE +/- 0.000223, N = 3 SE +/- 0.000267, N = 3 SE +/- 0.000604, N = 3 SE +/- 0.000792, N = 3 SE +/- 0.000098, N = 3 SE +/- 0.000393, N = 3 SE +/- 0.000730, N = 3 SE +/- 0.006662, N = 12 SE +/- 0.000258, N = 3 SE +/- 0.010750, N = 3 0.362448 0.335509 0.797260 0.775792 0.821373 0.797065 0.800528 0.776297 0.800044 0.770508 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 96000) pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 96000) 1024 512 0.133 0.266 0.399 0.532 0.665 SE +/- 0.000279, N = 3 SE +/- 0.000135, N = 3 SE +/- 0.000339, N = 3 SE +/- 0.000635, N = 3 SE +/- 0.000195, N = 3 SE +/- 0.000167, N = 3 SE +/- 0.003479, N = 3 SE +/- 0.000630, N = 3 SE +/- 0.005146, N = 9 SE +/- 0.000529, N = 3 0.252197 0.225567 0.570835 0.549147 0.585221 0.563347 0.558662 0.591268 0.576390 0.590221 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 192000) pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 192000) 1024 512 0.0887 0.1774 0.2661 0.3548 0.4435 SE +/- 0.000090, N = 3 SE +/- 0.000076, N = 3 SE +/- 0.000191, N = 3 SE +/- 0.000865, N = 3 SE +/- 0.000285, N = 3 SE +/- 0.000291, N = 3 SE +/- 0.003917, N = 3 SE +/- 0.000095, N = 3 SE +/- 0.000760, N = 3 SE +/- 0.000288, N = 3 0.166606 0.145109 0.381570 0.364385 0.390750 0.373282 0.391185 0.392878 0.394290 0.391729 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Sample Rate Comparison (Buffer Size: 1024) pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate Comparison (Buffer Size: 1024) 192000 44100 480000 96000 0.1848 0.3696 0.5544 0.7392 0.924 SE +/- 0.000090, N = 3 SE +/- 0.000223, N = 3 SE +/- 0.000131, N = 3 SE +/- 0.000279, N = 3 SE +/- 0.000191, N = 3 SE +/- 0.000604, N = 3 SE +/- 0.000798, N = 3 SE +/- 0.000339, N = 3 SE +/- 0.000285, N = 3 SE +/- 0.000098, N = 3 SE +/- 0.001050, N = 3 SE +/- 0.000195, N = 3 SE +/- 0.003917, N = 3 SE +/- 0.000730, N = 3 SE +/- 0.000633, N = 3 SE +/- 0.003479, N = 3 SE +/- 0.000760, N = 3 SE +/- 0.000258, N = 3 SE +/- 0.000443, N = 3 SE +/- 0.005146, N = 9 0.166606 0.362448 0.348121 0.252197 0.381570 0.797260 0.765616 0.570835 0.390750 0.821373 0.785961 0.585221 0.391185 0.800528 0.767829 0.558662 0.394290 0.800044 0.766823 0.576390 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 480000) pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 480000) 1024 512 0.1768 0.3536 0.5304 0.7072 0.884 SE +/- 0.000131, N = 3 SE +/- 0.000305, N = 3 SE +/- 0.000798, N = 3 SE +/- 0.000670, N = 3 SE +/- 0.001050, N = 3 SE +/- 0.000207, N = 3 SE +/- 0.000633, N = 3 SE +/- 0.006668, N = 12 SE +/- 0.000443, N = 3 SE +/- 0.003804, N = 3 0.348121 0.321843 0.765616 0.743771 0.785961 0.764251 0.767829 0.747707 0.766823 0.762093 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
WavPack Audio Encoding Comparison pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better WavPack Audio Encoding 5.3 Comparison WAV To WavPack 40 80 120 160 200 SE +/- 0.08, N = 5 SE +/- 0.07, N = 5 SE +/- 0.13, N = 5 SE +/- 0.05, N = 5 188.00 104.04 99.62 94.62 1. (CXX) g++ options: -rdynamic
LeelaChessZero Backend Comparison pi4-raspbian-sd pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.30 Backend Comparison BLAS 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.11, N = 9 1 7 5 5 6 6 1. (CXX) g++ options: -flto -pthread
N-Queens Comparison pi4-raspbian-sd pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better N-Queens 1.0 Comparison Elapsed Time 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.70, N = 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 109.66 63.00 59.48 55.76 56.18 56.24 1. (CC) gcc options: -static -fopenmp -O3 -march=native
Timed FFmpeg Compilation Comparison pi4-raspbian-sd pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 6.1 Comparison Time To Compile 200 400 600 800 1000 SE +/- 1.65, N = 3 SE +/- 0.09, N = 3 SE +/- 0.50, N = 3 SE +/- 0.58, N = 3 SE +/- 0.84, N = 3 SE +/- 0.36, N = 3 971.00 349.94 209.95 200.28 196.60 194.15
Timed GDB GNU Debugger Compilation Comparison pi5-raspbian-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed GDB GNU Debugger Compilation 10.2 Comparison Time To Compile 90 180 270 360 450 SE +/- 1.63, N = 3 SE +/- 1.39, N = 3 393.65 249.25
Timed ImageMagick Compilation Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed ImageMagick Compilation 6.9.0 Comparison Time To Compile 50 100 150 200 250 SE +/- 0.49, N = 3 SE +/- 0.66, N = 3 SE +/- 0.50, N = 3 SE +/- 0.41, N = 3 SE +/- 0.43, N = 3 211.59 120.10 115.09 114.08 112.86
Timed MPlayer Compilation Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed MPlayer Compilation 1.5 Comparison Time To Compile 60 120 180 240 300 SE +/- 0.06, N = 3 SE +/- 0.66, N = 3 SE +/- 1.17, N = 3 SE +/- 1.75, N = 3 SE +/- 1.68, N = 3 254.69 158.06 152.52 148.87 150.11
Timed Apache Compilation Comparison pi4-raspbian-sd pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Apache Compilation 2.4.41 Comparison Time To Compile 50 100 150 200 250 SE +/- 0.49, N = 3 SE +/- 0.37, N = 3 SE +/- 0.16, N = 3 SE +/- 0.22, N = 3 SE +/- 0.26, N = 3 SE +/- 0.38, N = 3 223.03 77.31 60.63 59.32 59.16 59.76
Stockfish Comparison pi4-raspbian-sd pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 15 Comparison Total Time 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 21647.79, N = 9 SE +/- 38968.66, N = 9 SE +/- 385132.57, N = 9 SE +/- 121318.23, N = 9 SE +/- 138882.38, N = 7 SE +/- 88074.41, N = 9 1136660 3116572 5271840 4873747 4863765 4326446 1. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver
Timed LLVM Compilation Build System Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System Comparison Ninja Unix Makefiles 800 1600 2400 3200 4000 SE +/- 5.47, N = 3 SE +/- 5.63, N = 3 SE +/- 1.73, N = 3 SE +/- 3.39, N = 3 SE +/- 3.31, N = 3 SE +/- 6.63, N = 3 SE +/- 1.23, N = 3 SE +/- 2.47, N = 3 3662.54 3722.37 3524.42 3577.04 3480.73 3524.74 3468.30 3511.13
Timed PHP Compilation Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.1.9 Comparison Time To Compile 110 220 330 440 550 SE +/- 1.64, N = 3 SE +/- 4.51, N = 3 SE +/- 1.19, N = 3 SE +/- 2.82, N = 3 SE +/- 2.08, N = 3 519.40 364.44 334.21 346.68 343.16
asmFish Comparison pi4-raspbian-sd rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Nodes/second, More Is Better asmFish 2018-07-23 Comparison 1024 Hash Memory, 26 Depth 2M 4M 6M 8M 10M SE +/- 34823.82, N = 3 SE +/- 75549.20, N = 6 SE +/- 43781.35, N = 3 SE +/- 65797.59, N = 9 SE +/- 44374.95, N = 3 2767131 7583856 8005820 7817210 7721159
m-queens Comparison pi4-raspbian-sd pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Comparison Time To Solve 120 240 360 480 600 SE +/- 0.33, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 567.49 316.59 216.46 206.45 206.26 206.40 1. (CXX) g++ options: -fopenmp -O2 -march=native
Timed GCC Compilation Comparison OpenBenchmarking.org Seconds, Fewer Is Better Timed GCC Compilation 13.2 Comparison Time To Compile 900 1800 2700 3600 4500 SE +/- 12.28, N = 3 4406.83
Timed Linux Kernel Compilation Build Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build Comparison allmodconfig defconfig 2K 4K 6K 8K 10K SE +/- 14.83, N = 3 SE +/- 9.15, N = 3 SE +/- 4.42, N = 3 SE +/- 1.10, N = 3 SE +/- 1.62, N = 3 SE +/- 1.28, N = 3 SE +/- 1.83, N = 3 SE +/- 5.72, N = 3 SE +/- 2.80, N = 3 SE +/- 2.04, N = 3 9463.57 1904.55 5759.51 1199.61 5536.03 1160.50 5375.95 1138.20 5371.02 1131.97
Timed Godot Game Engine Compilation Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Comparison Time To Compile 800 1600 2400 3200 4000 SE +/- 3.05, N = 3 SE +/- 7.67, N = 3 SE +/- 4.62, N = 3 SE +/- 4.83, N = 3 SE +/- 6.78, N = 3 3498.30 1922.64 1852.59 1835.92 1844.36
Build2 Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Build2 0.15 Comparison Time To Compile 200 400 600 800 1000 SE +/- 4.32, N = 3 SE +/- 1.02, N = 3 SE +/- 2.62, N = 3 SE +/- 2.22, N = 3 SE +/- 3.79, N = 3 1064.90 688.05 673.85 668.87 669.64
Timed CPython Compilation Build Configuration Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration Comparison Default Released Build, PGO + LTO Optimized 200 400 600 800 1000 93.78 862.02 66.13 784.30 59.76 744.60 60.52 764.72 61.47 783.87
Timed Eigen Compilation Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Eigen Compilation 3.3.9 Comparison Time To Compile 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 2.34, N = 3 SE +/- 1.77, N = 3 166.00 173.21 166.90 192.10 202.51
Timed Erlang/OTP Compilation Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Erlang/OTP Compilation 25.0 Comparison Time To Compile 90 180 270 360 450 SE +/- 0.17, N = 3 SE +/- 0.61, N = 3 SE +/- 0.12, N = 3 SE +/- 0.77, N = 3 SE +/- 0.74, N = 3 405.21 310.70 298.12 301.84 330.42
Timed Gem5 Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 23.0.1 Comparison Time To Compile 500 1000 1500 2000 2500 SE +/- 3.08, N = 3 SE +/- 0.90, N = 3 SE +/- 2.55, N = 3 SE +/- 0.96, N = 3 2329.03 2257.24 2222.42 2220.18
Timed Node.js Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 19.8.1 Comparison Time To Compile 700 1400 2100 2800 3500 SE +/- 2.91, N = 3 SE +/- 1.20, N = 3 SE +/- 3.73, N = 3 SE +/- 0.29, N = 3 3378.82 3261.91 3289.07 3283.24
Timed Wasmer Compilation Comparison pi5-raspbian-nvme rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Comparison Time To Compile 80 160 240 320 400 SE +/- 0.79, N = 3 SE +/- 0.59, N = 3 SE +/- 0.10, N = 3 SE +/- 1.67, N = 3 SE +/- 1.65, N = 3 372.86 215.92 204.89 198.46 188.16 1. (CC) gcc options: -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs
Apache Spark TPC-DS Scale Factor Comparison (Q01) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q01) 1 10 50 100 5 10 15 20 25 SE +/- 0.10, N = 3 SE +/- 0.14, N = 4 SE +/- 0.04, N = 3 SE +/- 0.10, N = 4 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.20, N = 3 8.93 11.29 15.85 8.98 11.23 20.13 15.41 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 1) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 1) Q01 Q02 Q03 Q04 Q05 Q06 Q07 Q08 Q09 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 Q19 Q20 Q21 Q22 Q23 Q24 Q25 Q26 Q27 Q28 Q29 Q30 Q31 Q32 Q33 Q34 Q35 Q36 Q37 Q38 Q39 Q40 Q41 Q42 Q43 Q44 Q45 Q46 Q47 Q48 Q49 Q50 Q51 Q52 Q53 Q54 Q55 Q56 Q57 Q58 Q59 Q60 Q61 Q62 Q63 Q64 Q65 Q66 Q67 Q68 Q69 Q70 Q71 Q72 Q73 Q74 Q75 Q76 Q77 Q78 Q79 Q80 Q81 Q82 Q83 Q84 Q85 Q86 Q87 Q88 Q89 Q90 Q91 Q92 Q93 Q94 Q95 Q96 Q97 Q98 Q99 5 10 15 20 25 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.22, N = 3 SE +/- 0.19, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.33, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.21, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.17, N = 3 SE +/- 0.06, N = 2 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 2 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 2 SE +/- 0.15, N = 2 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.28, N = 3 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 2 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 2 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.14, N = 2 SE +/- 0.01, N = 2 SE +/- 0.07, N = 3 SE +/- 0.04, N = 2 SE +/- 0.06, N = 3 SE +/- 0.02, N = 2 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 2 SE +/- 0.22, N = 2 SE +/- 0.10, N = 4 SE +/- 0.06, N = 4 SE +/- 0.07, N = 4 SE +/- 0.10, N = 4 SE +/- 0.11, N = 4 SE +/- 0.05, N = 4 SE +/- 0.04, N = 4 SE +/- 0.01, N = 4 SE +/- 0.05, N = 4 SE +/- 0.16, N = 4 SE +/- 0.05, N = 4 SE +/- 0.02, N = 4 SE +/- 0.11, N = 4 SE +/- 0.11, N = 4 SE +/- 0.02, N = 4 SE +/- 0.10, N = 4 SE +/- 0.12, N = 4 SE +/- 0.08, N = 4 SE +/- 0.05, N = 4 SE +/- 0.02, N = 4 SE +/- 0.08, N = 4 SE +/- 0.18, N = 4 SE +/- 0.23, N = 4 SE +/- 0.05, N = 4 SE +/- 0.11, N = 4 SE +/- 0.14, N = 4 SE +/- 0.05, N = 4 SE +/- 0.12, N = 3 SE +/- 0.04, N = 4 SE +/- 0.07, N = 3 SE +/- 0.14, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.13, N = 2 SE +/- 0.08, N = 4 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 4 SE +/- 0.12, N = 4 SE +/- 0.04, N = 3 SE +/- 0.05, N = 4 SE +/- 0.03, N = 4 SE +/- 0.09, N = 4 SE +/- 0.03, N = 4 SE +/- 0.03, N = 4 SE +/- 0.06, N = 3 SE +/- 0.16, N = 4 SE +/- 0.07, N = 4 SE +/- 0.08, N = 4 SE +/- 0.14, N = 4 SE +/- 0.19, N = 4 SE +/- 0.02, N = 4 SE +/- 0.07, N = 4 SE +/- 0.10, N = 4 SE +/- 0.06, N = 4 SE +/- 0.05, N = 4 SE +/- 0.07, N = 4 SE +/- 0.05, N = 2 SE +/- 0.04, N = 4 SE +/- 0.10, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.19, N = 4 SE +/- 0.06, N = 4 SE +/- 0.13, N = 3 SE +/- 0.13, N = 4 SE +/- 0.07, N = 4 SE +/- 0.18, N = 4 SE +/- 0.15, N = 3 SE +/- 0.10, N = 4 SE +/- 0.25, N = 4 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.13, N = 4 SE +/- 0.10, N = 4 SE +/- 0.05, N = 4 SE +/- 0.07, N = 4 SE +/- 0.06, N = 4 SE +/- 0.10, N = 4 SE +/- 0.08, N = 3 SE +/- 0.07, N = 4 SE +/- 0.02, N = 3 SE +/- 0.05, N = 4 SE +/- 0.19, N = 3 SE +/- 0.11, N = 4 SE +/- 0.05, N = 4 SE +/- 0.12, N = 3 SE +/- 0.10, N = 4 SE +/- 0.06, N = 4 SE +/- 0.06, N = 4 SE +/- 0.08, N = 4 SE +/- 0.04, N = 3 SE +/- 0.03, N = 4 SE +/- 0.04, N = 3 SE +/- 0.03, N = 4 SE +/- 0.06, N = 4 SE +/- 0.02, N = 4 SE +/- 0.02, N = 2 8.93 9.77 6.75 15.16 12.11 9.11 8.48 8.75 8.19 11.45 12.75 4.95 8.26 9.01 7.57 6.31 11.72 10.59 8.17 4.97 7.99 10.75 8.08 2.72 11.21 7.89 9.12 11.14 11.63 9.00 12.08 7.68 10.20 8.41 11.22 9.25 5.22 10.18 3.76 8.07 6.23 6.70 7.24 8.64 7.53 8.67 12.59 7.89 11.14 8.56 13.30 6.78 7.88 11.16 6.80 9.88 10.64 10.17 9.09 10.25 6.54 7.63 7.79 17.15 10.10 11.27 12.31 8.46 11.07 10.29 8.99 19.61 8.30 11.72 14.43 8.82 11.24 14.03 8.51 13.45 8.76 8.88 9.21 7.13 12.00 8.13 10.09 11.83 8.70 6.76 8.32 7.58 7.71 6.11 7.46 5.75 9.71 4.87 7.83 8.98 9.69 6.79 15.04 11.79 9.33 8.46 8.80 7.90 11.53 12.70 4.90 8.40 9.03 7.49 6.29 11.99 10.58 8.02 4.94 7.91 10.42 8.07 2.68 11.27 7.88 8.99 11.02 11.19 9.26 12.29 7.70 10.04 8.61 11.48 8.83 5.09 10.08 3.72 8.00 6.22 6.72 7.15 8.61 7.60 8.69 12.43 7.65 10.77 8.75 13.22 6.73 7.90 10.89 6.57 9.87 10.76 9.92 9.11 10.19 6.49 7.83 7.88 17.19 10.27 11.27 12.08 8.53 10.95 10.35 9.04 19.11 8.31 11.95 14.26 8.78 11.39 14.33 8.44 13.52 8.87 8.86 9.24 7.30 11.86 8.04 10.07 11.39 8.81 6.63 8.19 7.79 7.75 6.09 7.26 5.73 9.83 4.85 7.62 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q02) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q02) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.14, N = 3 SE +/- 0.25, N = 4 SE +/- 0.12, N = 3 SE +/- 0.06, N = 4 SE +/- 0.36, N = 3 SE +/- 0.29, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 2 9.77 11.32 17.55 9.69 11.63 27.55 17.58 27.90 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q03) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q03) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.03, N = 3 SE +/- 0.03, N = 4 SE +/- 0.08, N = 3 SE +/- 0.07, N = 4 SE +/- 0.17, N = 3 SE +/- 0.20, N = 3 SE +/- 0.28, N = 3 SE +/- 0.21, N = 2 6.75 8.48 14.18 6.79 9.02 19.51 14.12 19.48 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q04) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q04) 1 10 50 100 40 80 120 160 200 SE +/- 0.22, N = 3 SE +/- 0.36, N = 4 SE +/- 0.56, N = 3 SE +/- 0.10, N = 4 SE +/- 0.31, N = 3 SE +/- 1.16, N = 3 SE +/- 0.72, N = 3 15.16 50.14 154.31 15.04 48.88 192.45 153.78 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q05) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q05) 1 10 50 100 15 30 45 60 75 SE +/- 0.19, N = 3 SE +/- 0.37, N = 4 SE +/- 0.56, N = 3 SE +/- 0.11, N = 4 SE +/- 0.60, N = 3 SE +/- 0.44, N = 3 SE +/- 1.08, N = 3 12.11 23.85 43.17 11.79 23.38 66.74 43.74 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q06) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q06) 1 10 50 100 500 11 22 33 44 55 SE +/- 0.03, N = 3 SE +/- 0.14, N = 4 SE +/- 0.91, N = 3 SE +/- 0.05, N = 4 SE +/- 0.30, N = 3 SE +/- 0.17, N = 3 SE +/- 0.46, N = 3 SE +/- 0.05, N = 2 9.11 18.81 49.09 9.33 19.40 23.74 47.67 23.61 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q07) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q07) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.10, N = 3 SE +/- 0.32, N = 4 SE +/- 0.48, N = 3 SE +/- 0.04, N = 4 SE +/- 0.10, N = 3 SE +/- 0.64, N = 3 SE +/- 0.21, N = 3 SE +/- 1.17, N = 2 8.48 12.58 21.52 8.46 12.76 29.32 20.72 27.83 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q08) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q08) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.12, N = 3 SE +/- 0.13, N = 4 SE +/- 0.44, N = 3 SE +/- 0.01, N = 4 SE +/- 0.14, N = 3 SE +/- 0.28, N = 3 SE +/- 0.26, N = 3 SE +/- 0.13, N = 2 8.75 11.83 17.20 8.80 11.84 22.24 17.27 22.66 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q09) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q09) 1 10 50 100 500 9 18 27 36 45 SE +/- 0.11, N = 3 SE +/- 0.10, N = 4 SE +/- 0.25, N = 3 SE +/- 0.05, N = 4 SE +/- 0.28, N = 3 SE +/- 0.49, N = 3 SE +/- 0.16, N = 3 SE +/- 0.61, N = 2 8.19 12.05 24.13 7.90 11.83 41.19 24.46 39.80 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q10) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q10) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.17, N = 3 SE +/- 0.12, N = 4 SE +/- 0.37, N = 3 SE +/- 0.16, N = 4 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.15, N = 3 SE +/- 1.72, N = 2 11.45 14.14 20.16 11.53 14.33 27.59 20.24 27.69 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q11) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q11) 1 10 50 100 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.27, N = 4 SE +/- 0.28, N = 3 SE +/- 0.05, N = 4 SE +/- 0.37, N = 3 SE +/- 0.56, N = 3 SE +/- 0.53, N = 3 12.75 35.77 103.28 12.70 35.90 121.65 101.84 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q12) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q12) 1 10 50 100 500 1.1858 2.3716 3.5574 4.7432 5.929 SE +/- 0.02, N = 3 SE +/- 0.04, N = 4 SE +/- 0.08, N = 3 SE +/- 0.02, N = 4 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 SE +/- 0.09, N = 2 4.95 5.14 5.27 4.90 5.14 5.22 5.21 5.23 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q13) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q13) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.16, N = 3 SE +/- 0.16, N = 4 SE +/- 0.11, N = 3 SE +/- 0.11, N = 4 SE +/- 0.10, N = 3 SE +/- 0.50, N = 3 SE +/- 0.17, N = 3 SE +/- 0.38, N = 2 8.26 11.80 19.78 8.40 11.43 28.19 19.45 28.72 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q14) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q14) 1 10 50 100 500 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.35, N = 4 SE +/- 0.35, N = 3 SE +/- 0.11, N = 4 SE +/- 0.58, N = 3 SE +/- 2.66, N = 3 SE +/- 2.04, N = 3 SE +/- 1.32, N = 3 9.01 22.76 75.66 9.03 22.19 101.62 77.16 100.36 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q15) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q15) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.09, N = 3 SE +/- 0.21, N = 4 SE +/- 0.24, N = 3 SE +/- 0.02, N = 4 SE +/- 0.19, N = 3 SE +/- 0.30, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 7.57 10.39 17.77 7.49 10.33 26.19 17.59 26.11 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q16) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q16) 1 2 4 6 8 10 SE +/- 0.16, N = 3 SE +/- 0.10, N = 4 6.31 6.29 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q17) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q17) 1 10 50 100 500 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.36, N = 4 SE +/- 1.40, N = 3 SE +/- 0.12, N = 4 SE +/- 0.15, N = 3 SE +/- 0.40, N = 3 SE +/- 0.43, N = 3 SE +/- 0.71, N = 3 11.72 35.11 119.35 11.99 34.68 42.92 119.31 43.55 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q18) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q18) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.19, N = 3 SE +/- 0.12, N = 4 SE +/- 0.20, N = 3 SE +/- 0.08, N = 4 SE +/- 0.21, N = 3 SE +/- 0.54, N = 3 SE +/- 0.21, N = 3 SE +/- 0.23, N = 3 10.59 13.78 20.87 10.58 13.81 27.88 21.41 27.73 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q19) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q19) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.09, N = 3 SE +/- 0.21, N = 4 SE +/- 0.18, N = 3 SE +/- 0.05, N = 4 SE +/- 0.22, N = 3 SE +/- 0.67, N = 3 SE +/- 0.37, N = 3 SE +/- 0.52, N = 3 8.17 11.81 18.23 8.02 11.15 25.57 17.89 25.80 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q20) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q20) 1 10 50 100 500 1.197 2.394 3.591 4.788 5.985 SE +/- 0.04, N = 3 SE +/- 0.03, N = 4 SE +/- 0.08, N = 3 SE +/- 0.02, N = 4 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 2 4.97 5.09 5.21 4.94 5.05 5.32 5.27 5.22 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q21) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q21) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.03, N = 3 SE +/- 0.17, N = 4 SE +/- 0.26, N = 3 SE +/- 0.08, N = 4 SE +/- 0.17, N = 3 SE +/- 0.09, N = 3 SE +/- 0.34, N = 3 SE +/- 0.28, N = 3 7.99 12.54 15.80 7.91 12.10 20.57 15.83 21.02 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q22) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q22) 1 10 50 100 500 14 28 42 56 70 SE +/- 0.05, N = 3 SE +/- 0.40, N = 4 SE +/- 0.54, N = 3 SE +/- 0.18, N = 4 SE +/- 0.14, N = 3 SE +/- 0.29, N = 3 SE +/- 0.38, N = 3 SE +/- 0.40, N = 3 10.75 26.57 36.12 10.42 26.94 60.75 36.66 61.50 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q23) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q23) 1 10 50 100 50 100 150 200 250 SE +/- 0.02, N = 3 SE +/- 0.43, N = 4 SE +/- 1.35, N = 3 SE +/- 0.23, N = 4 SE +/- 0.46, N = 3 SE +/- 0.08, N = 3 SE +/- 1.31, N = 3 8.08 33.00 178.13 8.07 33.70 223.12 173.15 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q24) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q24) 1 10 50 100 13 26 39 52 65 SE +/- 0.02, N = 3 SE +/- 0.11, N = 4 SE +/- 0.49, N = 3 SE +/- 0.05, N = 4 SE +/- 0.64, N = 3 SE +/- 0.74, N = 3 SE +/- 0.08, N = 3 2.72 17.46 57.15 2.68 16.79 39.99 56.78 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q25) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q25) 1 10 50 100 500 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.27, N = 4 SE +/- 1.06, N = 3 SE +/- 0.11, N = 4 SE +/- 0.79, N = 3 SE +/- 0.33, N = 3 SE +/- 0.72, N = 3 SE +/- 0.28, N = 3 11.21 35.36 112.65 11.27 35.47 41.97 109.51 41.30 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q26) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q26) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.06, N = 3 SE +/- 0.27, N = 4 SE +/- 0.12, N = 3 SE +/- 0.14, N = 4 SE +/- 0.29, N = 3 SE +/- 0.57, N = 3 SE +/- 0.30, N = 3 SE +/- 0.61, N = 3 7.89 10.32 16.02 7.88 10.48 20.44 16.23 20.59 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q27) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q27) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.14, N = 3 SE +/- 0.20, N = 4 SE +/- 0.47, N = 3 SE +/- 0.05, N = 4 SE +/- 0.27, N = 2 SE +/- 0.26, N = 3 SE +/- 0.39, N = 3 SE +/- 0.46, N = 3 9.12 12.92 22.10 8.99 13.43 28.46 20.69 29.86 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q28) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q28) 1 10 50 100 500 15 30 45 60 75 SE +/- 0.21, N = 3 SE +/- 0.21, N = 4 SE +/- 0.48, N = 3 SE +/- 0.12, N = 3 SE +/- 0.51, N = 3 SE +/- 2.08, N = 3 SE +/- 0.66, N = 3 SE +/- 0.64, N = 3 11.14 17.46 42.77 11.02 17.54 68.17 41.62 67.04 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q29) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q29) 1 10 50 100 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.41, N = 4 SE +/- 1.14, N = 3 SE +/- 0.04, N = 4 SE +/- 0.40, N = 3 SE +/- 0.23, N = 3 SE +/- 0.16, N = 3 11.63 35.87 118.41 11.19 34.69 47.47 117.34 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q30) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q30) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.06, N = 4 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.16, N = 3 SE +/- 0.28, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 9.00 11.91 15.98 9.26 11.90 19.51 16.04 18.89 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q31) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q31) 1 10 50 100 500 12 24 36 48 60 SE +/- 0.05, N = 3 SE +/- 0.26, N = 3 SE +/- 0.17, N = 3 SE +/- 0.14, N = 4 SE +/- 0.63, N = 3 SE +/- 0.70, N = 3 SE +/- 0.41, N = 3 SE +/- 0.67, N = 3 12.08 18.64 35.80 12.29 19.33 51.49 33.52 49.00 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q32) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q32) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.07, N = 3 SE +/- 0.25, N = 4 SE +/- 0.17, N = 3 SE +/- 0.04, N = 4 SE +/- 0.14, N = 3 SE +/- 0.17, N = 3 SE +/- 0.41, N = 3 SE +/- 0.33, N = 3 7.68 9.74 14.40 7.70 9.38 22.65 15.29 22.59 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q33) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q33) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.09, N = 3 SE +/- 0.16, N = 4 SE +/- 0.40, N = 3 SE +/- 0.09, N = 4 SE +/- 0.26, N = 3 SE +/- 0.45, N = 3 SE +/- 0.37, N = 3 SE +/- 0.12, N = 3 10.20 14.10 22.31 10.04 13.60 29.17 22.00 29.04 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q34) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q34) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.13, N = 2 SE +/- 0.46, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 8.41 11.91 17.68 8.61 12.04 23.95 17.91 22.81 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q35) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q35) 1 10 50 100 500 8 16 24 32 40 SE +/- 0.17, N = 3 SE +/- 0.12, N = 4 SE +/- 0.27, N = 3 SE +/- 0.08, N = 4 SE +/- 0.93, N = 3 SE +/- 0.17, N = 3 SE +/- 0.22, N = 3 SE +/- 0.28, N = 3 11.22 15.91 25.60 11.48 16.57 36.60 25.07 36.50 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q36) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q36) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.06, N = 2 SE +/- 0.13, N = 4 SE +/- 0.71, N = 3 SE +/- 0.12, N = 3 SE +/- 0.63, N = 3 SE +/- 0.49, N = 3 SE +/- 0.63, N = 3 SE +/- 0.57, N = 3 9.25 11.92 22.14 8.83 12.48 31.04 22.39 30.73 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q37) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q37) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.27, N = 4 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 SE +/- 0.24, N = 3 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 5.22 13.82 22.76 5.09 13.36 20.99 22.74 21.40 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q38) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q38) 1 10 50 100 500 15 30 45 60 75 SE +/- 0.07, N = 3 SE +/- 0.28, N = 4 SE +/- 0.66, N = 3 SE +/- 0.05, N = 4 SE +/- 0.11, N = 3 SE +/- 0.66, N = 3 SE +/- 0.89, N = 3 SE +/- 0.18, N = 3 10.18 17.69 43.19 10.08 17.41 67.38 43.48 68.08 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q39) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q39) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.31, N = 4 SE +/- 0.36, N = 3 SE +/- 0.12, N = 4 SE +/- 0.20, N = 3 SE +/- 1.30, N = 3 SE +/- 0.36, N = 3 SE +/- 0.37, N = 3 3.76 10.42 15.19 3.72 10.75 22.77 15.19 24.99 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q40) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q40) 1 10 50 100 10 20 30 40 50 SE +/- 0.13, N = 3 SE +/- 0.11, N = 4 SE +/- 0.58, N = 3 SE +/- 0.04, N = 3 SE +/- 0.26, N = 3 SE +/- 0.17, N = 2 SE +/- 0.37, N = 3 8.07 17.68 42.82 8.00 17.38 24.08 41.43 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q41) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q41) 1 10 50 100 500 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.07, N = 4 SE +/- 0.10, N = 3 SE +/- 0.05, N = 4 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 6.23 7.17 7.37 6.22 7.09 7.29 7.28 7.32 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q42) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q42) 1 10 50 100 500 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.06, N = 4 SE +/- 0.30, N = 3 SE +/- 0.03, N = 4 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.34, N = 3 SE +/- 0.25, N = 3 6.70 8.69 13.56 6.72 8.44 17.72 13.25 17.61 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q43) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q43) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.06, N = 3 SE +/- 0.09, N = 4 SE +/- 0.34, N = 3 SE +/- 0.09, N = 4 SE +/- 0.08, N = 3 SE +/- 0.17, N = 2 SE +/- 0.30, N = 3 SE +/- 0.32, N = 3 7.24 8.55 14.17 7.15 8.42 18.71 13.77 19.23 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q44) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q44) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.13, N = 3 SE +/- 0.04, N = 4 SE +/- 0.06, N = 3 SE +/- 0.03, N = 4 SE +/- 0.07, N = 3 SE +/- 0.66, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 8.64 6.54 7.74 8.61 6.40 25.22 7.84 25.03 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q45) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q45) 1 10 50 100 500 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.13, N = 4 SE +/- 0.13, N = 3 SE +/- 0.03, N = 4 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.28, N = 3 SE +/- 0.37, N = 3 7.53 9.76 13.15 7.60 9.84 16.86 13.46 16.90 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q46) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q46) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.11, N = 3 SE +/- 0.16, N = 4 SE +/- 0.27, N = 3 SE +/- 0.06, N = 3 SE +/- 0.34, N = 3 SE +/- 0.26, N = 3 SE +/- 0.09, N = 3 SE +/- 0.29, N = 3 8.67 12.66 22.29 8.69 12.47 30.04 21.87 29.87 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q47) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q47) 1 10 50 100 500 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.16, N = 4 SE +/- 0.22, N = 3 SE +/- 0.16, N = 4 SE +/- 0.08, N = 3 SE +/- 0.31, N = 3 SE +/- 0.40, N = 3 SE +/- 0.43, N = 3 12.59 19.10 33.34 12.43 19.08 50.05 33.73 49.44 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q48) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q48) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.05, N = 3 SE +/- 0.10, N = 4 SE +/- 0.24, N = 3 SE +/- 0.07, N = 4 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.32, N = 3 SE +/- 0.27, N = 3 7.89 10.49 16.97 7.65 10.00 23.00 16.67 23.13 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q49) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q49) 1 10 50 100 10 20 30 40 50 SE +/- 0.08, N = 2 SE +/- 0.11, N = 4 SE +/- 0.37, N = 3 SE +/- 0.08, N = 4 SE +/- 0.20, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 11.14 18.93 40.27 10.77 19.51 44.00 39.34 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q50) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q50) 1 10 50 100 20 40 60 80 100 SE +/- 0.02, N = 3 SE +/- 0.25, N = 4 SE +/- 0.37, N = 3 SE +/- 0.14, N = 4 SE +/- 0.22, N = 3 SE +/- 0.82, N = 3 SE +/- 0.11, N = 3 8.56 22.00 50.08 8.75 21.90 81.06 49.36 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q51) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q51) 1 10 50 100 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.18, N = 4 SE +/- 0.66, N = 3 SE +/- 0.19, N = 4 SE +/- 0.17, N = 2 SE +/- 1.20, N = 3 SE +/- 0.65, N = 3 13.30 26.32 59.46 13.22 26.28 101.72 58.63 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q52) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q52) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.08, N = 3 SE +/- 0.10, N = 4 SE +/- 0.36, N = 3 SE +/- 0.02, N = 4 SE +/- 0.15, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.29, N = 3 6.78 8.76 13.59 6.73 8.65 18.87 13.22 19.14 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q53) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q53) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.13, N = 3 SE +/- 0.08, N = 4 SE +/- 0.18, N = 3 SE +/- 0.07, N = 4 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.25, N = 3 SE +/- 0.11, N = 3 7.88 9.75 15.36 7.90 9.46 20.06 14.94 19.96 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q54) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q54) 1 10 50 100 500 9 18 27 36 45 SE +/- 0.13, N = 3 SE +/- 0.07, N = 4 SE +/- 0.16, N = 3 SE +/- 0.10, N = 4 SE +/- 0.42, N = 3 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 2 11.16 16.97 37.77 10.89 17.07 33.83 36.96 33.99 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q55) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q55) 1 10 50 100 500 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.14, N = 4 SE +/- 0.23, N = 3 SE +/- 0.06, N = 4 SE +/- 0.19, N = 3 SE +/- 0.36, N = 3 SE +/- 0.12, N = 3 SE +/- 0.34, N = 3 6.80 8.63 13.93 6.57 8.70 18.22 13.60 17.95 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q56) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q56) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.05, N = 3 SE +/- 0.11, N = 4 SE +/- 0.09, N = 3 SE +/- 0.05, N = 4 SE +/- 0.14, N = 3 SE +/- 0.32, N = 3 SE +/- 0.24, N = 3 SE +/- 0.14, N = 3 9.88 13.02 20.67 9.87 12.80 27.59 21.10 28.05 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q57) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q57) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.10, N = 3 SE +/- 0.07, N = 4 SE +/- 0.60, N = 3 SE +/- 0.07, N = 4 SE +/- 0.16, N = 3 SE +/- 0.74, N = 3 SE +/- 0.03, N = 3 SE +/- 0.61, N = 3 10.64 16.48 24.44 10.76 16.38 31.67 24.78 31.63 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q58) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q58) 1 10 50 100 500 8 16 24 32 40 SE +/- 0.04, N = 2 SE +/- 0.09, N = 4 SE +/- 0.54, N = 3 SE +/- 0.05, N = 2 SE +/- 0.34, N = 3 SE +/- 0.53, N = 3 SE +/- 0.28, N = 3 SE +/- 1.31, N = 3 10.17 13.84 24.38 9.92 14.74 35.61 24.20 34.21 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q60) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q60) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.04, N = 3 SE +/- 0.34, N = 4 SE +/- 0.32, N = 3 SE +/- 0.10, N = 3 SE +/- 0.51, N = 3 SE +/- 0.71, N = 3 SE +/- 0.21, N = 3 SE +/- 0.70, N = 3 10.25 14.21 23.59 10.19 14.32 30.69 22.57 31.17 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q61) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q61) 1 10 50 100 500 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.05, N = 4 SE +/- 0.39, N = 2 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.17, N = 3 6.54 7.10 7.70 6.49 7.03 7.51 7.65 7.71 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q62) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q62) 1 10 50 100 500 4 8 12 16 20 SE +/- 0.10, N = 4 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.22, N = 3 SE +/- 0.27, N = 3 SE +/- 0.07, N = 3 7.63 9.19 12.97 7.83 8.98 15.66 12.61 15.61 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q63) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q63) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.13, N = 4 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.33, N = 3 SE +/- 0.06, N = 2 SE +/- 0.31, N = 3 7.79 9.55 15.01 7.88 9.83 19.93 14.73 19.86 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q64) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q64) 1 10 50 100 40 80 120 160 200 SE +/- 0.18, N = 3 SE +/- 0.32, N = 4 SE +/- 1.53, N = 3 SE +/- 0.19, N = 4 SE +/- 0.51, N = 3 SE +/- 2.48, N = 3 SE +/- 3.02, N = 3 17.15 51.48 170.85 17.19 50.33 151.38 165.96 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q65) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q65) 1 10 50 100 16 32 48 64 80 SE +/- 0.02, N = 3 SE +/- 0.84, N = 4 SE +/- 0.84, N = 3 SE +/- 0.06, N = 4 SE +/- 0.21, N = 3 SE +/- 1.31, N = 3 SE +/- 0.48, N = 3 10.10 18.64 42.42 10.27 18.12 73.38 42.69 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q66) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q66) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.08, N = 3 SE +/- 0.18, N = 4 SE +/- 0.17, N = 2 SE +/- 0.13, N = 3 SE +/- 0.16, N = 3 SE +/- 0.44, N = 3 SE +/- 0.24, N = 3 SE +/- 0.43, N = 3 11.27 14.03 20.07 11.27 13.75 27.68 20.62 27.08 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q67) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q67) 1 10 50 100 50 100 150 200 250 SE +/- 0.11, N = 3 SE +/- 0.13, N = 4 SE +/- 0.63, N = 3 SE +/- 0.13, N = 4 SE +/- 0.11, N = 3 SE +/- 1.23, N = 3 SE +/- 0.51, N = 3 12.31 33.19 106.61 12.08 32.61 205.56 106.30 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q68) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q68) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.09, N = 3 SE +/- 0.14, N = 4 SE +/- 0.18, N = 3 SE +/- 0.07, N = 4 SE +/- 0.27, N = 3 SE +/- 0.84, N = 3 SE +/- 0.47, N = 3 SE +/- 0.26, N = 3 8.46 12.51 21.68 8.53 12.81 31.31 22.60 30.48 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q69) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q69) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.28, N = 3 SE +/- 0.17, N = 4 SE +/- 0.29, N = 3 SE +/- 0.18, N = 4 SE +/- 0.02, N = 3 SE +/- 0.33, N = 3 SE +/- 0.21, N = 2 SE +/- 0.42, N = 3 11.07 13.82 20.28 10.95 13.97 26.76 20.17 26.08 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q70) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q70) 1 10 50 100 500 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.14, N = 4 SE +/- 0.35, N = 3 SE +/- 0.15, N = 3 SE +/- 0.32, N = 3 SE +/- 0.83, N = 3 SE +/- 0.53, N = 3 SE +/- 1.37, N = 3 10.29 13.44 23.76 10.35 13.71 35.15 22.95 35.88 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q71) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q71) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.08, N = 3 SE +/- 0.21, N = 4 SE +/- 1.15, N = 2 SE +/- 0.10, N = 4 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.38, N = 3 SE +/- 0.82, N = 3 8.99 13.12 22.27 9.04 12.71 31.44 23.19 30.91 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q72) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q72) 1 10 50 100 100 200 300 400 500 SE +/- 0.12, N = 3 SE +/- 1.21, N = 4 SE +/- 5.27, N = 3 SE +/- 0.25, N = 4 SE +/- 0.40, N = 3 SE +/- 1.63, N = 3 SE +/- 11.04, N = 3 19.61 118.28 445.11 19.11 118.08 135.02 419.79 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q73) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q73) 1 10 50 100 500 5 10 15 20 25 SE +/- 0.07, N = 3 SE +/- 0.10, N = 4 SE +/- 0.02, N = 2 SE +/- 0.05, N = 4 SE +/- 0.06, N = 3 SE +/- 0.46, N = 3 SE +/- 0.08, N = 3 SE +/- 0.37, N = 3 8.30 11.19 16.29 8.31 11.15 21.92 16.65 21.30 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q74) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q74) 1 10 50 100 30 60 90 120 150 SE +/- 0.08, N = 3 SE +/- 0.13, N = 4 SE +/- 1.15, N = 3 SE +/- 0.05, N = 4 SE +/- 0.09, N = 3 SE +/- 1.38, N = 3 SE +/- 0.64, N = 3 11.72 19.80 97.52 11.95 19.74 112.49 95.45 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q75) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q75) 1 10 50 100 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 0.35, N = 4 SE +/- 0.38, N = 3 SE +/- 0.13, N = 4 SE +/- 0.38, N = 3 SE +/- 0.98, N = 3 SE +/- 1.20, N = 3 14.43 27.49 59.60 14.26 27.04 96.42 59.37 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q76) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q76) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.03, N = 2 SE +/- 0.21, N = 3 SE +/- 0.40, N = 3 SE +/- 0.10, N = 4 SE +/- 0.13, N = 2 SE +/- 0.17, N = 3 SE +/- 0.40, N = 3 SE +/- 0.72, N = 3 8.82 12.52 20.50 8.78 12.30 29.14 20.59 28.59 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q77) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q77) 1 10 50 100 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.24, N = 4 SE +/- 0.16, N = 3 SE +/- 0.05, N = 4 SE +/- 0.15, N = 3 SE +/- 0.30, N = 3 SE +/- 0.31, N = 3 11.24 15.25 24.66 11.39 14.57 33.67 24.24 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q78) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q78) 1 10 50 100 40 80 120 160 200 SE +/- 0.08, N = 3 SE +/- 0.31, N = 4 SE +/- 0.64, N = 3 SE +/- 0.07, N = 4 SE +/- 0.13, N = 3 SE +/- 2.62, N = 3 SE +/- 2.63, N = 3 14.03 44.14 145.29 14.33 43.40 186.01 145.20 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q79) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q79) 1 10 50 100 500 7 14 21 28 35 SE +/- 0.19, N = 3 SE +/- 0.14, N = 4 SE +/- 0.10, N = 3 SE +/- 0.06, N = 4 SE +/- 0.05, N = 3 SE +/- 0.27, N = 3 SE +/- 0.08, N = 3 SE +/- 0.49, N = 3 8.51 11.91 21.24 8.44 11.99 30.33 21.04 30.27 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q80) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q80) 1 10 50 100 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 0.46, N = 4 SE +/- 2.12, N = 3 SE +/- 0.10, N = 4 SE +/- 0.75, N = 3 SE +/- 1.28, N = 3 SE +/- 1.43, N = 3 13.45 48.08 154.53 13.52 47.18 100.24 154.37 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q81) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q81) 1 10 50 100 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.42, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.23, N = 3 SE +/- 0.16, N = 3 8.76 11.54 15.86 8.87 11.46 18.70 15.60 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q82) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q82) 1 10 50 100 500 9 18 27 36 45 SE +/- 0.10, N = 2 SE +/- 0.22, N = 4 SE +/- 0.08, N = 3 SE +/- 0.07, N = 4 SE +/- 0.19, N = 3 SE +/- 0.16, N = 3 SE +/- 0.80, N = 3 SE +/- 0.43, N = 3 8.88 16.99 40.31 8.86 16.64 26.06 38.46 26.02 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q83) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q83) 1 10 50 100 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.11, N = 4 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.23, N = 3 SE +/- 0.25, N = 3 SE +/- 0.04, N = 3 9.21 10.74 13.63 9.24 10.79 15.75 13.26 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q84) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q84) 1 10 50 100 500 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.07, N = 4 SE +/- 0.21, N = 3 SE +/- 0.05, N = 4 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 7.13 9.13 11.68 7.30 9.15 13.57 11.70 13.55 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q85) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q85) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.03, N = 4 SE +/- 0.28, N = 3 SE +/- 0.19, N = 3 SE +/- 0.29, N = 3 SE +/- 0.30, N = 3 SE +/- 0.47, N = 2 SE +/- 0.20, N = 3 12.00 14.85 19.59 11.86 14.56 25.23 20.22 24.60 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q86) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q86) 1 10 50 100 500 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.04, N = 4 SE +/- 0.31, N = 3 SE +/- 0.11, N = 4 SE +/- 0.23, N = 3 SE +/- 0.31, N = 3 SE +/- 0.23, N = 3 SE +/- 0.13, N = 3 8.13 9.17 12.23 8.04 9.28 15.57 12.30 15.40 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q87) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q87) 1 10 50 100 500 15 30 45 60 75 SE +/- 0.01, N = 3 SE +/- 0.72, N = 3 SE +/- 0.51, N = 3 SE +/- 0.05, N = 4 SE +/- 0.23, N = 3 SE +/- 0.15, N = 3 SE +/- 0.36, N = 3 SE +/- 0.70, N = 3 10.09 17.66 44.42 10.07 18.04 67.97 43.60 68.19 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q88) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q88) 1 10 50 100 500 13 26 39 52 65 SE +/- 0.14, N = 2 SE +/- 0.39, N = 4 SE +/- 0.85, N = 3 SE +/- 0.12, N = 3 SE +/- 0.21, N = 3 SE +/- 1.29, N = 3 SE +/- 1.14, N = 3 SE +/- 0.43, N = 3 11.83 17.18 36.30 11.39 17.48 55.68 36.14 53.70 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q89) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q89) 1 10 50 100 500 6 12 18 24 30 SE +/- 0.01, N = 2 SE +/- 0.10, N = 4 SE +/- 0.22, N = 3 SE +/- 0.10, N = 4 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 SE +/- 0.51, N = 3 SE +/- 0.42, N = 3 8.70 11.01 17.65 8.81 10.78 23.22 17.70 23.46 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q90) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q90) 1 10 50 100 500 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.03, N = 4 SE +/- 0.37, N = 3 SE +/- 0.06, N = 4 SE +/- 0.13, N = 3 SE +/- 0.43, N = 3 SE +/- 0.37, N = 3 SE +/- 0.31, N = 3 6.76 7.46 9.97 6.63 7.52 12.11 9.82 12.10 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q91) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q91) 1 10 50 100 3 6 9 12 15 SE +/- 0.04, N = 2 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.06, N = 4 SE +/- 0.25, N = 2 SE +/- 0.17, N = 3 SE +/- 0.27, N = 3 8.32 9.78 10.92 8.19 10.00 12.21 10.73 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q92) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q92) 1 10 50 100 500 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.05, N = 4 SE +/- 0.07, N = 3 SE +/- 0.08, N = 4 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.43, N = 3 SE +/- 0.44, N = 3 7.58 9.07 12.35 7.79 9.01 16.24 13.18 16.04 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q94) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q94) 1 10 50 100 7 14 21 28 35 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.33, N = 3 SE +/- 0.03, N = 4 SE +/- 0.09, N = 3 SE +/- 0.28, N = 3 SE +/- 0.44, N = 3 6.11 9.93 19.04 6.09 10.12 27.97 18.96 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q95) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q95) 1 10 50 100 6 12 18 24 30 SE +/- 0.08, N = 3 SE +/- 0.09, N = 4 SE +/- 0.36, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 2 7.46 10.21 18.23 7.26 10.16 26.65 18.10 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q96) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q96) 1 10 50 100 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 4 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.19, N = 3 5.75 7.16 10.91 5.73 6.64 13.53 10.18 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q97) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q97) 1 10 50 100 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.17, N = 4 SE +/- 0.27, N = 3 SE +/- 0.06, N = 4 SE +/- 0.33, N = 3 SE +/- 0.24, N = 3 SE +/- 0.11, N = 3 9.71 16.99 48.41 9.83 17.23 78.07 47.08 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q59) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q59) 1 10 50 100 500 8 16 24 32 40 SE +/- 0.15, N = 2 SE +/- 0.10, N = 4 SE +/- 0.13, N = 3 SE +/- 0.04, N = 4 SE +/- 0.23, N = 2 SE +/- 0.85, N = 3 SE +/- 0.53, N = 3 SE +/- 1.04, N = 3 9.09 13.10 24.11 9.11 12.51 36.21 25.24 36.06 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q93) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q93) 1 10 50 100 30 60 90 120 150 SE +/- 0.02, N = 2 SE +/- 0.26, N = 4 SE +/- 0.71, N = 3 SE +/- 0.04, N = 3 SE +/- 0.41, N = 3 SE +/- 1.70, N = 3 SE +/- 2.38, N = 3 7.71 27.15 85.82 7.75 27.07 140.11 85.15 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q98) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q98) 1 10 50 100 1.2015 2.403 3.6045 4.806 6.0075 SE +/- 0.02, N = 2 SE +/- 0.02, N = 4 SE +/- 0.04, N = 3 SE +/- 0.02, N = 4 SE +/- 0.08, N = 2 SE +/- 0.05, N = 3 SE +/- 0.14, N = 2 4.87 5.00 5.16 4.85 5.04 5.34 5.26 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q99) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q99) 1 10 50 100 5 10 15 20 25 SE +/- 0.22, N = 2 SE +/- 0.36, N = 3 SE +/- 0.29, N = 3 SE +/- 0.02, N = 2 SE +/- 0.16, N = 3 SE +/- 0.64, N = 2 SE +/- 0.13, N = 3 7.83 10.23 16.26 7.62 10.20 22.45 16.37 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 10) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 10) Q01 Q02 Q03 Q04 Q05 Q06 Q07 Q08 Q09 Q10 Q11 Q12 Q13 Q14 Q15 Q17 Q18 Q19 Q20 Q21 Q22 Q23 Q24 Q25 Q26 Q27 Q28 Q29 Q30 Q31 Q32 Q33 Q34 Q35 Q36 Q37 Q38 Q39 Q40 Q41 Q42 Q43 Q44 Q45 Q46 Q47 Q48 Q49 Q50 Q51 Q52 Q53 Q54 Q55 Q56 Q57 Q58 Q59 Q60 Q61 Q62 Q63 Q64 Q65 Q66 Q67 Q68 Q69 Q70 Q71 Q72 Q73 Q74 Q75 Q76 Q77 Q78 Q79 Q80 Q81 Q82 Q83 Q84 Q85 Q86 Q87 Q88 Q89 Q90 Q91 Q92 Q93 Q94 Q95 Q96 Q97 Q98 Q99 30 60 90 120 150 SE +/- 0.14, N = 4 SE +/- 0.25, N = 4 SE +/- 0.03, N = 4 SE +/- 0.36, N = 4 SE +/- 0.37, N = 4 SE +/- 0.14, N = 4 SE +/- 0.32, N = 4 SE +/- 0.13, N = 4 SE +/- 0.10, N = 4 SE +/- 0.12, N = 4 SE +/- 0.27, N = 4 SE +/- 0.04, N = 4 SE +/- 0.16, N = 4 SE +/- 0.35, N = 4 SE +/- 0.21, N = 4 SE +/- 0.36, N = 4 SE +/- 0.12, N = 4 SE +/- 0.21, N = 4 SE +/- 0.03, N = 4 SE +/- 0.17, N = 4 SE +/- 0.40, N = 4 SE +/- 0.43, N = 4 SE +/- 0.11, N = 4 SE +/- 0.27, N = 4 SE +/- 0.27, N = 4 SE +/- 0.20, N = 4 SE +/- 0.21, N = 4 SE +/- 0.41, N = 4 SE +/- 0.06, N = 4 SE +/- 0.26, N = 3 SE +/- 0.25, N = 4 SE +/- 0.16, N = 4 SE +/- 0.22, N = 3 SE +/- 0.12, N = 4 SE +/- 0.13, N = 4 SE +/- 0.27, N = 4 SE +/- 0.28, N = 4 SE +/- 0.31, N = 4 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.06, N = 4 SE +/- 0.09, N = 4 SE +/- 0.04, N = 4 SE +/- 0.13, N = 4 SE +/- 0.16, N = 4 SE +/- 0.16, N = 4 SE +/- 0.10, N = 4 SE +/- 0.11, N = 4 SE +/- 0.25, N = 4 SE +/- 0.18, N = 4 SE +/- 0.10, N = 4 SE +/- 0.08, N = 4 SE +/- 0.07, N = 4 SE +/- 0.14, N = 4 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.09, N = 4 SE +/- 0.10, N = 4 SE +/- 0.34, N = 4 SE +/- 0.05, N = 4 SE +/- 0.10, N = 4 SE +/- 0.13, N = 4 SE +/- 0.32, N = 4 SE +/- 0.84, N = 4 SE +/- 0.18, N = 4 SE +/- 0.13, N = 4 SE +/- 0.14, N = 4 SE +/- 0.17, N = 4 SE +/- 0.14, N = 4 SE +/- 0.21, N = 4 SE +/- 1.21, N = 4 SE +/- 0.10, N = 4 SE +/- 0.13, N = 4 SE +/- 0.35, N = 4 SE +/- 0.21, N = 3 SE +/- 0.24, N = 4 SE +/- 0.31, N = 4 SE +/- 0.14, N = 4 SE +/- 0.46, N = 4 SE +/- 0.17, N = 3 SE +/- 0.22, N = 4 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.03, N = 4 SE +/- 0.04, N = 4 SE +/- 0.72, N = 3 SE +/- 0.39, N = 4 SE +/- 0.10, N = 4 SE +/- 0.03, N = 4 SE +/- 0.02, N = 3 SE +/- 0.05, N = 4 SE +/- 0.26, N = 4 SE +/- 0.08, N = 3 SE +/- 0.09, N = 4 SE +/- 0.25, N = 3 SE +/- 0.17, N = 4 SE +/- 0.02, N = 4 SE +/- 0.36, N = 3 SE +/- 0.02, N = 3 SE +/- 0.36, N = 3 SE +/- 0.17, N = 3 SE +/- 0.31, N = 3 SE +/- 0.60, N = 3 SE +/- 0.30, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 SE +/- 0.37, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.58, N = 3 SE +/- 0.19, N = 3 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.22, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.14, N = 3 SE +/- 0.46, N = 3 SE +/- 0.64, N = 3 SE +/- 0.79, N = 3 SE +/- 0.29, N = 3 SE +/- 0.27, N = 2 SE +/- 0.51, N = 3 SE +/- 0.40, N = 3 SE +/- 0.16, N = 3 SE +/- 0.63, N = 3 SE +/- 0.14, N = 3 SE +/- 0.26, N = 3 SE +/- 0.46, N = 3 SE +/- 0.93, N = 3 SE +/- 0.63, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.26, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.34, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.17, N = 2 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.42, N = 3 SE +/- 0.19, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.34, N = 3 SE +/- 0.23, N = 2 SE +/- 0.51, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.24, N = 3 SE +/- 0.51, N = 3 SE +/- 0.21, N = 3 SE +/- 0.16, N = 3 SE +/- 0.11, N = 3 SE +/- 0.27, N = 3 SE +/- 0.02, N = 3 SE +/- 0.32, N = 3 SE +/- 0.02, N = 3 SE +/- 0.40, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.38, N = 3 SE +/- 0.13, N = 2 SE +/- 0.15, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.75, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.23, N = 3 SE +/- 0.14, N = 3 SE +/- 0.29, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.25, N = 2 SE +/- 0.16, N = 3 SE +/- 0.41, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.33, N = 3 SE +/- 0.08, N = 2 SE +/- 0.16, N = 3 11.29 11.32 8.48 50.14 23.85 18.81 12.58 11.83 12.05 14.14 35.77 5.14 11.80 22.76 10.39 35.11 13.78 11.81 5.09 12.54 26.57 33.00 17.46 35.36 10.32 12.92 17.46 35.87 11.91 18.64 9.74 14.10 11.91 15.91 11.92 13.82 17.69 10.42 17.68 7.17 8.69 8.55 6.54 9.76 12.66 19.10 10.49 18.93 22.00 26.32 8.76 9.75 16.97 8.63 13.02 16.48 13.84 13.10 14.21 7.10 9.19 9.55 51.48 18.64 14.03 33.19 12.51 13.82 13.44 13.12 118.28 11.19 19.80 27.49 12.52 15.25 44.14 11.91 48.08 11.54 16.99 10.74 9.13 14.85 9.17 17.66 17.18 11.01 7.46 9.78 9.07 27.15 9.93 10.21 7.16 16.99 5.00 10.23 11.23 11.63 9.02 48.88 23.38 19.40 12.76 11.84 11.83 14.33 35.90 5.14 11.43 22.19 10.33 34.68 13.81 11.15 5.05 12.10 26.94 33.70 16.79 35.47 10.48 13.43 17.54 34.69 11.90 19.33 9.38 13.60 12.04 16.57 12.48 13.36 17.41 10.75 17.38 7.09 8.44 8.42 6.40 9.84 12.47 19.08 10.00 19.51 21.90 26.28 8.65 9.46 17.07 8.70 12.80 16.38 14.74 12.51 14.32 7.03 8.98 9.83 50.33 18.12 13.75 32.61 12.81 13.97 13.71 12.71 118.08 11.15 19.74 27.04 12.30 14.57 43.40 11.99 47.18 11.46 16.64 10.79 9.15 14.56 9.28 18.04 17.48 10.78 7.52 10.00 9.01 27.07 10.12 10.16 6.64 17.23 5.04 10.20 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 50) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 50) Q01 Q02 Q03 Q04 Q05 Q06 Q07 Q08 Q09 Q10 Q11 Q12 Q13 Q14 Q15 Q17 Q18 Q19 Q20 Q21 Q22 Q23 Q24 Q25 Q26 Q27 Q28 Q29 Q30 Q31 Q32 Q33 Q34 Q35 Q36 Q37 Q38 Q39 Q40 Q41 Q42 Q43 Q44 Q45 Q46 Q47 Q48 Q49 Q50 Q51 Q52 Q53 Q54 Q55 Q56 Q57 Q58 Q59 Q60 Q61 Q62 Q63 Q64 Q65 Q66 Q67 Q68 Q69 Q70 Q71 Q72 Q73 Q74 Q75 Q76 Q77 Q78 Q79 Q80 Q81 Q82 Q83 Q84 Q85 Q86 Q87 Q88 Q89 Q90 Q91 Q92 Q93 Q94 Q95 Q96 Q97 Q98 Q99 100 200 300 400 500 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.08, N = 3 SE +/- 0.56, N = 3 SE +/- 0.56, N = 3 SE +/- 0.91, N = 3 SE +/- 0.48, N = 3 SE +/- 0.44, N = 3 SE +/- 0.25, N = 3 SE +/- 0.37, N = 3 SE +/- 0.28, N = 3 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.35, N = 3 SE +/- 0.24, N = 3 SE +/- 1.40, N = 3 SE +/- 0.20, N = 3 SE +/- 0.18, N = 3 SE +/- 0.08, N = 3 SE +/- 0.26, N = 3 SE +/- 0.54, N = 3 SE +/- 1.35, N = 3 SE +/- 0.49, N = 3 SE +/- 1.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.47, N = 3 SE +/- 0.48, N = 3 SE +/- 1.14, N = 3 SE +/- 0.32, N = 3 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 SE +/- 0.40, N = 3 SE +/- 0.09, N = 3 SE +/- 0.27, N = 3 SE +/- 0.71, N = 3 SE +/- 0.18, N = 3 SE +/- 0.66, N = 3 SE +/- 0.36, N = 3 SE +/- 0.58, N = 3 SE +/- 0.10, N = 3 SE +/- 0.30, N = 3 SE +/- 0.34, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.27, N = 3 SE +/- 0.22, N = 3 SE +/- 0.24, N = 3 SE +/- 0.37, N = 3 SE +/- 0.37, N = 3 SE +/- 0.66, N = 3 SE +/- 0.36, N = 3 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.60, N = 3 SE +/- 0.54, N = 3 SE +/- 0.13, N = 3 SE +/- 0.32, N = 3 SE +/- 0.39, N = 2 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 1.53, N = 3 SE +/- 0.84, N = 3 SE +/- 0.17, N = 2 SE +/- 0.63, N = 3 SE +/- 0.18, N = 3 SE +/- 0.29, N = 3 SE +/- 0.35, N = 3 SE +/- 1.15, N = 2 SE +/- 5.27, N = 3 SE +/- 0.02, N = 2 SE +/- 1.15, N = 3 SE +/- 0.38, N = 3 SE +/- 0.40, N = 3 SE +/- 0.16, N = 3 SE +/- 0.64, N = 3 SE +/- 0.10, N = 3 SE +/- 2.12, N = 3 SE +/- 0.42, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.21, N = 3 SE +/- 0.28, N = 3 SE +/- 0.31, N = 3 SE +/- 0.51, N = 3 SE +/- 0.85, N = 3 SE +/- 0.22, N = 3 SE +/- 0.37, N = 3 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 SE +/- 0.71, N = 3 SE +/- 0.33, N = 3 SE +/- 0.36, N = 3 SE +/- 0.08, N = 3 SE +/- 0.27, N = 3 SE +/- 0.04, N = 3 SE +/- 0.29, N = 3 SE +/- 0.20, N = 3 SE +/- 0.09, N = 3 SE +/- 0.28, N = 3 SE +/- 0.72, N = 3 SE +/- 1.08, N = 3 SE +/- 0.46, N = 3 SE +/- 0.21, N = 3 SE +/- 0.26, N = 3 SE +/- 0.16, N = 3 SE +/- 0.15, N = 3 SE +/- 0.53, N = 3 SE +/- 0.13, N = 3 SE +/- 0.17, N = 3 SE +/- 2.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.43, N = 3 SE +/- 0.21, N = 3 SE +/- 0.37, N = 3 SE +/- 0.02, N = 3 SE +/- 0.34, N = 3 SE +/- 0.38, N = 3 SE +/- 1.31, N = 3 SE +/- 0.08, N = 3 SE +/- 0.72, N = 3 SE +/- 0.30, N = 3 SE +/- 0.39, N = 3 SE +/- 0.66, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 SE +/- 0.41, N = 3 SE +/- 0.41, N = 3 SE +/- 0.37, N = 3 SE +/- 0.11, N = 3 SE +/- 0.22, N = 3 SE +/- 0.63, N = 3 SE +/- 0.11, N = 3 SE +/- 0.89, N = 3 SE +/- 0.36, N = 3 SE +/- 0.37, N = 3 SE +/- 0.06, N = 3 SE +/- 0.34, N = 3 SE +/- 0.30, N = 3 SE +/- 0.09, N = 3 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 SE +/- 0.40, N = 3 SE +/- 0.32, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.65, N = 3 SE +/- 0.10, N = 3 SE +/- 0.25, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 SE +/- 0.03, N = 3 SE +/- 0.28, N = 3 SE +/- 0.53, N = 3 SE +/- 0.21, N = 3 SE +/- 0.13, N = 3 SE +/- 0.27, N = 3 SE +/- 0.06, N = 2 SE +/- 3.02, N = 3 SE +/- 0.48, N = 3 SE +/- 0.24, N = 3 SE +/- 0.51, N = 3 SE +/- 0.47, N = 3 SE +/- 0.21, N = 2 SE +/- 0.53, N = 3 SE +/- 0.38, N = 3 SE +/- 11.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.64, N = 3 SE +/- 1.20, N = 3 SE +/- 0.40, N = 3 SE +/- 0.31, N = 3 SE +/- 2.63, N = 3 SE +/- 0.08, N = 3 SE +/- 1.43, N = 3 SE +/- 0.16, N = 3 SE +/- 0.80, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.47, N = 2 SE +/- 0.23, N = 3 SE +/- 0.36, N = 3 SE +/- 1.14, N = 3 SE +/- 0.51, N = 3 SE +/- 0.37, N = 3 SE +/- 0.27, N = 3 SE +/- 0.43, N = 3 SE +/- 2.38, N = 3 SE +/- 0.44, N = 3 SE +/- 0.17, N = 2 SE +/- 0.19, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 2 SE +/- 0.13, N = 3 15.85 17.55 14.18 154.31 43.17 49.09 21.52 17.20 24.13 20.16 103.28 5.27 19.78 75.66 17.77 119.35 20.87 18.23 5.21 15.80 36.12 178.13 57.15 112.65 16.02 22.10 42.77 118.41 15.98 35.80 14.40 22.31 17.68 25.60 22.14 22.76 43.19 15.19 42.82 7.37 13.56 14.17 7.74 13.15 22.29 33.34 16.97 40.27 50.08 59.46 13.59 15.36 37.77 13.93 20.67 24.44 24.38 24.11 23.59 7.70 12.97 15.01 170.85 42.42 20.07 106.61 21.68 20.28 23.76 22.27 445.11 16.29 97.52 59.60 20.50 24.66 145.29 21.24 154.53 15.86 40.31 13.63 11.68 19.59 12.23 44.42 36.30 17.65 9.97 10.92 12.35 85.82 19.04 18.23 10.91 48.41 5.16 16.26 15.41 17.58 14.12 153.78 43.74 47.67 20.72 17.27 24.46 20.24 101.84 5.21 19.45 77.16 17.59 119.31 21.41 17.89 5.27 15.83 36.66 173.15 56.78 109.51 16.23 20.69 41.62 117.34 16.04 33.52 15.29 22.00 17.91 25.07 22.39 22.74 43.48 15.19 41.43 7.28 13.25 13.77 7.84 13.46 21.87 33.73 16.67 39.34 49.36 58.63 13.22 14.94 36.96 13.60 21.10 24.78 24.20 25.24 22.57 7.65 12.61 14.73 165.96 42.69 20.62 106.30 22.60 20.17 22.95 23.19 419.79 16.65 95.45 59.37 20.59 24.24 145.20 21.04 154.37 15.60 38.46 13.26 11.70 20.22 12.30 43.60 36.14 17.70 9.82 10.73 13.18 85.15 18.96 18.10 10.18 47.08 5.26 16.37 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 100) OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 100) Q01 Q02 Q03 Q04 Q05 Q06 Q07 Q08 Q09 Q10 Q11 Q12 Q13 Q14 Q15 Q17 Q18 Q19 Q20 Q21 Q22 Q23 Q24 Q25 Q26 Q27 Q28 Q29 Q30 Q31 Q32 Q33 Q34 Q35 Q36 Q37 Q38 Q39 Q40 Q41 Q42 Q43 Q44 Q45 Q46 Q47 Q48 Q49 Q50 Q51 Q52 Q53 Q54 Q55 Q56 Q57 Q58 Q59 Q60 Q61 Q62 Q63 Q64 Q65 Q66 Q67 Q68 Q69 Q70 Q71 Q72 Q73 Q74 Q75 Q76 Q77 Q78 Q79 Q80 Q81 Q82 Q83 Q84 Q85 Q86 Q87 Q88 Q89 Q90 Q91 Q92 Q93 Q94 Q95 Q96 Q97 Q98 Q99 50 100 150 200 250 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 SE +/- 0.20, N = 3 SE +/- 1.16, N = 3 SE +/- 0.44, N = 3 SE +/- 0.17, N = 3 SE +/- 0.64, N = 3 SE +/- 0.28, N = 3 SE +/- 0.49, N = 3 SE +/- 0.08, N = 3 SE +/- 0.56, N = 3 SE +/- 0.08, N = 3 SE +/- 0.50, N = 3 SE +/- 2.66, N = 3 SE +/- 0.30, N = 3 SE +/- 0.40, N = 3 SE +/- 0.54, N = 3 SE +/- 0.67, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.29, N = 3 SE +/- 0.08, N = 3 SE +/- 0.74, N = 3 SE +/- 0.33, N = 3 SE +/- 0.57, N = 3 SE +/- 0.26, N = 3 SE +/- 2.08, N = 3 SE +/- 0.23, N = 3 SE +/- 0.28, N = 3 SE +/- 0.70, N = 3 SE +/- 0.17, N = 3 SE +/- 0.45, N = 3 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.49, N = 3 SE +/- 0.24, N = 3 SE +/- 0.66, N = 3 SE +/- 1.30, N = 3 SE +/- 0.17, N = 2 SE +/- 0.04, N = 3 SE +/- 0.15, N = 3 SE +/- 0.17, N = 2 SE +/- 0.66, N = 3 SE +/- 0.16, N = 3 SE +/- 0.26, N = 3 SE +/- 0.31, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.82, N = 3 SE +/- 1.20, N = 3 SE +/- 0.18, N = 3 SE +/- 0.21, N = 3 SE +/- 0.19, N = 3 SE +/- 0.36, N = 3 SE +/- 0.32, N = 3 SE +/- 0.74, N = 3 SE +/- 0.53, N = 3 SE +/- 0.85, N = 3 SE +/- 0.71, N = 3 SE +/- 0.16, N = 3 SE +/- 0.22, N = 3 SE +/- 0.33, N = 3 SE +/- 2.48, N = 3 SE +/- 1.31, N = 3 SE +/- 0.44, N = 3 SE +/- 1.23, N = 3 SE +/- 0.84, N = 3 SE +/- 0.33, N = 3 SE +/- 0.83, N = 3 SE +/- 0.15, N = 3 SE +/- 1.63, N = 3 SE +/- 0.46, N = 3 SE +/- 1.38, N = 3 SE +/- 0.98, N = 3 SE +/- 0.17, N = 3 SE +/- 0.30, N = 3 SE +/- 2.62, N = 3 SE +/- 0.27, N = 3 SE +/- 1.28, N = 3 SE +/- 0.23, N = 3 SE +/- 0.16, N = 3 SE +/- 0.25, N = 3 SE +/- 0.03, N = 3 SE +/- 0.30, N = 3 SE +/- 0.31, N = 3 SE +/- 0.15, N = 3 SE +/- 1.29, N = 3 SE +/- 0.16, N = 3 SE +/- 0.43, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 SE +/- 1.70, N = 3 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.24, N = 3 SE +/- 0.05, N = 3 SE +/- 0.64, N = 2 20.13 27.55 19.51 192.45 66.74 23.74 29.32 22.24 41.19 27.59 121.65 5.22 28.19 101.62 26.19 42.92 27.88 25.57 5.32 20.57 60.75 223.12 39.99 41.97 20.44 28.46 68.17 47.47 19.51 51.49 22.65 29.17 23.95 36.60 31.04 20.99 67.38 22.77 24.08 7.29 17.72 18.71 25.22 16.86 30.04 50.05 23.00 44.00 81.06 101.72 18.87 20.06 33.83 18.22 27.59 31.67 35.61 36.21 30.69 7.51 15.66 19.93 151.38 73.38 27.68 205.56 31.31 26.76 35.15 31.44 135.02 21.92 112.49 96.42 29.14 33.67 186.01 30.33 100.24 18.70 26.06 15.75 13.57 25.23 15.57 67.97 55.68 23.22 12.11 12.21 16.24 140.11 27.97 26.65 13.53 78.07 5.34 22.45 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 500) OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 500) Q02 Q03 Q06 Q07 Q08 Q09 Q10 Q12 Q13 Q14 Q15 Q17 Q18 Q19 Q20 Q21 Q22 Q25 Q26 Q27 Q28 Q30 Q31 Q32 Q33 Q34 Q35 Q36 Q37 Q38 Q39 Q41 Q42 Q43 Q44 Q45 Q46 Q47 Q48 Q52 Q53 Q54 Q55 Q56 Q57 Q58 Q59 Q60 Q61 Q62 Q63 Q66 Q68 Q69 Q70 Q71 Q73 Q76 Q79 Q82 Q84 Q85 Q86 Q87 Q88 Q89 Q90 Q92 20 40 60 80 100 SE +/- 0.07, N = 2 SE +/- 0.21, N = 2 SE +/- 0.05, N = 2 SE +/- 1.17, N = 2 SE +/- 0.13, N = 2 SE +/- 0.61, N = 2 SE +/- 1.72, N = 2 SE +/- 0.09, N = 2 SE +/- 0.38, N = 2 SE +/- 1.32, N = 3 SE +/- 0.11, N = 3 SE +/- 0.71, N = 3 SE +/- 0.23, N = 3 SE +/- 0.52, N = 3 SE +/- 0.02, N = 2 SE +/- 0.28, N = 3 SE +/- 0.40, N = 3 SE +/- 0.28, N = 3 SE +/- 0.61, N = 3 SE +/- 0.46, N = 3 SE +/- 0.64, N = 3 SE +/- 0.06, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.28, N = 3 SE +/- 0.57, N = 3 SE +/- 0.33, N = 3 SE +/- 0.18, N = 3 SE +/- 0.37, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.32, N = 3 SE +/- 0.23, N = 3 SE +/- 0.37, N = 3 SE +/- 0.29, N = 3 SE +/- 0.43, N = 3 SE +/- 0.27, N = 3 SE +/- 0.29, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 2 SE +/- 0.34, N = 3 SE +/- 0.14, N = 3 SE +/- 0.61, N = 3 SE +/- 1.31, N = 3 SE +/- 1.04, N = 3 SE +/- 0.70, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.31, N = 3 SE +/- 0.43, N = 3 SE +/- 0.26, N = 3 SE +/- 0.42, N = 3 SE +/- 1.37, N = 3 SE +/- 0.82, N = 3 SE +/- 0.37, N = 3 SE +/- 0.72, N = 3 SE +/- 0.49, N = 3 SE +/- 0.43, N = 3 SE +/- 0.08, N = 3 SE +/- 0.20, N = 3 SE +/- 0.13, N = 3 SE +/- 0.70, N = 3 SE +/- 0.43, N = 3 SE +/- 0.42, N = 3 SE +/- 0.31, N = 3 SE +/- 0.44, N = 3 27.90 19.48 23.61 27.83 22.66 39.80 27.69 5.23 28.72 100.36 26.11 43.55 27.73 25.80 5.22 21.02 61.50 41.30 20.59 29.86 67.04 18.89 49.00 22.59 29.04 22.81 36.50 30.73 21.40 68.08 24.99 7.32 17.61 19.23 25.03 16.90 29.87 49.44 23.13 19.14 19.96 33.99 17.95 28.05 31.63 34.21 36.06 31.17 7.71 15.61 19.86 27.08 30.48 26.08 35.88 30.91 21.30 28.59 30.27 26.02 13.55 24.60 15.40 68.19 53.70 23.46 12.10 16.04 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-H Scale Factor Comparison (Geometric Mean Of All Queries) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Geometric Mean Of All Queries) 1 1.0584 2.1168 3.1752 4.2336 5.292 SE +/- 0.02205715, N = 3 SE +/- 0.03832583, N = 8 4.70394366 4.58796121
Apache Spark TPC-H Comparison (Scale Factor: 1) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Comparison (Scale Factor: 1) Geometric Mean Of All Queries Q01 Q02 Q03 Q04 Q05 Q06 Q07 Q08 Q09 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 Q19 Q20 Q21 Q22 4 8 12 16 20 SE +/- 0.02205715, N = 3 SE +/- 0.17776740, N = 3 SE +/- 0.06585723, N = 3 SE +/- 0.17085945, N = 3 SE +/- 0.15831346, N = 3 SE +/- 0.08288138, N = 3 SE +/- 0.06400088, N = 3 SE +/- 0.01424190, N = 3 SE +/- 0.07990249, N = 3 SE +/- 0.03195754, N = 3 SE +/- 0.12475642, N = 3 SE +/- 0.00889576, N = 3 SE +/- 0.07812445, N = 3 SE +/- 0.05404231, N = 3 SE +/- 0.09844103, N = 3 SE +/- 0.01587727, N = 3 SE +/- 0.04807800, N = 3 SE +/- 0.11188602, N = 3 SE +/- 0.02944973, N = 3 SE +/- 0.08247514, N = 3 SE +/- 0.16740673, N = 3 SE +/- 0.45650715, N = 3 SE +/- 0.05419067, N = 3 SE +/- 0.03832583, N = 8 SE +/- 0.10385415, N = 8 SE +/- 0.10497115, N = 8 SE +/- 0.07160103, N = 8 SE +/- 0.15490647, N = 8 SE +/- 0.06264325, N = 8 SE +/- 0.02204410, N = 8 SE +/- 0.12029949, N = 8 SE +/- 0.01870892, N = 8 SE +/- 0.06360940, N = 8 SE +/- 0.08702141, N = 8 SE +/- 0.02504461, N = 8 SE +/- 0.07037349, N = 8 SE +/- 0.02994103, N = 8 SE +/- 0.08797017, N = 8 SE +/- 0.02096419, N = 8 SE +/- 0.04873253, N = 8 SE +/- 0.05677966, N = 8 SE +/- 0.15655408, N = 8 SE +/- 0.04107179, N = 8 SE +/- 0.02853109, N = 8 SE +/- 0.09251555, N = 8 SE +/- 0.40940044, N = 8 4.70394366 8.99111398 5.12156471 6.21926069 6.35284599 6.45101420 3.14496096 5.67845901 5.12595320 8.09893131 5.48864635 2.22946509 4.41146898 3.30999152 3.48376338 3.73393631 2.36529143 7.48008188 8.85217094 3.45616110 4.95553335 18.00248718 2.63550258 4.58796121 8.89810467 5.17664826 6.01340967 5.94609463 6.25091559 2.87266311 5.71245319 5.01394421 7.73483688 5.45098496 2.23056737 4.26149431 3.00252223 3.41781682 3.52197197 2.37898293 7.14879584 8.63420987 3.26604420 4.59865994 16.83148050 3.25603971
Apache Spark TPC-H Scale Factor Comparison (Q01) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q01) 1 3 6 9 12 15 SE +/- 0.17776740, N = 3 SE +/- 0.10385415, N = 8 8.99111398 8.89810467
Apache Spark TPC-H Scale Factor Comparison (Q02) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q02) 1 1.1647 2.3294 3.4941 4.6588 5.8235 SE +/- 0.06585723, N = 3 SE +/- 0.10497115, N = 8 5.12156471 5.17664826
Apache Spark TPC-H Scale Factor Comparison (Q03) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q03) 1 2 4 6 8 10 SE +/- 0.17085945, N = 3 SE +/- 0.07160103, N = 8 6.21926069 6.01340967
Apache Spark TPC-H Scale Factor Comparison (Q04) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q04) 1 2 4 6 8 10 SE +/- 0.15831346, N = 3 SE +/- 0.15490647, N = 8 6.35284599 5.94609463
Apache Spark TPC-H Scale Factor Comparison (Q05) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q05) 1 2 4 6 8 10 SE +/- 0.08288138, N = 3 SE +/- 0.06264325, N = 8 6.45101420 6.25091559
Apache Spark TPC-H Scale Factor Comparison (Q06) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q06) 1 0.7076 1.4152 2.1228 2.8304 3.538 SE +/- 0.06400088, N = 3 SE +/- 0.02204410, N = 8 3.14496096 2.87266311
Apache Spark TPC-H Scale Factor Comparison (Q07) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q07) 1 1.2853 2.5706 3.8559 5.1412 6.4265 SE +/- 0.01424190, N = 3 SE +/- 0.12029949, N = 8 5.67845901 5.71245319
Apache Spark TPC-H Scale Factor Comparison (Q08) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q08) 1 1.1533 2.3066 3.4599 4.6132 5.7665 SE +/- 0.07990249, N = 3 SE +/- 0.01870892, N = 8 5.12595320 5.01394421
Apache Spark TPC-H Scale Factor Comparison (Q09) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q09) 1 2 4 6 8 10 SE +/- 0.03195754, N = 3 SE +/- 0.06360940, N = 8 8.09893131 7.73483688
Apache Spark TPC-H Scale Factor Comparison (Q10) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q10) 1 1.2349 2.4698 3.7047 4.9396 6.1745 SE +/- 0.12475642, N = 3 SE +/- 0.08702141, N = 8 5.48864635 5.45098496
Apache Spark TPC-H Scale Factor Comparison (Q11) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q11) 1 0.5019 1.0038 1.5057 2.0076 2.5095 SE +/- 0.00889576, N = 3 SE +/- 0.02504461, N = 8 2.22946509 2.23056737
Apache Spark TPC-H Scale Factor Comparison (Q12) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q12) 1 0.9926 1.9852 2.9778 3.9704 4.963 SE +/- 0.07812445, N = 3 SE +/- 0.07037349, N = 8 4.41146898 4.26149431
Apache Spark TPC-H Scale Factor Comparison (Q13) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q13) 1 0.7447 1.4894 2.2341 2.9788 3.7235 SE +/- 0.05404231, N = 3 SE +/- 0.02994103, N = 8 3.30999152 3.00252223
Apache Spark TPC-H Scale Factor Comparison (Q14) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q14) 1 0.7838 1.5676 2.3514 3.1352 3.919 SE +/- 0.09844103, N = 3 SE +/- 0.08797017, N = 8 3.48376338 3.41781682
Apache Spark TPC-H Scale Factor Comparison (Q15) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q15) 1 0.8401 1.6802 2.5203 3.3604 4.2005 SE +/- 0.01587727, N = 3 SE +/- 0.02096419, N = 8 3.73393631 3.52197197
Apache Spark TPC-H Scale Factor Comparison (Q16) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q16) 1 0.5353 1.0706 1.6059 2.1412 2.6765 SE +/- 0.04807800, N = 3 SE +/- 0.04873253, N = 8 2.36529143 2.37898293
Apache Spark TPC-H Scale Factor Comparison (Q17) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q17) 1 2 4 6 8 10 SE +/- 0.11188602, N = 3 SE +/- 0.05677966, N = 8 7.48008188 7.14879584
Apache Spark TPC-H Scale Factor Comparison (Q18) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q18) 1 2 4 6 8 10 SE +/- 0.02944973, N = 3 SE +/- 0.15655408, N = 8 8.85217094 8.63420987
Apache Spark TPC-H Scale Factor Comparison (Q19) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q19) 1 0.7776 1.5552 2.3328 3.1104 3.888 SE +/- 0.08247514, N = 3 SE +/- 0.04107179, N = 8 3.45616110 3.26604420
Apache Spark TPC-H Scale Factor Comparison (Q20) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q20) 1 1.115 2.23 3.345 4.46 5.575 SE +/- 0.16740673, N = 3 SE +/- 0.02853109, N = 8 4.95553335 4.59865994
Apache Spark TPC-H Scale Factor Comparison (Q21) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q21) 1 4 8 12 16 20 SE +/- 0.46, N = 3 SE +/- 0.09, N = 8 18.00 16.83
Apache Spark TPC-H Scale Factor Comparison (Q22) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q22) 1 0.7326 1.4652 2.1978 2.9304 3.663 SE +/- 0.05419067, N = 3 SE +/- 0.40940044, N = 8 2.63550258 3.25603971
Apache CouchDB Bulk Size Comparison (Inserts: 1000 - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Bulk Size Comparison (Inserts: 1000 - Rounds: 30) 100 300 500 150 300 450 600 750 SE +/- 3.82, N = 9 SE +/- 2.78, N = 3 SE +/- 0.74, N = 3 SE +/- 2.31, N = 3 SE +/- 3.79, N = 3 SE +/- 0.51, N = 3 SE +/- 2.80, N = 9 SE +/- 1.83, N = 3 SE +/- 3.77, N = 3 SE +/- 2.59, N = 6 SE +/- 0.91, N = 3 SE +/- 2.58, N = 3 262.44 377.97 464.69 247.76 366.67 438.30 266.25 384.07 676.09 258.52 394.74 679.40 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Inserts Comparison (Bulk Size: 100 - - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Inserts Comparison (Bulk Size: 100 - - Rounds: 30) 1000 3000 200 400 600 800 1000 SE +/- 3.82, N = 9 SE +/- 1.11, N = 3 SE +/- 2.31, N = 3 SE +/- 0.84, N = 3 SE +/- 2.80, N = 9 SE +/- 1.88, N = 3 SE +/- 2.59, N = 6 SE +/- 10.18, N = 3 262.44 887.89 247.76 860.53 266.25 855.61 258.52 871.54 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 100 - Inserts: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 100 - Inserts: 1000) 30 60 120 180 240 300 SE +/- 3.82, N = 9 SE +/- 2.31, N = 3 SE +/- 2.80, N = 9 SE +/- 2.59, N = 6 262.44 247.76 266.25 258.52 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Bulk Size Comparison (Inserts: 3000 - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Bulk Size Comparison (Inserts: 3000 - Rounds: 30) 100 300 500 500 1000 1500 2000 2500 SE +/- 1.11, N = 3 SE +/- 14.88, N = 5 SE +/- 0.87, N = 3 SE +/- 0.84, N = 3 SE +/- 2.19, N = 3 SE +/- 1.95, N = 3 SE +/- 1.88, N = 3 SE +/- 31.00, N = 9 SE +/- 11.33, N = 3 SE +/- 10.18, N = 3 SE +/- 2.59, N = 3 SE +/- 13.77, N = 3 887.89 1412.82 2261.83 860.53 1314.73 2158.52 855.61 1492.53 2083.07 871.54 1444.00 2140.74 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 100 - Inserts: 3000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 100 - Inserts: 3000) 30 200 400 600 800 1000 SE +/- 1.11, N = 3 SE +/- 0.84, N = 3 SE +/- 1.88, N = 3 SE +/- 10.18, N = 3 887.89 860.53 855.61 871.54 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Inserts Comparison (Bulk Size: 300 - - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Inserts Comparison (Bulk Size: 300 - - Rounds: 30) 1000 3000 300 600 900 1200 1500 SE +/- 2.78, N = 3 SE +/- 14.88, N = 5 SE +/- 3.79, N = 3 SE +/- 2.19, N = 3 SE +/- 1.83, N = 3 SE +/- 31.00, N = 9 SE +/- 0.91, N = 3 SE +/- 2.59, N = 3 377.97 1412.82 366.67 1314.73 384.07 1492.53 394.74 1444.00 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 300 - Inserts: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 300 - Inserts: 1000) 30 90 180 270 360 450 SE +/- 2.78, N = 3 SE +/- 3.79, N = 3 SE +/- 1.83, N = 3 SE +/- 0.91, N = 3 377.97 366.67 384.07 394.74 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 300 - Inserts: 3000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 300 - Inserts: 3000) 30 300 600 900 1200 1500 SE +/- 14.88, N = 5 SE +/- 2.19, N = 3 SE +/- 31.00, N = 9 SE +/- 2.59, N = 3 1412.82 1314.73 1492.53 1444.00 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Inserts Comparison (Bulk Size: 500 - - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Inserts Comparison (Bulk Size: 500 - - Rounds: 30) 1000 3000 500 1000 1500 2000 2500 SE +/- 0.74, N = 3 SE +/- 0.87, N = 3 SE +/- 0.51, N = 3 SE +/- 1.95, N = 3 SE +/- 3.77, N = 3 SE +/- 11.33, N = 3 SE +/- 2.58, N = 3 SE +/- 13.77, N = 3 464.69 2261.83 438.30 2158.52 676.09 2083.07 679.40 2140.74 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 500 - Inserts: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 500 - Inserts: 1000) 30 150 300 450 600 750 SE +/- 0.74, N = 3 SE +/- 0.51, N = 3 SE +/- 3.77, N = 3 SE +/- 2.58, N = 3 464.69 438.30 676.09 679.40 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 500 - Inserts: 3000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 500 - Inserts: 3000) 30 500 1000 1500 2000 2500 SE +/- 0.87, N = 3 SE +/- 1.95, N = 3 SE +/- 11.33, N = 3 SE +/- 13.77, N = 3 2261.83 2158.52 2083.07 2140.74 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache Spark Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time) 1000000 10000000 20000000 40000000 40 80 120 160 200 SE +/- 0.11, N = 4 SE +/- 0.32, N = 3 SE +/- 0.22, N = 3 SE +/- 0.34, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.34, N = 3 SE +/- 0.84, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.58, N = 3 SE +/- 0.10, N = 5 SE +/- 0.39, N = 3 SE +/- 0.67, N = 3 SE +/- 0.82, N = 3 10.01 57.05 96.68 195.45 9.50 55.28 93.79 190.03 9.34 52.69 88.81 177.81 9.56 52.88 89.48 178.89
Apache Spark Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time) 100 1000 2000 500 3 6 9 12 15 SE +/- 0.11, N = 4 SE +/- 0.14, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 4 SE +/- 0.12, N = 9 SE +/- 0.03, N = 3 SE +/- 0.10, N = 5 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 SE +/- 0.11, N = 3 10.01 11.38 12.96 11.23 9.50 11.18 12.55 10.43 9.34 10.78 12.63 9.89 9.56 11.14 12.88 10.48
Apache Spark Comparison (Row Count: 1000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 100) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 160 320 480 640 800 SE +/- 0.085253143, N = 4 SE +/- 9.681628257, N = 4 SE +/- 0.122562063, N = 4 SE +/- 0.023541873, N = 4 SE +/- 0.134671456, N = 4 SE +/- 0.025356347, N = 4 SE +/- 0.113137090, N = 4 SE +/- 0.102452612, N = 3 SE +/- 1.768265132, N = 3 SE +/- 0.257940983, N = 3 SE +/- 0.129389851, N = 3 SE +/- 0.004165140, N = 3 SE +/- 0.084920457, N = 3 SE +/- 0.038555282, N = 3 SE +/- 0.076264083, N = 3 SE +/- 1.541717417, N = 3 SE +/- 0.039099097, N = 3 SE +/- 0.130013375, N = 3 SE +/- 0.294062371, N = 3 SE +/- 0.070931558, N = 3 SE +/- 0.093919752, N = 3 SE +/- 0.069228259, N = 5 SE +/- 0.461842438, N = 5 SE +/- 0.089037280, N = 5 SE +/- 0.081615689, N = 5 SE +/- 0.044993077, N = 5 SE +/- 0.034264151, N = 5 SE +/- 0.101368246, N = 5 5.720000000 727.520000000 33.760000000 9.070000000 6.590000000 9.080000000 10.010000000 5.690000000 694.410000000 32.140000000 8.810000000 6.250000000 8.790000000 9.500000000 5.500000000 581.450000000 31.840000000 8.750000000 6.540000000 8.620000000 9.340000000 5.450000000 581.852210785 31.630000000 9.090000000 6.040000000 8.750000000 9.560000000
Apache Spark Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark) 1000000 10000000 20000000 40000000 160 320 480 640 800 SE +/- 9.68, N = 4 SE +/- 3.83, N = 3 SE +/- 8.94, N = 3 SE +/- 8.88, N = 3 SE +/- 1.77, N = 3 SE +/- 7.97, N = 3 SE +/- 8.48, N = 3 SE +/- 1.80, N = 3 SE +/- 1.54, N = 3 SE +/- 1.47, N = 3 SE +/- 1.38, N = 3 SE +/- 0.87, N = 3 SE +/- 0.46, N = 5 SE +/- 0.70, N = 3 SE +/- 3.74, N = 3 SE +/- 0.68, N = 3 727.52 722.90 713.91 724.99 694.41 681.48 694.61 694.62 581.45 581.85 580.52 579.98 581.85 580.29 582.87 581.19
Apache Spark Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark) 100 1000 2000 500 160 320 480 640 800 SE +/- 9.68, N = 4 SE +/- 1.88, N = 3 SE +/- 5.14, N = 3 SE +/- 10.10, N = 3 SE +/- 1.77, N = 3 SE +/- 1.43, N = 3 SE +/- 8.22, N = 3 SE +/- 3.62, N = 3 SE +/- 1.54, N = 3 SE +/- 0.54, N = 4 SE +/- 0.47, N = 9 SE +/- 0.64, N = 3 SE +/- 0.46, N = 5 SE +/- 2.32, N = 3 SE +/- 0.55, N = 3 SE +/- 1.70, N = 3 727.52 717.10 733.77 733.90 694.41 695.32 690.63 685.12 581.45 580.24 580.68 580.99 581.85 583.50 582.61 579.16
Apache Spark Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe) 1000000 10000000 20000000 40000000 8 16 24 32 40 SE +/- 0.12, N = 4 SE +/- 0.10, N = 3 SE +/- 0.32, N = 3 SE +/- 0.05, N = 3 SE +/- 0.26, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.04, N = 3 SE +/- 0.29, N = 3 SE +/- 0.07, N = 3 SE +/- 0.38, N = 3 SE +/- 0.09, N = 5 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 33.76 34.02 33.73 33.63 32.14 32.35 32.24 32.08 31.84 31.49 31.81 31.57 31.63 31.97 31.62 31.79
Apache Spark Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe) 100 1000 2000 500 8 16 24 32 40 SE +/- 0.12, N = 4 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.26, N = 3 SE +/- 0.10, N = 3 SE +/- 0.23, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 4 SE +/- 0.09, N = 9 SE +/- 0.02, N = 3 SE +/- 0.09, N = 5 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 33.76 33.39 33.79 33.76 32.14 32.36 32.03 32.27 31.84 31.88 31.56 31.79 31.63 31.54 31.68 31.72
Apache Spark Row Count Comparison (Partitions: 100 - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Group By Test Time) 1000000 10000000 20000000 40000000 20 40 60 80 100 SE +/- 0.02, N = 4 SE +/- 0.30, N = 3 SE +/- 0.45, N = 3 SE +/- 0.13, N = 3 SE +/- 0.25, N = 3 SE +/- 0.32, N = 3 SE +/- 2.29, N = 3 SE +/- 0.13, N = 3 SE +/- 3.06, N = 3 SE +/- 0.73, N = 3 SE +/- 0.08, N = 5 SE +/- 0.24, N = 3 SE +/- 0.47, N = 3 SE +/- 3.33, N = 3 9.07 25.05 37.11 8.81 23.50 35.51 87.32 8.75 26.62 34.66 9.09 23.90 34.41 88.01
Apache Spark Partitions Comparison (Row Count: 1000000 - - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Group By Test Time) 100 1000 2000 500 3 6 9 12 15 SE +/- 0.02, N = 4 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 4 SE +/- 0.13, N = 9 SE +/- 0.15, N = 3 SE +/- 0.08, N = 5 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 9.07 11.39 13.02 10.13 8.81 11.10 12.86 9.95 8.75 10.93 12.83 9.84 9.09 11.18 13.31 10.03
Apache Spark Row Count Comparison (Partitions: 100 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Repartition Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.03, N = 4 SE +/- 0.56, N = 3 SE +/- 0.55, N = 3 SE +/- 0.08, N = 3 SE +/- 0.18, N = 3 SE +/- 0.33, N = 3 SE +/- 1.31, N = 3 SE +/- 0.07, N = 3 SE +/- 0.76, N = 3 SE +/- 2.01, N = 3 SE +/- 0.03, N = 5 SE +/- 0.43, N = 3 SE +/- 0.15, N = 3 SE +/- 0.42, N = 3 9.08 41.28 74.32 8.79 38.29 71.59 137.28 8.62 38.58 72.35 8.75 37.07 68.12 131.38
Apache Spark Partitions Comparison (Row Count: 1000000 - - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Repartition Test Time) 100 1000 2000 500 3 6 9 12 15 SE +/- 0.03, N = 4 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 4 SE +/- 0.04, N = 9 SE +/- 0.10, N = 3 SE +/- 0.03, N = 5 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 9.08 10.06 11.01 9.46 8.79 10.05 10.71 9.10 8.62 9.74 10.57 9.00 8.75 9.95 10.85 9.21
Apache Spark Row Count Comparison (Partitions: 100 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Inner Join Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.134671456, N = 4 SE +/- 0.257232291, N = 3 SE +/- 0.574015178, N = 3 SE +/- 0.004165140, N = 3 SE +/- 0.120293064, N = 3 SE +/- 0.323667212, N = 3 SE +/- 1.752337079, N = 3 SE +/- 0.294062371, N = 3 SE +/- 1.642152192, N = 3 SE +/- 1.129567495, N = 3 SE +/- 0.044993077, N = 5 SE +/- 1.372283254, N = 3 SE +/- 0.475686548, N = 3 SE +/- 1.445788055, N = 3 6.590000000 47.520000000 83.980000000 6.250000000 43.580000000 80.900000000 157.880000000 6.540000000 43.880000000 75.680000000 6.040000000 43.710000000 76.870000000 152.872557219
Apache Spark Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time) 100 1000 2000 500 3 6 9 12 15 SE +/- 0.13, N = 4 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.29, N = 3 SE +/- 0.63, N = 4 SE +/- 0.50, N = 9 SE +/- 0.52, N = 3 SE +/- 0.04, N = 5 SE +/- 0.11, N = 3 SE +/- 0.40, N = 3 SE +/- 0.04, N = 3 6.59 8.33 10.69 7.26 6.25 8.01 10.68 7.01 6.54 8.63 11.06 7.53 6.04 7.81 10.89 7.03
Apache Spark Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time) 1000000 10000000 20000000 40000000 40 80 120 160 200 SE +/- 0.09, N = 4 SE +/- 0.25, N = 3 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.71, N = 3 SE +/- 0.43, N = 3 SE +/- 2.32, N = 3 SE +/- 0.08, N = 3 SE +/- 0.62, N = 3 SE +/- 0.59, N = 3 SE +/- 0.07, N = 5 SE +/- 0.21, N = 3 SE +/- 0.55, N = 3 SE +/- 0.60, N = 3 5.72 47.10 82.03 5.69 44.26 79.21 159.01 5.50 43.19 73.60 5.45 42.85 74.60 150.05
Apache Spark Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time) 100 1000 2000 500 2 4 6 8 10 SE +/- 0.09, N = 4 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 4 SE +/- 0.13, N = 9 SE +/- 0.06, N = 3 SE +/- 0.07, N = 5 SE +/- 0.06, N = 3 SE +/- 0.27, N = 3 SE +/- 0.49, N = 3 5.72 7.29 8.58 6.62 5.69 6.99 8.04 6.29 5.50 6.90 8.37 6.12 5.45 7.05 8.41 6.51
Apache Spark Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time) 1000000 10000000 20000000 40000000 40 80 120 160 200 SE +/- 0.075456756, N = 3 SE +/- 0.109148903, N = 3 SE +/- 0.307771793, N = 3 SE +/- 0.260000987, N = 3 SE +/- 0.073904401, N = 3 SE +/- 0.088475323, N = 3 SE +/- 0.105154004, N = 3 SE +/- 0.553867494, N = 3 SE +/- 0.026873455, N = 3 SE +/- 0.112654588, N = 3 SE +/- 0.160687224, N = 3 SE +/- 0.477080995, N = 3 SE +/- 0.114204323, N = 3 SE +/- 0.195921788, N = 3 SE +/- 0.331996595, N = 3 SE +/- 1.561648800, N = 3 11.230000000 52.620000000 99.640000000 189.390000000 10.430000000 50.730000000 96.850000000 183.200000000 9.890000000 47.870000000 90.560000000 172.060000000 10.480000000 48.840000000 91.240000000 172.690048331
Apache Spark Comparison (Row Count: 1000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 500) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 160 320 480 640 800 SE +/- 0.094366471, N = 3 SE +/- 10.096513371, N = 3 SE +/- 0.158253119, N = 3 SE +/- 0.085288962, N = 3 SE +/- 0.056766652, N = 3 SE +/- 0.037643391, N = 3 SE +/- 0.075456756, N = 3 SE +/- 0.103211248, N = 3 SE +/- 3.616590948, N = 3 SE +/- 0.155432056, N = 3 SE +/- 0.188967987, N = 3 SE +/- 0.103943425, N = 3 SE +/- 0.076523207, N = 3 SE +/- 0.073904401, N = 3 SE +/- 0.063047733, N = 3 SE +/- 0.635610275, N = 3 SE +/- 0.017302603, N = 3 SE +/- 0.152630685, N = 3 SE +/- 0.517942458, N = 3 SE +/- 0.101989022, N = 3 SE +/- 0.026873455, N = 3 SE +/- 0.486110869, N = 3 SE +/- 1.696546131, N = 3 SE +/- 0.016927629, N = 3 SE +/- 0.086808001, N = 3 SE +/- 0.043852959, N = 3 SE +/- 0.069154351, N = 3 SE +/- 0.114204323, N = 3 6.620000000 733.900000000 33.760000000 10.130000000 7.260000000 9.460000000 11.230000000 6.290000000 685.120000000 32.270000000 9.950000000 7.010000000 9.100000000 10.430000000 6.120000000 580.990000000 31.790000000 9.840000000 7.530000000 9.000000000 9.890000000 6.510000000 579.160667240 31.720000000 10.030000000 7.030000000 9.210000000 10.480000000
Apache Spark Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark) 1000000 10000000 20000000 40000000 160 320 480 640 800 SE +/- 10.10, N = 3 SE +/- 3.66, N = 3 SE +/- 17.41, N = 3 SE +/- 6.99, N = 3 SE +/- 3.62, N = 3 SE +/- 3.78, N = 3 SE +/- 4.56, N = 3 SE +/- 4.60, N = 3 SE +/- 0.64, N = 3 SE +/- 1.02, N = 3 SE +/- 0.79, N = 3 SE +/- 0.86, N = 3 SE +/- 1.70, N = 3 SE +/- 0.62, N = 3 SE +/- 0.67, N = 3 SE +/- 0.55, N = 3 733.90 692.06 714.05 728.26 685.12 684.23 683.57 690.62 580.99 579.55 581.12 580.30 579.16 581.78 583.11 579.01
Apache Spark Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe) 1000000 10000000 20000000 40000000 8 16 24 32 40 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.25, N = 3 SE +/- 0.10, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.36, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 33.76 33.89 33.72 33.77 32.27 32.17 31.84 31.96 31.79 31.79 31.76 31.51 31.72 31.81 31.74 31.71
Apache Spark Row Count Comparison (Partitions: 500 - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Group By Test Time) 1000000 10000000 20000000 40000000 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.42, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.51, N = 3 SE +/- 0.72, N = 3 SE +/- 4.05, N = 3 SE +/- 0.15, N = 3 SE +/- 1.78, N = 3 SE +/- 4.59, N = 3 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 SE +/- 1.17, N = 3 10.13 23.28 37.00 9.95 22.37 36.37 89.23 9.84 23.82 39.26 10.03 22.38 35.99 82.35
Apache Spark Row Count Comparison (Partitions: 500 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Repartition Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.037643391, N = 3 SE +/- 0.579061882, N = 3 SE +/- 0.150029474, N = 3 SE +/- 0.076523207, N = 3 SE +/- 0.263873750, N = 3 SE +/- 0.119615928, N = 3 SE +/- 0.575990239, N = 3 SE +/- 0.101989022, N = 3 SE +/- 1.074726167, N = 3 SE +/- 0.840434214, N = 3 SE +/- 0.069154351, N = 3 SE +/- 0.254871419, N = 3 SE +/- 0.310887433, N = 3 SE +/- 0.835252655, N = 3 9.460000000 40.160000000 73.220000000 9.100000000 38.210000000 71.300000000 138.040000000 9.000000000 38.920000000 70.900000000 9.210000000 36.440000000 67.860000000 131.531132677
Apache Spark Row Count Comparison (Partitions: 500 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Inner Join Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.056766652, N = 3 SE +/- 0.422261678, N = 3 SE +/- 0.562607380, N = 3 SE +/- 0.103943425, N = 3 SE +/- 0.391685283, N = 3 SE +/- 0.747944666, N = 3 SE +/- 0.391834664, N = 3 SE +/- 0.517942458, N = 3 SE +/- 0.798930107, N = 3 SE +/- 0.488163973, N = 3 SE +/- 0.043852959, N = 3 SE +/- 0.324188438, N = 3 SE +/- 0.097366593, N = 3 SE +/- 1.021947894, N = 3 7.260000000 44.680000000 83.840000000 7.010000000 42.540000000 80.990000000 158.110000000 7.530000000 42.430000000 78.030000000 7.030000000 40.240000000 77.630000000 152.207485397
Apache Spark Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.094366471, N = 3 SE +/- 0.236866720, N = 3 SE +/- 0.300364443, N = 3 SE +/- 0.103211248, N = 3 SE +/- 0.236232308, N = 3 SE +/- 0.489603948, N = 3 SE +/- 0.852271154, N = 3 SE +/- 0.063047733, N = 3 SE +/- 0.416062930, N = 3 SE +/- 0.043071403, N = 3 SE +/- 0.486110869, N = 3 SE +/- 0.448087864, N = 3 SE +/- 0.730826056, N = 3 SE +/- 0.764058299, N = 3 6.620000000 42.680000000 83.530000000 6.290000000 40.950000000 80.770000000 157.080000000 6.120000000 39.160000000 75.230000000 6.510000000 38.350000000 76.270000000 147.548531194
Apache Spark Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time) 1000000 10000000 20000000 40000000 40 80 120 160 200 SE +/- 0.14, N = 3 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 SE +/- 0.54, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 4 SE +/- 0.15, N = 3 SE +/- 0.29, N = 3 SE +/- 0.77, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.48, N = 3 11.38 53.52 100.73 189.73 11.18 51.64 95.92 183.35 10.78 49.21 91.39 172.45 11.14 49.45 92.42 172.19
Apache Spark Comparison (Row Count: 1000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 1000) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 150 300 450 600 750 SE +/- 0.04, N = 3 SE +/- 1.88, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 SE +/- 0.12, N = 3 SE +/- 1.43, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 4 SE +/- 0.54, N = 4 SE +/- 0.05, N = 4 SE +/- 0.08, N = 4 SE +/- 0.63, N = 4 SE +/- 0.07, N = 4 SE +/- 0.12, N = 4 SE +/- 0.06, N = 3 SE +/- 2.32, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.18, N = 3 SE +/- 0.01, N = 3 7.29 717.10 33.39 11.39 8.33 10.06 11.38 6.99 695.32 32.36 11.10 8.01 10.05 11.18 6.90 580.24 31.88 10.93 8.63 9.74 10.78 7.05 583.50 31.54 11.18 7.81 9.95 11.14
Apache Spark Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark) 1000000 10000000 20000000 40000000 160 320 480 640 800 SE +/- 1.88, N = 3 SE +/- 5.58, N = 3 SE +/- 11.19, N = 3 SE +/- 14.94, N = 3 SE +/- 1.43, N = 3 SE +/- 4.78, N = 3 SE +/- 2.66, N = 3 SE +/- 6.51, N = 3 SE +/- 0.54, N = 4 SE +/- 1.40, N = 3 SE +/- 0.66, N = 3 SE +/- 0.56, N = 3 SE +/- 2.32, N = 3 SE +/- 0.29, N = 3 SE +/- 1.10, N = 3 SE +/- 1.66, N = 3 717.10 722.36 722.93 721.00 695.32 690.24 687.06 697.90 580.24 580.37 579.19 581.69 583.50 580.46 580.24 581.60
Apache Spark Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe) 1000000 10000000 20000000 40000000 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.18, N = 3 SE +/- 0.19, N = 3 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 4 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.26, N = 3 SE +/- 0.32, N = 3 SE +/- 0.10, N = 3 33.39 34.00 33.81 33.51 32.36 32.24 32.05 32.40 31.88 31.66 31.75 31.54 31.54 31.36 31.22 31.61
Apache Spark Row Count Comparison (Partitions: 1000 - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Group By Test Time) 1000000 10000000 20000000 40000000 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.35, N = 3 SE +/- 0.79, N = 3 SE +/- 0.02, N = 3 SE +/- 0.28, N = 3 SE +/- 0.15, N = 3 SE +/- 2.33, N = 3 SE +/- 0.08, N = 4 SE +/- 0.36, N = 3 SE +/- 2.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.20, N = 3 SE +/- 0.44, N = 3 SE +/- 0.85, N = 3 11.39 23.89 37.31 11.10 22.29 35.27 88.02 10.93 22.44 35.83 11.18 22.62 34.70 79.60
Apache Spark Row Count Comparison (Partitions: 1000 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Repartition Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.02, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.07, N = 3 SE +/- 0.22, N = 3 SE +/- 0.23, N = 3 SE +/- 0.83, N = 3 SE +/- 0.07, N = 4 SE +/- 0.54, N = 3 SE +/- 1.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.31, N = 3 SE +/- 0.20, N = 3 SE +/- 0.93, N = 3 10.06 39.96 75.18 10.05 38.61 71.70 138.87 9.74 39.31 72.98 9.95 36.72 68.54 131.43
Apache Spark Row Count Comparison (Partitions: 1000 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Inner Join Test Time) 1000000 10000000 20000000 40000000 40 80 120 160 200 SE +/- 0.105150363, N = 3 SE +/- 0.399790551, N = 3 SE +/- 0.315382741, N = 3 SE +/- 0.035374915, N = 3 SE +/- 0.136942862, N = 3 SE +/- 0.420756743, N = 3 SE +/- 1.923212084, N = 3 SE +/- 0.633875719, N = 4 SE +/- 0.557375853, N = 3 SE +/- 0.855084002, N = 3 SE +/- 0.108422107, N = 3 SE +/- 0.211182878, N = 3 SE +/- 0.524371080, N = 3 SE +/- 1.834767926, N = 3 8.330000000 45.600000000 85.120000000 8.010000000 44.000000000 81.350000000 162.010000000 8.630000000 43.300000000 78.420000000 7.810000000 41.490000000 79.290000000 151.543861997
Apache Spark Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.51, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.06, N = 4 SE +/- 1.25, N = 3 SE +/- 0.83, N = 3 SE +/- 0.06, N = 3 SE +/- 0.36, N = 3 SE +/- 0.20, N = 3 SE +/- 1.46, N = 3 7.29 43.47 84.01 6.99 41.98 80.64 158.24 6.90 40.90 75.96 7.05 39.22 76.66 147.55
Apache Spark Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time) 1000000 10000000 20000000 40000000 40 80 120 160 200 SE +/- 0.14, N = 3 SE +/- 0.39, N = 3 SE +/- 0.14, N = 3 SE +/- 0.40, N = 3 SE +/- 0.11, N = 3 SE +/- 0.34, N = 3 SE +/- 0.37, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 9 SE +/- 0.36, N = 3 SE +/- 0.02, N = 3 SE +/- 0.42, N = 3 SE +/- 0.11, N = 3 SE +/- 0.24, N = 3 SE +/- 0.11, N = 3 SE +/- 0.47, N = 3 12.96 55.17 101.15 192.81 12.55 53.04 97.65 185.51 12.63 50.80 91.96 175.84 12.88 51.09 92.19 175.24
Apache Spark Comparison (Row Count: 1000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 2000) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 160 320 480 640 800 SE +/- 0.177939327, N = 3 SE +/- 5.138863712, N = 3 SE +/- 0.013599313, N = 3 SE +/- 0.146972816, N = 3 SE +/- 0.098619535, N = 3 SE +/- 0.181687585, N = 3 SE +/- 0.139768323, N = 3 SE +/- 0.011049874, N = 3 SE +/- 8.221686317, N = 3 SE +/- 0.230080533, N = 3 SE +/- 0.090717982, N = 3 SE +/- 0.094249006, N = 3 SE +/- 0.042552140, N = 3 SE +/- 0.112867497, N = 3 SE +/- 0.128969955, N = 9 SE +/- 0.468273880, N = 9 SE +/- 0.090240232, N = 9 SE +/- 0.134671941, N = 9 SE +/- 0.501143304, N = 9 SE +/- 0.039688685, N = 9 SE +/- 0.121232499, N = 9 SE +/- 0.269877699, N = 3 SE +/- 0.548006604, N = 3 SE +/- 0.123827132, N = 3 SE +/- 0.230601906, N = 3 SE +/- 0.401879123, N = 3 SE +/- 0.155773144, N = 3 SE +/- 0.113414449, N = 3 8.580000000 733.770000000 33.790000000 13.020000000 10.690000000 11.010000000 12.960000000 8.040000000 690.630000000 32.030000000 12.860000000 10.680000000 10.710000000 12.550000000 8.370000000 580.680000000 31.560000000 12.830000000 11.060000000 10.570000000 12.630000000 8.410000000 582.614894707 31.680000000 13.310000000 10.890000000 10.850000000 12.880000000
Apache Spark Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark) 1000000 10000000 20000000 40000000 160 320 480 640 800 SE +/- 5.14, N = 3 SE +/- 13.31, N = 3 SE +/- 22.40, N = 3 SE +/- 16.56, N = 3 SE +/- 8.22, N = 3 SE +/- 6.18, N = 3 SE +/- 2.10, N = 3 SE +/- 8.50, N = 3 SE +/- 0.47, N = 9 SE +/- 0.41, N = 3 SE +/- 1.08, N = 3 SE +/- 0.49, N = 3 SE +/- 0.55, N = 3 SE +/- 0.51, N = 3 SE +/- 0.28, N = 3 SE +/- 1.28, N = 3 733.77 711.60 723.32 710.71 690.63 699.96 681.91 695.17 580.68 581.17 579.87 580.86 582.61 577.92 581.10 579.55
Apache Spark Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe) 1000000 10000000 20000000 40000000 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.31, N = 3 SE +/- 0.09, N = 9 SE +/- 0.14, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.15, N = 3 SE +/- 0.14, N = 3 33.79 33.96 33.91 33.79 32.03 31.92 32.21 32.20 31.56 31.66 31.61 31.65 31.68 31.58 31.66 31.32
Apache Spark Row Count Comparison (Partitions: 2000 - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Group By Test Time) 1000000 10000000 20000000 40000000 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 SE +/- 0.46, N = 3 SE +/- 4.77, N = 3 SE +/- 0.13, N = 9 SE +/- 0.22, N = 3 SE +/- 0.23, N = 3 SE +/- 0.39, N = 3 SE +/- 0.41, N = 3 SE +/- 3.36, N = 3 13.02 24.85 37.35 12.86 24.09 36.72 83.87 12.83 24.10 13.31 24.13 37.16 81.61
Apache Spark Row Count Comparison (Partitions: 2000 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Repartition Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 0.46, N = 3 SE +/- 0.04, N = 3 SE +/- 0.21, N = 3 SE +/- 0.20, N = 3 SE +/- 0.91, N = 3 SE +/- 0.04, N = 9 SE +/- 0.66, N = 3 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.14, N = 3 SE +/- 0.77, N = 3 11.01 40.50 75.44 10.71 39.22 72.28 137.45 10.57 39.33 10.85 37.94 69.09 131.39
Apache Spark Row Count Comparison (Partitions: 2000 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Inner Join Test Time) 1000000 10000000 20000000 40000000 40 80 120 160 200 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.31, N = 3 SE +/- 1.46, N = 3 SE +/- 0.50, N = 9 SE +/- 1.45, N = 3 SE +/- 0.40, N = 3 SE +/- 0.15, N = 3 SE +/- 0.05, N = 3 SE +/- 1.01, N = 3 10.69 47.67 86.43 10.68 45.74 83.64 159.12 11.06 47.61 10.89 44.23 80.41 151.60
Apache Spark Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time) 1000000 10000000 20000000 40000000 30 60 90 120 150 SE +/- 0.18, N = 3 SE +/- 0.27, N = 3 SE +/- 0.57, N = 3 SE +/- 0.01, N = 3 SE +/- 0.28, N = 3 SE +/- 0.08, N = 3 SE +/- 1.89, N = 3 SE +/- 0.13, N = 9 SE +/- 0.24, N = 3 SE +/- 0.27, N = 3 SE +/- 0.13, N = 3 SE +/- 0.89, N = 3 SE +/- 0.50, N = 3 8.58 44.59 83.94 8.04 42.90 81.25 157.25 8.37 40.93 8.41 41.16 77.56 148.66
Apache Spark Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time) 100 1000 2000 500 13 26 39 52 65 SE +/- 0.32, N = 3 SE +/- 0.22, N = 3 SE +/- 0.39, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.34, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.36, N = 3 SE +/- 0.11, N = 3 SE +/- 0.39, N = 3 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.20, N = 3 57.05 53.52 55.17 52.62 55.28 51.64 53.04 50.73 52.69 49.21 50.80 47.87 52.88 49.45 51.09 48.84
Apache Spark Comparison (Row Count: 10000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 100) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 160 320 480 640 800 SE +/- 0.25, N = 3 SE +/- 3.83, N = 3 SE +/- 0.10, N = 3 SE +/- 0.30, N = 3 SE +/- 0.26, N = 3 SE +/- 0.56, N = 3 SE +/- 0.32, N = 3 SE +/- 0.71, N = 3 SE +/- 7.97, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.14, N = 3 SE +/- 0.62, N = 3 SE +/- 1.47, N = 3 SE +/- 0.29, N = 3 SE +/- 3.06, N = 3 SE +/- 1.64, N = 3 SE +/- 0.76, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.70, N = 3 SE +/- 0.06, N = 3 SE +/- 0.24, N = 3 SE +/- 1.37, N = 3 SE +/- 0.43, N = 3 SE +/- 0.39, N = 3 47.10 722.90 34.02 25.05 47.52 41.28 57.05 44.26 681.48 32.35 23.50 43.58 38.29 55.28 43.19 581.85 31.49 26.62 43.88 38.58 52.69 42.85 580.29 31.97 23.90 43.71 37.07 52.88
Apache Spark Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark) 100 1000 2000 500 160 320 480 640 800 SE +/- 3.83, N = 3 SE +/- 5.58, N = 3 SE +/- 13.31, N = 3 SE +/- 3.66, N = 3 SE +/- 7.97, N = 3 SE +/- 4.78, N = 3 SE +/- 6.18, N = 3 SE +/- 3.78, N = 3 SE +/- 1.47, N = 3 SE +/- 1.40, N = 3 SE +/- 0.41, N = 3 SE +/- 1.02, N = 3 SE +/- 0.70, N = 3 SE +/- 0.29, N = 3 SE +/- 0.51, N = 3 SE +/- 0.62, N = 3 722.90 722.36 711.60 692.06 681.48 690.24 699.96 684.23 581.85 580.37 581.17 579.55 580.29 580.46 577.92 581.78
Apache Spark Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe) 100 1000 2000 500 8 16 24 32 40 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 SE +/- 0.32, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.26, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 34.02 34.00 33.96 33.89 32.35 32.24 31.92 32.17 31.49 31.66 31.66 31.79 31.97 31.36 31.58 31.81
Apache Spark Partitions Comparison (Row Count: 10000000 - - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Group By Test Time) 100 1000 2000 500 6 12 18 24 30 SE +/- 0.30, N = 3 SE +/- 0.35, N = 3 SE +/- 0.28, N = 3 SE +/- 0.42, N = 3 SE +/- 0.25, N = 3 SE +/- 0.28, N = 3 SE +/- 0.13, N = 3 SE +/- 0.51, N = 3 SE +/- 3.06, N = 3 SE +/- 0.36, N = 3 SE +/- 0.22, N = 3 SE +/- 1.78, N = 3 SE +/- 0.24, N = 3 SE +/- 0.20, N = 3 SE +/- 0.39, N = 3 SE +/- 0.17, N = 3 25.05 23.89 24.85 23.28 23.50 22.29 24.09 22.37 26.62 22.44 24.10 23.82 23.90 22.62 24.13 22.38
Apache Spark Partitions Comparison (Row Count: 10000000 - - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Repartition Test Time) 100 1000 2000 500 9 18 27 36 45 SE +/- 0.56, N = 3 SE +/- 0.23, N = 3 SE +/- 0.03, N = 3 SE +/- 0.58, N = 3 SE +/- 0.18, N = 3 SE +/- 0.22, N = 3 SE +/- 0.21, N = 3 SE +/- 0.26, N = 3 SE +/- 0.76, N = 3 SE +/- 0.54, N = 3 SE +/- 0.66, N = 3 SE +/- 1.07, N = 3 SE +/- 0.43, N = 3 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 SE +/- 0.25, N = 3 41.28 39.96 40.50 40.16 38.29 38.61 39.22 38.21 38.58 39.31 39.33 38.92 37.07 36.72 37.94 36.44
Apache Spark Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time) 100 1000 2000 500 11 22 33 44 55 SE +/- 0.26, N = 3 SE +/- 0.40, N = 3 SE +/- 0.21, N = 3 SE +/- 0.42, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 SE +/- 0.04, N = 3 SE +/- 0.39, N = 3 SE +/- 1.64, N = 3 SE +/- 0.56, N = 3 SE +/- 1.45, N = 3 SE +/- 0.80, N = 3 SE +/- 1.37, N = 3 SE +/- 0.21, N = 3 SE +/- 0.15, N = 3 SE +/- 0.32, N = 3 47.52 45.60 47.67 44.68 43.58 44.00 45.74 42.54 43.88 43.30 47.61 42.43 43.71 41.49 44.23 40.24
Apache Spark Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time) 100 1000 2000 500 11 22 33 44 55 SE +/- 0.25, N = 3 SE +/- 0.09, N = 3 SE +/- 0.27, N = 3 SE +/- 0.24, N = 3 SE +/- 0.71, N = 3 SE +/- 0.16, N = 3 SE +/- 0.28, N = 3 SE +/- 0.24, N = 3 SE +/- 0.62, N = 3 SE +/- 1.25, N = 3 SE +/- 0.24, N = 3 SE +/- 0.42, N = 3 SE +/- 0.21, N = 3 SE +/- 0.36, N = 3 SE +/- 0.13, N = 3 SE +/- 0.45, N = 3 47.10 43.47 44.59 42.68 44.26 41.98 42.90 40.95 43.19 40.90 40.93 39.16 42.85 39.22 41.16 38.35
Apache Spark Comparison (Row Count: 10000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 500) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 150 300 450 600 750 SE +/- 0.24, N = 3 SE +/- 3.66, N = 3 SE +/- 0.13, N = 3 SE +/- 0.42, N = 3 SE +/- 0.42, N = 3 SE +/- 0.58, N = 3 SE +/- 0.11, N = 3 SE +/- 0.24, N = 3 SE +/- 3.78, N = 3 SE +/- 0.05, N = 3 SE +/- 0.51, N = 3 SE +/- 0.39, N = 3 SE +/- 0.26, N = 3 SE +/- 0.09, N = 3 SE +/- 0.42, N = 3 SE +/- 1.02, N = 3 SE +/- 0.11, N = 3 SE +/- 1.78, N = 3 SE +/- 0.80, N = 3 SE +/- 1.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.45, N = 3 SE +/- 0.62, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.32, N = 3 SE +/- 0.25, N = 3 SE +/- 0.20, N = 3 42.68 692.06 33.89 23.28 44.68 40.16 52.62 40.95 684.23 32.17 22.37 42.54 38.21 50.73 39.16 579.55 31.79 23.82 42.43 38.92 47.87 38.35 581.78 31.81 22.38 40.24 36.44 48.84
Apache Spark Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time) 100 1000 2000 500 20 40 60 80 100 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 SE +/- 0.14, N = 3 SE +/- 0.31, N = 3 SE +/- 0.34, N = 3 SE +/- 0.20, N = 3 SE +/- 0.37, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.29, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.67, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 96.68 100.73 101.15 99.64 93.79 95.92 97.65 96.85 88.81 91.39 91.96 90.56 89.48 92.42 92.19 91.24
Apache Spark Comparison (Row Count: 20000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 100) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 150 300 450 600 750 SE +/- 0.19, N = 3 SE +/- 8.94, N = 3 SE +/- 0.32, N = 3 SE +/- 0.45, N = 3 SE +/- 0.57, N = 3 SE +/- 0.55, N = 3 SE +/- 0.22, N = 3 SE +/- 0.43, N = 3 SE +/- 8.48, N = 3 SE +/- 0.23, N = 3 SE +/- 0.32, N = 3 SE +/- 0.32, N = 3 SE +/- 0.33, N = 3 SE +/- 0.34, N = 3 SE +/- 0.59, N = 3 SE +/- 1.38, N = 3 SE +/- 0.07, N = 3 SE +/- 0.73, N = 3 SE +/- 1.13, N = 3 SE +/- 2.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.55, N = 3 SE +/- 3.74, N = 3 SE +/- 0.18, N = 3 SE +/- 0.47, N = 3 SE +/- 0.48, N = 3 SE +/- 0.15, N = 3 SE +/- 0.67, N = 3 82.03 713.91 33.73 37.11 83.98 74.32 96.68 79.21 694.61 32.24 35.51 80.90 71.59 93.79 73.60 580.52 31.81 34.66 75.68 72.35 88.81 74.60 582.87 31.62 34.41 76.87 68.12 89.48
Apache Spark Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark) 100 1000 2000 500 160 320 480 640 800 SE +/- 8.94, N = 3 SE +/- 11.19, N = 3 SE +/- 22.40, N = 3 SE +/- 17.41, N = 3 SE +/- 8.48, N = 3 SE +/- 2.66, N = 3 SE +/- 2.10, N = 3 SE +/- 4.56, N = 3 SE +/- 1.38, N = 3 SE +/- 0.66, N = 3 SE +/- 1.08, N = 3 SE +/- 0.79, N = 3 SE +/- 3.74, N = 3 SE +/- 1.10, N = 3 SE +/- 0.28, N = 3 SE +/- 0.67, N = 3 713.91 722.93 723.32 714.05 694.61 687.06 681.91 683.57 580.52 579.19 579.87 581.12 582.87 580.24 581.10 583.11
Apache Spark Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe) 100 1000 2000 500 8 16 24 32 40 SE +/- 0.32, N = 3 SE +/- 0.19, N = 3 SE +/- 0.11, N = 3 SE +/- 0.25, N = 3 SE +/- 0.23, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.18, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 33.73 33.81 33.91 33.72 32.24 32.05 32.21 31.84 31.81 31.75 31.61 31.76 31.62 31.22 31.66 31.74
Apache Spark Partitions Comparison (Row Count: 20000000 - - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Group By Test Time) 100 1000 2000 500 9 18 27 36 45 SE +/- 0.45, N = 3 SE +/- 0.79, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 0.46, N = 3 SE +/- 0.72, N = 3 SE +/- 0.73, N = 3 SE +/- 2.03, N = 3 SE +/- 4.59, N = 3 SE +/- 0.47, N = 3 SE +/- 0.44, N = 3 SE +/- 0.41, N = 3 SE +/- 0.13, N = 3 37.11 37.31 37.35 37.00 35.51 35.27 36.72 36.37 34.66 35.83 39.26 34.41 34.70 37.16 35.99
Apache Spark Partitions Comparison (Row Count: 20000000 - - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Repartition Test Time) 100 1000 2000 500 20 40 60 80 100 SE +/- 0.55, N = 3 SE +/- 0.23, N = 3 SE +/- 0.46, N = 3 SE +/- 0.15, N = 3 SE +/- 0.33, N = 3 SE +/- 0.23, N = 3 SE +/- 0.20, N = 3 SE +/- 0.12, N = 3 SE +/- 2.01, N = 3 SE +/- 1.03, N = 3 SE +/- 0.84, N = 3 SE +/- 0.15, N = 3 SE +/- 0.20, N = 3 SE +/- 0.14, N = 3 SE +/- 0.31, N = 3 74.32 75.18 75.44 73.22 71.59 71.70 72.28 71.30 72.35 72.98 70.90 68.12 68.54 69.09 67.86
Apache Spark Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time) 100 1000 2000 500 20 40 60 80 100 SE +/- 0.57, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 0.56, N = 3 SE +/- 0.32, N = 3 SE +/- 0.42, N = 3 SE +/- 0.31, N = 3 SE +/- 0.75, N = 3 SE +/- 1.13, N = 3 SE +/- 0.86, N = 3 SE +/- 0.49, N = 3 SE +/- 0.48, N = 3 SE +/- 0.52, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 83.98 85.12 86.43 83.84 80.90 81.35 83.64 80.99 75.68 78.42 78.03 76.87 79.29 80.41 77.63
Apache Spark Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time) 100 1000 2000 500 20 40 60 80 100 SE +/- 0.19, N = 3 SE +/- 0.51, N = 3 SE +/- 0.57, N = 3 SE +/- 0.30, N = 3 SE +/- 0.43, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.49, N = 3 SE +/- 0.59, N = 3 SE +/- 0.83, N = 3 SE +/- 0.04, N = 3 SE +/- 0.55, N = 3 SE +/- 0.20, N = 3 SE +/- 0.89, N = 3 SE +/- 0.73, N = 3 82.03 84.01 83.94 83.53 79.21 80.64 81.25 80.77 73.60 75.96 75.23 74.60 76.66 77.56 76.27
Apache Spark Comparison (Row Count: 20000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 500) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 150 300 450 600 750 SE +/- 0.30, N = 3 SE +/- 17.41, N = 3 SE +/- 0.25, N = 3 SE +/- 0.10, N = 3 SE +/- 0.56, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 SE +/- 0.49, N = 3 SE +/- 4.56, N = 3 SE +/- 0.22, N = 3 SE +/- 0.72, N = 3 SE +/- 0.75, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.79, N = 3 SE +/- 0.15, N = 3 SE +/- 4.59, N = 3 SE +/- 0.49, N = 3 SE +/- 0.84, N = 3 SE +/- 0.16, N = 3 SE +/- 0.73, N = 3 SE +/- 0.67, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.31, N = 3 SE +/- 0.33, N = 3 83.53 714.05 33.72 37.00 83.84 73.22 99.64 80.77 683.57 31.84 36.37 80.99 71.30 96.85 75.23 581.12 31.76 39.26 78.03 70.90 90.56 76.27 583.11 31.74 35.99 77.63 67.86 91.24
Apache Spark Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time) 100 1000 2000 500 40 80 120 160 200 SE +/- 0.34, N = 3 SE +/- 0.54, N = 3 SE +/- 0.40, N = 3 SE +/- 0.26, N = 3 SE +/- 0.84, N = 3 SE +/- 0.13, N = 3 SE +/- 0.21, N = 3 SE +/- 0.55, N = 3 SE +/- 0.58, N = 3 SE +/- 0.77, N = 3 SE +/- 0.42, N = 3 SE +/- 0.48, N = 3 SE +/- 0.82, N = 3 SE +/- 0.48, N = 3 SE +/- 0.47, N = 3 SE +/- 1.56, N = 3 195.45 189.73 192.81 189.39 190.03 183.35 185.51 183.20 177.81 172.45 175.84 172.06 178.89 172.19 175.24 172.69
Apache Spark Comparison (Row Count: 40000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 100) Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe SHA-512 Benchmark Time Broadcast Inner Join Test Time Group By Test Time Inner Join Test Time Repartition Test Time 160 320 480 640 800 SE +/- 8.88, N = 3 SE +/- 0.05, N = 3 SE +/- 0.34, N = 3 SE +/- 2.32, N = 3 SE +/- 1.80, N = 3 SE +/- 0.23, N = 3 SE +/- 2.29, N = 3 SE +/- 1.75, N = 3 SE +/- 1.31, N = 3 SE +/- 0.84, N = 3 SE +/- 0.87, N = 3 SE +/- 0.38, N = 3 SE +/- 0.58, N = 3 SE +/- 0.60, N = 3 SE +/- 0.68, N = 3 SE +/- 0.10, N = 3 SE +/- 3.33, N = 3 SE +/- 1.45, N = 3 SE +/- 0.42, N = 3 SE +/- 0.82, N = 3 724.99 33.63 195.45 159.01 694.62 32.08 87.32 157.88 137.28 190.03 579.98 31.57 177.81 150.05 581.19 31.79 88.01 152.87 131.38 178.89
Apache Spark Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark) 100 1000 2000 500 160 320 480 640 800 SE +/- 8.88, N = 3 SE +/- 14.94, N = 3 SE +/- 16.56, N = 3 SE +/- 6.99, N = 3 SE +/- 1.80, N = 3 SE +/- 6.51, N = 3 SE +/- 8.50, N = 3 SE +/- 4.60, N = 3 SE +/- 0.87, N = 3 SE +/- 0.56, N = 3 SE +/- 0.49, N = 3 SE +/- 0.86, N = 3 SE +/- 0.68, N = 3 SE +/- 1.66, N = 3 SE +/- 1.28, N = 3 SE +/- 0.55, N = 3 724.99 721.00 710.71 728.26 694.62 697.90 695.17 690.62 579.98 581.69 580.86 580.30 581.19 581.60 579.55 579.01
Apache Spark Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe) 100 1000 2000 500 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.23, N = 3 SE +/- 0.16, N = 3 SE +/- 0.31, N = 3 SE +/- 0.36, N = 3 SE +/- 0.38, N = 3 SE +/- 0.16, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 33.63 33.51 33.79 33.77 32.08 32.40 32.20 31.96 31.57 31.54 31.65 31.51 31.79 31.61 31.32 31.71
Apache Spark Comparison (Row Count: 40000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 500) Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe SHA-512 Benchmark Time Broadcast Inner Join Test Time Group By Test Time Inner Join Test Time Repartition Test Time 160 320 480 640 800 SE +/- 6.99, N = 3 SE +/- 0.10, N = 3 SE +/- 0.26, N = 3 SE +/- 0.85, N = 3 SE +/- 4.60, N = 3 SE +/- 0.36, N = 3 SE +/- 4.05, N = 3 SE +/- 0.39, N = 3 SE +/- 0.58, N = 3 SE +/- 0.55, N = 3 SE +/- 0.86, N = 3 SE +/- 0.11, N = 3 SE +/- 0.48, N = 3 SE +/- 0.76, N = 3 SE +/- 0.55, N = 3 SE +/- 0.09, N = 3 SE +/- 1.17, N = 3 SE +/- 1.02, N = 3 SE +/- 0.84, N = 3 SE +/- 1.56, N = 3 728.26 33.77 189.39 157.08 690.62 31.96 89.23 158.11 138.04 183.20 580.30 31.51 172.06 147.55 579.01 31.71 82.35 152.21 131.53 172.69
Apache Spark Comparison (Row Count: 10000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 1000) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 160 320 480 640 800 SE +/- 0.09, N = 3 SE +/- 5.58, N = 3 SE +/- 0.18, N = 3 SE +/- 0.35, N = 3 SE +/- 0.40, N = 3 SE +/- 0.23, N = 3 SE +/- 0.22, N = 3 SE +/- 0.16, N = 3 SE +/- 4.78, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 0.14, N = 3 SE +/- 0.22, N = 3 SE +/- 0.11, N = 3 SE +/- 1.25, N = 3 SE +/- 1.40, N = 3 SE +/- 0.04, N = 3 SE +/- 0.36, N = 3 SE +/- 0.56, N = 3 SE +/- 0.54, N = 3 SE +/- 0.15, N = 3 SE +/- 0.36, N = 3 SE +/- 0.29, N = 3 SE +/- 0.26, N = 3 SE +/- 0.20, N = 3 SE +/- 0.21, N = 3 SE +/- 0.31, N = 3 SE +/- 0.05, N = 3 43.47 722.36 34.00 23.89 45.60 39.96 53.52 41.98 690.24 32.24 22.29 44.00 38.61 51.64 40.90 580.37 31.66 22.44 43.30 39.31 49.21 39.22 580.46 31.36 22.62 41.49 36.72 49.45
Apache Spark Comparison (Row Count: 10000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 2000) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 150 300 450 600 750 SE +/- 0.27, N = 3 SE +/- 13.31, N = 3 SE +/- 0.14, N = 3 SE +/- 0.28, N = 3 SE +/- 0.21, N = 3 SE +/- 0.03, N = 3 SE +/- 0.39, N = 3 SE +/- 0.28, N = 3 SE +/- 6.18, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.04, N = 3 SE +/- 0.21, N = 3 SE +/- 0.34, N = 3 SE +/- 0.24, N = 3 SE +/- 0.41, N = 3 SE +/- 0.14, N = 3 SE +/- 0.22, N = 3 SE +/- 1.45, N = 3 SE +/- 0.66, N = 3 SE +/- 0.36, N = 3 SE +/- 0.13, N = 3 SE +/- 0.51, N = 3 SE +/- 0.04, N = 3 SE +/- 0.39, N = 3 SE +/- 0.15, N = 3 SE +/- 0.08, N = 3 SE +/- 0.24, N = 3 44.59 711.60 33.96 24.85 47.67 40.50 55.17 42.90 699.96 31.92 24.09 45.74 39.22 53.04 40.93 581.17 31.66 24.10 47.61 39.33 50.80 41.16 577.92 31.58 24.13 44.23 37.94 51.09
Apache Spark Comparison (Row Count: 20000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 1000) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 160 320 480 640 800 SE +/- 0.51, N = 3 SE +/- 11.19, N = 3 SE +/- 0.19, N = 3 SE +/- 0.79, N = 3 SE +/- 0.32, N = 3 SE +/- 0.23, N = 3 SE +/- 0.20, N = 3 SE +/- 0.09, N = 3 SE +/- 2.66, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.42, N = 3 SE +/- 0.23, N = 3 SE +/- 0.20, N = 3 SE +/- 0.83, N = 3 SE +/- 0.66, N = 3 SE +/- 0.14, N = 3 SE +/- 2.03, N = 3 SE +/- 0.86, N = 3 SE +/- 1.03, N = 3 SE +/- 0.29, N = 3 SE +/- 0.20, N = 3 SE +/- 1.10, N = 3 SE +/- 0.32, N = 3 SE +/- 0.44, N = 3 SE +/- 0.52, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 84.01 722.93 33.81 37.31 85.12 75.18 100.73 80.64 687.06 32.05 35.27 81.35 71.70 95.92 75.96 579.19 31.75 35.83 78.42 72.98 91.39 76.66 580.24 31.22 34.70 79.29 68.54 92.42
Apache Spark Comparison (Row Count: 20000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 2000) Broadcast Inner Join Test Time Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Group By Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time 160 320 480 640 800 SE +/- 0.57, N = 3 SE +/- 22.40, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.28, N = 3 SE +/- 0.46, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 2.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.46, N = 3 SE +/- 0.31, N = 3 SE +/- 0.20, N = 3 SE +/- 0.37, N = 3 SE +/- 1.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.89, N = 3 SE +/- 0.28, N = 3 SE +/- 0.15, N = 3 SE +/- 0.41, N = 3 SE +/- 0.05, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 83.94 723.32 33.91 37.35 86.43 75.44 101.15 81.25 681.91 32.21 36.72 83.64 72.28 97.65 579.87 31.61 91.96 77.56 581.10 31.66 37.16 80.41 69.09 92.19
Apache Spark Comparison (Row Count: 40000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 1000) Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe SHA-512 Benchmark Time Broadcast Inner Join Test Time Group By Test Time Inner Join Test Time Repartition Test Time 160 320 480 640 800 SE +/- 14.94, N = 3 SE +/- 0.22, N = 3 SE +/- 0.54, N = 3 SE +/- 0.25, N = 3 SE +/- 6.51, N = 3 SE +/- 0.16, N = 3 SE +/- 2.33, N = 3 SE +/- 1.92, N = 3 SE +/- 0.83, N = 3 SE +/- 0.13, N = 3 SE +/- 0.56, N = 3 SE +/- 0.16, N = 3 SE +/- 0.77, N = 3 SE +/- 1.46, N = 3 SE +/- 1.66, N = 3 SE +/- 0.10, N = 3 SE +/- 0.85, N = 3 SE +/- 1.83, N = 3 SE +/- 0.93, N = 3 SE +/- 0.48, N = 3 721.00 33.51 189.73 158.24 697.90 32.40 88.02 162.01 138.87 183.35 581.69 31.54 172.45 147.55 581.60 31.61 79.60 151.54 131.43 172.19
Apache Spark Comparison (Row Count: 40000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 2000) Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe SHA-512 Benchmark Time Broadcast Inner Join Test Time Group By Test Time Inner Join Test Time Repartition Test Time 150 300 450 600 750 SE +/- 16.56, N = 3 SE +/- 0.06, N = 3 SE +/- 0.40, N = 3 SE +/- 1.89, N = 3 SE +/- 8.50, N = 3 SE +/- 0.31, N = 3 SE +/- 4.77, N = 3 SE +/- 1.46, N = 3 SE +/- 0.91, N = 3 SE +/- 0.21, N = 3 SE +/- 0.49, N = 3 SE +/- 0.10, N = 3 SE +/- 0.42, N = 3 SE +/- 0.50, N = 3 SE +/- 1.28, N = 3 SE +/- 0.14, N = 3 SE +/- 3.36, N = 3 SE +/- 1.01, N = 3 SE +/- 0.77, N = 3 SE +/- 0.47, N = 3 710.71 33.79 192.81 157.25 695.17 32.20 83.87 159.12 137.45 185.51 580.86 31.65 175.84 148.66 579.55 31.32 81.61 151.60 131.39 175.24
Apache Spark Partitions Comparison (Row Count: 40000000 - - Group By Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Group By Test Time) 100 1000 2000 500 20 40 60 80 100 SE +/- 2.29, N = 3 SE +/- 2.33, N = 3 SE +/- 4.77, N = 3 SE +/- 4.05, N = 3 SE +/- 3.33, N = 3 SE +/- 0.85, N = 3 SE +/- 3.36, N = 3 SE +/- 1.17, N = 3 87.32 88.02 83.87 89.23 88.01 79.60 81.61 82.35
Apache Spark Partitions Comparison (Row Count: 40000000 - - Repartition Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Repartition Test Time) 100 1000 2000 500 30 60 90 120 150 SE +/- 1.31, N = 3 SE +/- 0.83, N = 3 SE +/- 0.91, N = 3 SE +/- 0.58, N = 3 SE +/- 0.42, N = 3 SE +/- 0.93, N = 3 SE +/- 0.77, N = 3 SE +/- 0.84, N = 3 137.28 138.87 137.45 138.04 131.38 131.43 131.39 131.53
Apache Spark Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time) 100 1000 2000 500 40 80 120 160 200 SE +/- 1.75, N = 3 SE +/- 1.92, N = 3 SE +/- 1.46, N = 3 SE +/- 0.39, N = 3 SE +/- 1.45, N = 3 SE +/- 1.83, N = 3 SE +/- 1.01, N = 3 SE +/- 1.02, N = 3 157.88 162.01 159.12 158.11 152.87 151.54 151.60 152.21
Apache Spark Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time) 100 1000 2000 500 40 80 120 160 200 SE +/- 2.32, N = 3 SE +/- 0.25, N = 3 SE +/- 1.89, N = 3 SE +/- 0.85, N = 3 SE +/- 0.60, N = 3 SE +/- 1.46, N = 3 SE +/- 0.50, N = 3 SE +/- 0.76, N = 3 159.01 158.24 157.25 157.08 150.05 147.55 148.66 147.55
ClickHouse Comparison rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 Comparison 100M Rows Hits Dataset, First Run / Cold Cache 100M Rows Hits Dataset, Second Run 100M Rows Hits Dataset, Third Run 10 20 30 40 50 SE +/- 0.56, N = 3 SE +/- 0.67, N = 3 SE +/- 0.37, N = 3 SE +/- 0.29, N = 3 SE +/- 0.32, N = 3 SE +/- 0.71, N = 3 43.45 46.15 45.72 38.83 41.37 41.81
etcd Test Comparison (Connections: 50 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 100) PUT RANGE 4K 8K 12K 16K 20K SE +/- 548.13, N = 9 SE +/- 162.99, N = 9 SE +/- 103.48, N = 3 SE +/- 149.49, N = 3 SE +/- 580.79, N = 9 SE +/- 213.67, N = 9 SE +/- 13.84, N = 3 SE +/- 170.29, N = 6 9019.79 8177.71 17919.74 17702.59 9143.01 8026.12 17625.64 17733.58
etcd Connections Comparison (Test: PUT - - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 100) 100 50 500 4K 8K 12K 16K 20K SE +/- 78.80, N = 3 SE +/- 548.13, N = 9 SE +/- 154.99, N = 9 SE +/- 121.87, N = 3 SE +/- 103.48, N = 3 SE +/- 210.10, N = 3 SE +/- 59.42, N = 3 SE +/- 580.79, N = 9 SE +/- 162.97, N = 9 SE +/- 230.09, N = 3 SE +/- 13.84, N = 3 SE +/- 107.83, N = 3 7525.00 9019.79 7773.68 16623.40 17919.74 16740.45 7417.32 9143.01 7555.48 16034.33 17625.64 16067.27
etcd Clients Comparison (Test: PUT - Connections: 50) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 50) 100 1000 7K 14K 21K 28K 35K SE +/- 548.13, N = 9 SE +/- 452.84, N = 9 SE +/- 103.48, N = 3 SE +/- 166.43, N = 3 SE +/- 580.79, N = 9 SE +/- 523.12, N = 12 SE +/- 13.84, N = 3 SE +/- 97.60, N = 3 9019.79 16573.19 17919.74 32076.41 9143.01 19495.97 17625.64 30813.77
etcd Test Comparison (Connections: 50 - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 100 - Average Latency) PUT RANGE 3 6 9 12 15 SE +/- 0.57, N = 9 SE +/- 0.23, N = 9 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.55, N = 9 SE +/- 0.31, N = 9 SE +/- 0.00, N = 3 SE +/- 0.05, N = 6 11.3 12.2 5.5 5.6 11.1 12.4 5.6 5.6
etcd Connections Comparison (Test: PUT - - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 100 - Average Latency) 100 50 500 3 6 9 12 15 SE +/- 0.15, N = 3 SE +/- 0.57, N = 9 SE +/- 0.25, N = 9 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.55, N = 9 SE +/- 0.26, N = 9 SE +/- 0.09, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 13.2 11.3 12.8 5.9 5.5 5.9 13.4 11.1 13.2 6.2 5.6 6.1
etcd Clients Comparison (Test: PUT - Connections: 50 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 50 - - Average Latency) 100 1000 13 26 39 52 65 SE +/- 0.57, N = 9 SE +/- 1.79, N = 9 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.55, N = 9 SE +/- 1.66, N = 12 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 11.3 59.0 5.5 29.9 11.1 50.3 5.6 30.9
etcd Comparison (Test: PUT - Connections: 50 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 50 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.57, N = 9 SE +/- 0.03, N = 3 SE +/- 0.55, N = 9 SE +/- 0.00, N = 3 11.3 5.5 11.1 5.6
etcd Test Comparison (Connections: 100 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 100) PUT RANGE 4K 8K 12K 16K 20K SE +/- 78.80, N = 3 SE +/- 43.16, N = 3 SE +/- 121.87, N = 3 SE +/- 92.45, N = 3 SE +/- 59.42, N = 3 SE +/- 90.88, N = 3 SE +/- 230.09, N = 3 SE +/- 51.41, N = 3 7525.00 7344.58 16623.40 16784.83 7417.32 7054.62 16034.33 15796.44
etcd Clients Comparison (Test: PUT - Connections: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 100) 100 1000 6K 12K 18K 24K 30K SE +/- 78.80, N = 3 SE +/- 392.03, N = 9 SE +/- 121.87, N = 3 SE +/- 119.58, N = 3 SE +/- 59.42, N = 3 SE +/- 530.09, N = 12 SE +/- 230.09, N = 3 SE +/- 97.95, N = 3 7525.00 15482.13 16623.40 30106.84 7417.32 19163.35 16034.33 28950.57
etcd Test Comparison (Connections: 100 - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 100 - Average Latency) PUT RANGE 4 8 12 16 20 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 13.2 13.5 5.9 5.9 13.4 14.0 6.2 6.2
etcd Clients Comparison (Test: PUT - Connections: 100 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 100 - - Average Latency) 100 1000 14 28 42 56 70 SE +/- 0.15, N = 3 SE +/- 1.82, N = 9 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 1.74, N = 12 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 13.2 63.0 5.9 31.7 13.4 50.9 6.2 32.6
etcd Comparison (Test: PUT - Connections: 100 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 100 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 13.2 5.9 13.4 6.2
etcd Test Comparison (Connections: 50 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 1000) PUT RANGE 7K 14K 21K 28K 35K SE +/- 452.84, N = 9 SE +/- 428.03, N = 9 SE +/- 166.43, N = 3 SE +/- 208.41, N = 3 SE +/- 523.12, N = 12 SE +/- 466.92, N = 12 SE +/- 97.60, N = 3 SE +/- 55.90, N = 3 16573.19 15862.12 32076.41 32275.15 19495.97 18635.50 30813.77 30789.21
etcd Connections Comparison (Test: PUT - - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 1000) 100 50 500 7K 14K 21K 28K 35K SE +/- 392.03, N = 9 SE +/- 452.84, N = 9 SE +/- 131.09, N = 3 SE +/- 119.58, N = 3 SE +/- 166.43, N = 3 SE +/- 6.47, N = 3 SE +/- 530.09, N = 12 SE +/- 523.12, N = 12 SE +/- 178.58, N = 3 SE +/- 97.95, N = 3 SE +/- 97.60, N = 3 SE +/- 76.06, N = 3 15482.13 16573.19 13947.87 30106.84 32076.41 22994.38 19163.35 19495.97 16043.00 28950.57 30813.77 21936.54
etcd Test Comparison (Connections: 50 - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 1000 - Average Latency) PUT RANGE 14 28 42 56 70 SE +/- 1.79, N = 9 SE +/- 1.90, N = 9 SE +/- 0.18, N = 3 SE +/- 0.22, N = 3 SE +/- 1.66, N = 12 SE +/- 1.59, N = 12 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 59.0 61.8 29.9 29.7 50.3 52.6 30.9 31.0
etcd Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency) 100 50 500 15 30 45 60 75 SE +/- 1.82, N = 9 SE +/- 1.79, N = 9 SE +/- 0.71, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.00, N = 3 SE +/- 1.74, N = 12 SE +/- 1.66, N = 12 SE +/- 0.73, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.21, N = 3 63.0 59.0 67.8 31.7 29.9 40.6 50.9 50.3 58.7 32.6 30.9 41.9
etcd Comparison (Test: PUT - Connections: 50 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 50 - Clients: 1000) Average Latency 13 26 39 52 65 SE +/- 1.79, N = 9 SE +/- 0.18, N = 3 SE +/- 1.66, N = 12 SE +/- 0.12, N = 3 59.0 29.9 50.3 30.9
etcd Test Comparison (Connections: 500 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 100) PUT RANGE 4K 8K 12K 16K 20K SE +/- 154.99, N = 9 SE +/- 186.80, N = 6 SE +/- 210.10, N = 3 SE +/- 32.79, N = 3 SE +/- 162.97, N = 9 SE +/- 157.07, N = 9 SE +/- 107.83, N = 3 SE +/- 51.80, N = 3 7773.68 7871.69 16740.45 16375.19 7555.48 7311.14 16067.27 15844.21
etcd Clients Comparison (Test: PUT - Connections: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 500) 100 1000 5K 10K 15K 20K 25K SE +/- 154.99, N = 9 SE +/- 131.09, N = 3 SE +/- 210.10, N = 3 SE +/- 6.47, N = 3 SE +/- 162.97, N = 9 SE +/- 178.58, N = 3 SE +/- 107.83, N = 3 SE +/- 76.06, N = 3 7773.68 13947.87 16740.45 22994.38 7555.48 16043.00 16067.27 21936.54
etcd Test Comparison (Connections: 500 - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 100 - Average Latency) PUT RANGE 3 6 9 12 15 SE +/- 0.25, N = 9 SE +/- 0.31, N = 6 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.26, N = 9 SE +/- 0.26, N = 9 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 12.8 12.6 5.9 6.0 13.2 13.6 6.1 6.2
etcd Clients Comparison (Test: PUT - Connections: 500 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 500 - - Average Latency) 100 1000 15 30 45 60 75 SE +/- 0.25, N = 9 SE +/- 0.71, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.26, N = 9 SE +/- 0.73, N = 3 SE +/- 0.06, N = 3 SE +/- 0.21, N = 3 12.8 67.8 5.9 40.6 13.2 58.7 6.1 41.9
etcd Comparison (Test: PUT - Connections: 500 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 500 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.25, N = 9 SE +/- 0.06, N = 3 SE +/- 0.26, N = 9 SE +/- 0.06, N = 3 12.8 5.9 13.2 6.1
etcd Test Comparison (Connections: 100 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 1000) PUT RANGE 6K 12K 18K 24K 30K SE +/- 392.03, N = 9 SE +/- 438.82, N = 9 SE +/- 119.58, N = 3 SE +/- 136.35, N = 3 SE +/- 530.09, N = 12 SE +/- 414.34, N = 12 SE +/- 97.95, N = 3 SE +/- 123.00, N = 3 15482.13 15177.05 30106.84 30214.10 19163.35 18202.36 28950.57 28883.95
etcd Test Comparison (Connections: 100 - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 1000 - Average Latency) PUT RANGE 14 28 42 56 70 SE +/- 1.82, N = 9 SE +/- 2.12, N = 9 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 1.74, N = 12 SE +/- 1.57, N = 12 SE +/- 0.13, N = 3 SE +/- 0.18, N = 3 63.0 64.4 31.7 31.6 50.9 53.5 32.6 32.7
etcd Comparison (Test: PUT - Connections: 100 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 100 - Clients: 1000) Average Latency 14 28 42 56 70 SE +/- 1.82, N = 9 SE +/- 0.12, N = 3 SE +/- 1.74, N = 12 SE +/- 0.13, N = 3 63.0 31.7 50.9 32.6
etcd Test Comparison (Connections: 500 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 1000) PUT RANGE 5K 10K 15K 20K 25K SE +/- 131.09, N = 3 SE +/- 181.75, N = 3 SE +/- 6.47, N = 3 SE +/- 44.26, N = 3 SE +/- 178.58, N = 3 SE +/- 379.06, N = 6 SE +/- 76.06, N = 3 SE +/- 41.44, N = 3 13947.87 13685.59 22994.38 22948.34 16043.00 15827.12 21936.54 21829.11
etcd Test Comparison (Connections: 500 - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 1000 - Average Latency) PUT RANGE 15 30 45 60 75 SE +/- 0.71, N = 3 SE +/- 0.98, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 SE +/- 0.73, N = 3 SE +/- 1.51, N = 6 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 67.8 69.2 40.6 40.7 58.7 59.8 41.9 42.2
etcd Comparison (Test: PUT - Connections: 500 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 500 - Clients: 1000) Average Latency 15 30 45 60 75 SE +/- 0.71, N = 3 SE +/- 0.00, N = 3 SE +/- 0.73, N = 3 SE +/- 0.21, N = 3 67.8 40.6 58.7 41.9
etcd Connections Comparison (Test: RANGE - - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 100) 100 50 500 4K 8K 12K 16K 20K SE +/- 43.16, N = 3 SE +/- 162.99, N = 9 SE +/- 186.80, N = 6 SE +/- 92.45, N = 3 SE +/- 149.49, N = 3 SE +/- 32.79, N = 3 SE +/- 90.88, N = 3 SE +/- 213.67, N = 9 SE +/- 157.07, N = 9 SE +/- 51.41, N = 3 SE +/- 170.29, N = 6 SE +/- 51.80, N = 3 7344.58 8177.71 7871.69 16784.83 17702.59 16375.19 7054.62 8026.12 7311.14 15796.44 17733.58 15844.21
etcd Clients Comparison (Test: RANGE - Connections: 50) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 50) 100 1000 7K 14K 21K 28K 35K SE +/- 162.99, N = 9 SE +/- 428.03, N = 9 SE +/- 149.49, N = 3 SE +/- 208.41, N = 3 SE +/- 213.67, N = 9 SE +/- 466.92, N = 12 SE +/- 170.29, N = 6 SE +/- 55.90, N = 3 8177.71 15862.12 17702.59 32275.15 8026.12 18635.50 17733.58 30789.21
etcd Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency) 100 50 500 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 0.23, N = 9 SE +/- 0.31, N = 6 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 9 SE +/- 0.26, N = 9 SE +/- 0.03, N = 3 SE +/- 0.05, N = 6 SE +/- 0.00, N = 3 13.5 12.2 12.6 5.9 5.6 6.0 14.0 12.4 13.6 6.2 5.6 6.2
etcd Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency) 100 1000 14 28 42 56 70 SE +/- 0.23, N = 9 SE +/- 1.90, N = 9 SE +/- 0.06, N = 3 SE +/- 0.22, N = 3 SE +/- 0.31, N = 9 SE +/- 1.59, N = 12 SE +/- 0.05, N = 6 SE +/- 0.07, N = 3 12.2 61.8 5.6 29.7 12.4 52.6 5.6 31.0
etcd Comparison (Test: RANGE - Connections: 50 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 50 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.23, N = 9 SE +/- 0.06, N = 3 SE +/- 0.31, N = 9 SE +/- 0.05, N = 6 12.2 5.6 12.4 5.6
etcd Clients Comparison (Test: RANGE - Connections: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 100) 100 1000 6K 12K 18K 24K 30K SE +/- 43.16, N = 3 SE +/- 438.82, N = 9 SE +/- 92.45, N = 3 SE +/- 136.35, N = 3 SE +/- 90.88, N = 3 SE +/- 414.34, N = 12 SE +/- 51.41, N = 3 SE +/- 123.00, N = 3 7344.58 15177.05 16784.83 30214.10 7054.62 18202.36 15796.44 28883.95
etcd Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency) 100 1000 14 28 42 56 70 SE +/- 0.09, N = 3 SE +/- 2.12, N = 9 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 1.57, N = 12 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 13.5 64.4 5.9 31.6 14.0 53.5 6.2 32.7
etcd Comparison (Test: RANGE - Connections: 100 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 100 - Clients: 100) Average Latency 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 13.5 5.9 14.0 6.2
etcd Connections Comparison (Test: RANGE - - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 1000) 100 50 500 7K 14K 21K 28K 35K SE +/- 438.82, N = 9 SE +/- 428.03, N = 9 SE +/- 181.75, N = 3 SE +/- 136.35, N = 3 SE +/- 208.41, N = 3 SE +/- 44.26, N = 3 SE +/- 414.34, N = 12 SE +/- 466.92, N = 12 SE +/- 379.06, N = 6 SE +/- 123.00, N = 3 SE +/- 55.90, N = 3 SE +/- 41.44, N = 3 15177.05 15862.12 13685.59 30214.10 32275.15 22948.34 18202.36 18635.50 15827.12 28883.95 30789.21 21829.11
etcd Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency) 100 50 500 15 30 45 60 75 SE +/- 2.12, N = 9 SE +/- 1.90, N = 9 SE +/- 0.98, N = 3 SE +/- 0.15, N = 3 SE +/- 0.22, N = 3 SE +/- 0.12, N = 3 SE +/- 1.57, N = 12 SE +/- 1.59, N = 12 SE +/- 1.51, N = 6 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 64.4 61.8 69.2 31.6 29.7 40.7 53.5 52.6 59.8 32.7 31.0 42.2
etcd Comparison (Test: RANGE - Connections: 50 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 50 - Clients: 1000) Average Latency 14 28 42 56 70 SE +/- 1.90, N = 9 SE +/- 0.22, N = 3 SE +/- 1.59, N = 12 SE +/- 0.07, N = 3 61.8 29.7 52.6 31.0
etcd Clients Comparison (Test: RANGE - Connections: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 500) 100 1000 5K 10K 15K 20K 25K SE +/- 186.80, N = 6 SE +/- 181.75, N = 3 SE +/- 32.79, N = 3 SE +/- 44.26, N = 3 SE +/- 157.07, N = 9 SE +/- 379.06, N = 6 SE +/- 51.80, N = 3 SE +/- 41.44, N = 3 7871.69 13685.59 16375.19 22948.34 7311.14 15827.12 15844.21 21829.11
etcd Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency) 100 1000 15 30 45 60 75 SE +/- 0.31, N = 6 SE +/- 0.98, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.26, N = 9 SE +/- 1.51, N = 6 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 12.6 69.2 6.0 40.7 13.6 59.8 6.2 42.2
etcd Comparison (Test: RANGE - Connections: 500 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 500 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.31, N = 6 SE +/- 0.03, N = 3 SE +/- 0.26, N = 9 SE +/- 0.00, N = 3 12.6 6.0 13.6 6.2
etcd Comparison (Test: RANGE - Connections: 100 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 100 - Clients: 1000) Average Latency 14 28 42 56 70 SE +/- 2.12, N = 9 SE +/- 0.15, N = 3 SE +/- 1.57, N = 12 SE +/- 0.18, N = 3 64.4 31.6 53.5 32.7
etcd Comparison (Test: RANGE - Connections: 500 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 500 - Clients: 1000) Average Latency 15 30 45 60 75 SE +/- 0.98, N = 3 SE +/- 0.12, N = 3 SE +/- 1.51, N = 6 SE +/- 0.06, N = 3 69.2 40.7 59.8 42.2
SQLite Threads / Copies Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.30.1 Threads / Copies Comparison 1 8 16 24 32 40 SE +/- 0.28, N = 15 SE +/- 0.11, N = 3 SE +/- 0.35, N = 3 SE +/- 0.04, N = 3 36.07 31.28 36.30 33.27 1. (CC) gcc options: -O2 -lreadline -ltermcap -lz -lm
LevelDB Benchmark Comparison rk1-mainline-emmc rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Microseconds Per Op, Fewer Is Better LevelDB 1.23 Benchmark Comparison Fill Sync Hot Read Overwrite Random Delete Random Fill Random Read Seek Random Sequential Fill 800 1600 2400 3200 4000 SE +/- 124.904, N = 15 SE +/- 0.032, N = 3 SE +/- 0.512, N = 15 SE +/- 0.132, N = 3 SE +/- 0.486, N = 10 SE +/- 0.043, N = 3 SE +/- 0.148, N = 15 SE +/- 0.405, N = 3 SE +/- 80.483, N = 15 SE +/- 0.014, N = 3 SE +/- 1.898, N = 5 SE +/- 1.094, N = 3 SE +/- 0.770, N = 3 SE +/- 0.015, N = 3 SE +/- 0.013, N = 3 SE +/- 0.648, N = 3 SE +/- 9.836, N = 3 SE +/- 0.015, N = 3 SE +/- 0.482, N = 3 SE +/- 0.861, N = 3 SE +/- 1.262, N = 3 SE +/- 0.015, N = 3 SE +/- 0.008, N = 3 SE +/- 0.569, N = 3 3015.646 4.593 62.013 55.527 61.550 4.606 6.376 59.031 3224.474 4.520 156.267 142.858 153.493 4.497 6.275 149.853 3817.429 4.517 149.216 139.647 150.352 4.502 6.273 147.151 1. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy
LevelDB Benchmark Comparison rk1-mainline-emmc rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org MB/s, More Is Better LevelDB 1.23 Benchmark Comparison Fill Sync Overwrite Random Fill Sequential Fill 4 8 12 16 20 SE +/- 0.01, N = 15 SE +/- 0.11, N = 15 SE +/- 0.11, N = 10 SE +/- 0.12, N = 3 SE +/- 0.01, N = 15 SE +/- 0.06, N = 5 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 0.3 14.2 14.3 15.0 0.3 5.5 5.6 5.8 0.2 5.8 5.8 6.0 1. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy
Phoronix Test Suite v10.8.5