rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd rk1-mainline-emmc testing on Ubuntu 22.04 via the Phoronix Test Suite.
rk1-mainline-nvme: rk1-mainline-nvme testing on Ubuntu 22.04 via the Phoronix Test Suite.
rok1: Rockchip ARMv8 Cortex-A76 testing with a Turing Machines RK1 and rockchipdrmfb on Ubuntu 22.04 via the Phoronix Test Suite.
pi5-compilation: ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.
pi4-raspbian-sd: ARMv8 Cortex-A72 testing on Debian 12 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2405141-NE-RK1EMMCCO86,2405147-NE-RK1MAINLI70,2405142-NE-ROK12186375,2402267-NE-PI5COMPIL39,2402287-NE-PI4RASPBI24&cts=1&ppt=D&rdt&grs .
rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd Processor Motherboard Memory Disk Graphics Network Chipset OS Kernel Compiler File-System Screen Resolution Vulkan Display Server rk1-rok-emmc rk1-mainline-emmc pi5-raspbian-nvme rk1-mainline-nvme pi4-raspbian-sd rk1-rok-nvme rk1-rok-emmc @ 1.80GHz (4 Cores / 8 Threads) Turing Machines RK1 32GB 500GB CT500P3SSD8 + 31GB BJTD4R rockchipdrmfb Ubuntu 22.04 5.10.160-rockchip (aarch64) GCC 11.4.0 ext4 1920x1080 rk1-mainline-emmc @ 1.80GHz (4 Cores / 8 Threads) 1000GB CT1000P3PSSD8 + 31GB BJTD4R 6.7.0 (aarch64) 1.3.255 ARMv8 Cortex-A76 @ 2.40GHz (4 Cores) Raspberry Pi 5 Model B Rev 1.0 4096MB 500GB CT500P3SSD8 Device 1de4:0001 Debian 12 6.1.0-rpi7-rpi-2712 (aarch64) GCC 12.2.0 rk1-mainline-nvme @ 1.80GHz (4 Cores / 8 Threads) Turing Machines RK1 32GB 500GB CT500P3SSD8 + 31GB BJTD4R Ubuntu 22.04 6.7.0 (aarch64) 1.3.255 GCC 11.4.0 ARMv8 Cortex-A72 @ 1.80GHz (4 Cores) BCM2835 Raspberry Pi 400 Rev 1.0 Broadcom BCM2711 4096MB 64GB SR64G Debian 12 6.1.0-rpi6-rpi-v8 (aarch64) X Server GCC 12.2.0 Rockchip ARMv8 Cortex-A76 @ 1.80GHz (4 Cores / 8 Threads) Turing Machines RK1 32GB 500GB CT500P3SSD8 + 31GB BJTD4R rockchipdrmfb Ubuntu 22.04 5.10.160-rockchip (aarch64) GCC 11.4.0 1920x1080 OpenBenchmarking.org Compiler Details - rk1-rok-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi5-raspbian-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi4-raspbian-sd: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details - rk1-rok-emmc: Scaling Governor: cpufreq-dt performance - rk1-mainline-emmc: Scaling Governor: rockchip-cpufreq ondemand - pi5-raspbian-nvme: Scaling Governor: cpufreq-dt ondemand - rk1-mainline-nvme: Scaling Governor: rockchip-cpufreq performance - pi4-raspbian-sd: Scaling Governor: cpufreq-dt ondemand - rk1-rok-nvme: Scaling Governor: cpufreq-dt performance Python Details - rk1-rok-emmc: Python 3.10.12 - rk1-mainline-emmc: Python 3.10.12 - pi5-raspbian-nvme: Python 3.11.2 - rk1-mainline-nvme: Python 3.10.12 - pi4-raspbian-sd: Python 3.11.2 - rk1-rok-nvme: Python 3.10.12 Security Details - rk1-rok-emmc: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-emmc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi5-raspbian-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi4-raspbian-sd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-nvme: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected Kernel Details - rk1-mainline-emmc: Transparent Huge Pages: madvise - rk1-mainline-nvme: Transparent Huge Pages: madvise - pi4-raspbian-sd: snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0 cfg80211.ieee80211_regdom=US
rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd spark-tpcds: 3000 rk1-rok-emmc rk1-mainline-emmc pi5-raspbian-nvme rk1-mainline-nvme pi4-raspbian-sd rk1-rok-nvme OpenBenchmarking.org
LeelaChessZero Backend Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.30 Backend Comparison BLAS 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.11, N = 9 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5 5 6 6 7 1 1. (CXX) g++ options: -flto -pthread
Timed FFmpeg Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 6.1 Comparison Time To Compile 200 400 600 800 1000 SE +/- 0.50, N = 3 SE +/- 0.58, N = 3 SE +/- 0.84, N = 3 SE +/- 0.36, N = 3 SE +/- 0.09, N = 3 SE +/- 1.65, N = 3 209.95 200.28 196.60 194.15 349.94 971.00
Timed Apache Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better Timed Apache Compilation 2.4.41 Comparison Time To Compile 50 100 150 200 250 SE +/- 0.16, N = 3 SE +/- 0.22, N = 3 SE +/- 0.26, N = 3 SE +/- 0.38, N = 3 SE +/- 0.37, N = 3 SE +/- 0.49, N = 3 60.63 59.32 59.16 59.76 77.31 223.03
asmFish Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Nodes/second, More Is Better asmFish 2018-07-23 Comparison 1024 Hash Memory, 26 Depth 2M 4M 6M 8M 10M SE +/- 75549.20, N = 6 SE +/- 43781.35, N = 3 SE +/- 65797.59, N = 9 SE +/- 44374.95, N = 3 SE +/- 34823.82, N = 3 7583856 8005820 7817210 7721159 2767131
m-queens Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Comparison Time To Solve 120 240 360 480 600 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.33, N = 3 216.46 206.45 206.26 206.40 316.59 567.49 1. (CXX) g++ options: -fopenmp -O2 -march=native
Stargate Digital Audio Workstation Sample Rate Comparison (Buffer Size: 512) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate Comparison (Buffer Size: 512) 192000 96000 44100 480000 0.1793 0.3586 0.5379 0.7172 0.8965 SE +/- 0.000865, N = 3 SE +/- 0.000635, N = 3 SE +/- 0.000792, N = 3 SE +/- 0.000670, N = 3 SE +/- 0.000291, N = 3 SE +/- 0.000167, N = 3 SE +/- 0.000393, N = 3 SE +/- 0.000207, N = 3 SE +/- 0.000095, N = 3 SE +/- 0.000630, N = 3 SE +/- 0.006662, N = 12 SE +/- 0.006668, N = 12 SE +/- 0.000288, N = 3 SE +/- 0.000529, N = 3 SE +/- 0.010750, N = 3 SE +/- 0.003804, N = 3 SE +/- 0.000076, N = 3 SE +/- 0.000135, N = 3 SE +/- 0.000267, N = 3 SE +/- 0.000305, N = 3 0.364385 0.549147 0.775792 0.743771 0.373282 0.563347 0.797065 0.764251 0.392878 0.591268 0.776297 0.747707 0.391729 0.590221 0.770508 0.762093 0.145109 0.225567 0.335509 0.321843 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 192000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 192000) 512 1024 0.0887 0.1774 0.2661 0.3548 0.4435 SE +/- 0.000865, N = 3 SE +/- 0.000191, N = 3 SE +/- 0.000291, N = 3 SE +/- 0.000285, N = 3 SE +/- 0.000095, N = 3 SE +/- 0.003917, N = 3 SE +/- 0.000288, N = 3 SE +/- 0.000760, N = 3 SE +/- 0.000076, N = 3 SE +/- 0.000090, N = 3 0.364385 0.381570 0.373282 0.390750 0.392878 0.391185 0.391729 0.394290 0.145109 0.166606 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 96000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 96000) 512 1024 0.133 0.266 0.399 0.532 0.665 SE +/- 0.000635, N = 3 SE +/- 0.000339, N = 3 SE +/- 0.000167, N = 3 SE +/- 0.000195, N = 3 SE +/- 0.000630, N = 3 SE +/- 0.003479, N = 3 SE +/- 0.000529, N = 3 SE +/- 0.005146, N = 9 SE +/- 0.000135, N = 3 SE +/- 0.000279, N = 3 0.549147 0.570835 0.563347 0.585221 0.591268 0.558662 0.590221 0.576390 0.225567 0.252197 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 44100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 44100) 512 1024 0.1848 0.3696 0.5544 0.7392 0.924 SE +/- 0.000792, N = 3 SE +/- 0.000604, N = 3 SE +/- 0.000393, N = 3 SE +/- 0.000098, N = 3 SE +/- 0.006662, N = 12 SE +/- 0.000730, N = 3 SE +/- 0.010750, N = 3 SE +/- 0.000258, N = 3 SE +/- 0.000267, N = 3 SE +/- 0.000223, N = 3 0.775792 0.797260 0.797065 0.821373 0.776297 0.800528 0.770508 0.800044 0.335509 0.362448 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Buffer Size Comparison (Sample Rate: 480000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Buffer Size Comparison (Sample Rate: 480000) 512 1024 0.1768 0.3536 0.5304 0.7072 0.884 SE +/- 0.000670, N = 3 SE +/- 0.000798, N = 3 SE +/- 0.000207, N = 3 SE +/- 0.001050, N = 3 SE +/- 0.006668, N = 12 SE +/- 0.000633, N = 3 SE +/- 0.003804, N = 3 SE +/- 0.000443, N = 3 SE +/- 0.000305, N = 3 SE +/- 0.000131, N = 3 0.743771 0.765616 0.764251 0.785961 0.747707 0.767829 0.762093 0.766823 0.321843 0.348121 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Stargate Digital Audio Workstation Sample Rate Comparison (Buffer Size: 1024) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate Comparison (Buffer Size: 1024) 192000 96000 44100 480000 0.1848 0.3696 0.5544 0.7392 0.924 SE +/- 0.000191, N = 3 SE +/- 0.000339, N = 3 SE +/- 0.000604, N = 3 SE +/- 0.000798, N = 3 SE +/- 0.000285, N = 3 SE +/- 0.000195, N = 3 SE +/- 0.000098, N = 3 SE +/- 0.001050, N = 3 SE +/- 0.003917, N = 3 SE +/- 0.003479, N = 3 SE +/- 0.000730, N = 3 SE +/- 0.000633, N = 3 SE +/- 0.000760, N = 3 SE +/- 0.005146, N = 9 SE +/- 0.000258, N = 3 SE +/- 0.000443, N = 3 SE +/- 0.000090, N = 3 SE +/- 0.000279, N = 3 SE +/- 0.000223, N = 3 SE +/- 0.000131, N = 3 0.381570 0.570835 0.797260 0.765616 0.390750 0.585221 0.821373 0.785961 0.391185 0.558662 0.800528 0.767829 0.394290 0.576390 0.800044 0.766823 0.166606 0.252197 0.362448 0.348121 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
LevelDB Benchmark Comparison rk1-mainline-emmc rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org MB/s, More Is Better LevelDB 1.23 Benchmark Comparison Sequential Fill Overwrite Random Fill Fill Sync 4 8 12 16 20 SE +/- 0.12, N = 3 SE +/- 0.11, N = 15 SE +/- 0.11, N = 10 SE +/- 0.01, N = 15 SE +/- 0.03, N = 3 SE +/- 0.06, N = 5 SE +/- 0.03, N = 3 SE +/- 0.01, N = 15 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 15.0 14.2 14.3 0.3 5.8 5.5 5.6 0.3 6.0 5.8 5.8 0.2 1. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy
LevelDB Benchmark Comparison rk1-mainline-emmc rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Microseconds Per Op, Fewer Is Better LevelDB 1.23 Benchmark Comparison Random Delete Sequential Fill Overwrite Random Fill Random Read Hot Read Seek Random Fill Sync 800 1600 2400 3200 4000 SE +/- 0.132, N = 3 SE +/- 0.405, N = 3 SE +/- 0.512, N = 15 SE +/- 0.486, N = 10 SE +/- 0.043, N = 3 SE +/- 0.032, N = 3 SE +/- 0.148, N = 15 SE +/- 124.904, N = 15 SE +/- 1.094, N = 3 SE +/- 0.648, N = 3 SE +/- 1.898, N = 5 SE +/- 0.770, N = 3 SE +/- 0.015, N = 3 SE +/- 0.014, N = 3 SE +/- 0.013, N = 3 SE +/- 80.483, N = 15 SE +/- 0.861, N = 3 SE +/- 0.569, N = 3 SE +/- 0.482, N = 3 SE +/- 1.262, N = 3 SE +/- 0.015, N = 3 SE +/- 0.015, N = 3 SE +/- 0.008, N = 3 SE +/- 9.836, N = 3 55.527 59.031 62.013 61.550 4.606 4.593 6.376 3015.646 142.858 149.853 156.267 153.493 4.497 4.520 6.275 3224.474 139.647 147.151 149.216 150.352 4.502 4.517 6.273 3817.429 1. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy
etcd Test Comparison (Connections: 100 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 100) RANGE PUT 4K 8K 12K 16K 20K SE +/- 43.16, N = 3 SE +/- 78.80, N = 3 SE +/- 92.45, N = 3 SE +/- 121.87, N = 3 SE +/- 90.88, N = 3 SE +/- 59.42, N = 3 SE +/- 51.41, N = 3 SE +/- 230.09, N = 3 7344.58 7525.00 16784.83 16623.40 7054.62 7417.32 15796.44 16034.33
etcd Connections Comparison (Test: RANGE - - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 100) 100 500 50 4K 8K 12K 16K 20K SE +/- 43.16, N = 3 SE +/- 186.80, N = 6 SE +/- 162.99, N = 9 SE +/- 92.45, N = 3 SE +/- 32.79, N = 3 SE +/- 149.49, N = 3 SE +/- 90.88, N = 3 SE +/- 157.07, N = 9 SE +/- 213.67, N = 9 SE +/- 51.41, N = 3 SE +/- 51.80, N = 3 SE +/- 170.29, N = 6 7344.58 7871.69 8177.71 16784.83 16375.19 17702.59 7054.62 7311.14 8026.12 15796.44 15844.21 17733.58
etcd Clients Comparison (Test: RANGE - Connections: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 100) 100 1000 6K 12K 18K 24K 30K SE +/- 43.16, N = 3 SE +/- 438.82, N = 9 SE +/- 92.45, N = 3 SE +/- 136.35, N = 3 SE +/- 90.88, N = 3 SE +/- 414.34, N = 12 SE +/- 51.41, N = 3 SE +/- 123.00, N = 3 7344.58 15177.05 16784.83 30214.10 7054.62 18202.36 15796.44 28883.95
etcd Test Comparison (Connections: 100 - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 100 - Average Latency) RANGE PUT 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 13.5 13.2 5.9 5.9 14.0 13.4 6.2 6.2
etcd Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency) 100 500 50 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 0.31, N = 6 SE +/- 0.23, N = 9 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.26, N = 9 SE +/- 0.31, N = 9 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 6 13.5 12.6 12.2 5.9 6.0 5.6 14.0 13.6 12.4 6.2 6.2 5.6
etcd Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency) 100 1000 14 28 42 56 70 SE +/- 0.09, N = 3 SE +/- 2.12, N = 9 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 1.57, N = 12 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 13.5 64.4 5.9 31.6 14.0 53.5 6.2 32.7
etcd Comparison (Test: RANGE - Connections: 100 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 100 - Clients: 100) Average Latency 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 13.5 5.9 14.0 6.2
etcd Connections Comparison (Test: PUT - - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 100 - Average Latency) 100 500 50 3 6 9 12 15 SE +/- 0.15, N = 3 SE +/- 0.25, N = 9 SE +/- 0.57, N = 9 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.26, N = 9 SE +/- 0.55, N = 9 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 13.2 12.8 11.3 5.9 5.9 5.5 13.4 13.2 11.1 6.2 6.1 5.6
etcd Clients Comparison (Test: PUT - Connections: 100 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 100 - - Average Latency) 100 1000 14 28 42 56 70 SE +/- 0.15, N = 3 SE +/- 1.82, N = 9 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 1.74, N = 12 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 13.2 63.0 5.9 31.7 13.4 50.9 6.2 32.6
etcd Comparison (Test: PUT - Connections: 100 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 100 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 13.2 5.9 13.4 6.2
etcd Test Comparison (Connections: 500 - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 100 - Average Latency) RANGE PUT 3 6 9 12 15 SE +/- 0.31, N = 6 SE +/- 0.25, N = 9 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.26, N = 9 SE +/- 0.26, N = 9 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 12.6 12.8 6.0 5.9 13.6 13.2 6.2 6.1
etcd Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency) 100 1000 15 30 45 60 75 SE +/- 0.31, N = 6 SE +/- 0.98, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.26, N = 9 SE +/- 1.51, N = 6 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 12.6 69.2 6.0 40.7 13.6 59.8 6.2 42.2
etcd Comparison (Test: RANGE - Connections: 500 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 500 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.31, N = 6 SE +/- 0.03, N = 3 SE +/- 0.26, N = 9 SE +/- 0.00, N = 3 12.6 6.0 13.6 6.2
etcd Connections Comparison (Test: PUT - - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 100) 100 500 50 4K 8K 12K 16K 20K SE +/- 78.80, N = 3 SE +/- 154.99, N = 9 SE +/- 548.13, N = 9 SE +/- 121.87, N = 3 SE +/- 210.10, N = 3 SE +/- 103.48, N = 3 SE +/- 59.42, N = 3 SE +/- 162.97, N = 9 SE +/- 580.79, N = 9 SE +/- 230.09, N = 3 SE +/- 107.83, N = 3 SE +/- 13.84, N = 3 7525.00 7773.68 9019.79 16623.40 16740.45 17919.74 7417.32 7555.48 9143.01 16034.33 16067.27 17625.64
etcd Clients Comparison (Test: PUT - Connections: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 100) 100 1000 6K 12K 18K 24K 30K SE +/- 78.80, N = 3 SE +/- 392.03, N = 9 SE +/- 121.87, N = 3 SE +/- 119.58, N = 3 SE +/- 59.42, N = 3 SE +/- 530.09, N = 12 SE +/- 230.09, N = 3 SE +/- 97.95, N = 3 7525.00 15482.13 16623.40 30106.84 7417.32 19163.35 16034.33 28950.57
etcd Clients Comparison (Test: PUT - Connections: 500 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 500 - - Average Latency) 100 1000 15 30 45 60 75 SE +/- 0.25, N = 9 SE +/- 0.71, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.26, N = 9 SE +/- 0.73, N = 3 SE +/- 0.06, N = 3 SE +/- 0.21, N = 3 12.8 67.8 5.9 40.6 13.2 58.7 6.1 41.9
etcd Comparison (Test: PUT - Connections: 500 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 500 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.25, N = 9 SE +/- 0.06, N = 3 SE +/- 0.26, N = 9 SE +/- 0.06, N = 3 12.8 5.9 13.2 6.1
etcd Test Comparison (Connections: 500 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 1000) RANGE PUT 5K 10K 15K 20K 25K SE +/- 181.75, N = 3 SE +/- 131.09, N = 3 SE +/- 44.26, N = 3 SE +/- 6.47, N = 3 SE +/- 379.06, N = 6 SE +/- 178.58, N = 3 SE +/- 41.44, N = 3 SE +/- 76.06, N = 3 13685.59 13947.87 22948.34 22994.38 15827.12 16043.00 21829.11 21936.54
etcd Connections Comparison (Test: RANGE - - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 1000) 500 100 50 7K 14K 21K 28K 35K SE +/- 181.75, N = 3 SE +/- 438.82, N = 9 SE +/- 428.03, N = 9 SE +/- 44.26, N = 3 SE +/- 136.35, N = 3 SE +/- 208.41, N = 3 SE +/- 379.06, N = 6 SE +/- 414.34, N = 12 SE +/- 466.92, N = 12 SE +/- 41.44, N = 3 SE +/- 123.00, N = 3 SE +/- 55.90, N = 3 13685.59 15177.05 15862.12 22948.34 30214.10 32275.15 15827.12 18202.36 18635.50 21829.11 28883.95 30789.21
etcd Clients Comparison (Test: RANGE - Connections: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 500) 1000 100 5K 10K 15K 20K 25K SE +/- 181.75, N = 3 SE +/- 186.80, N = 6 SE +/- 44.26, N = 3 SE +/- 32.79, N = 3 SE +/- 379.06, N = 6 SE +/- 157.07, N = 9 SE +/- 41.44, N = 3 SE +/- 51.80, N = 3 13685.59 7871.69 22948.34 16375.19 15827.12 7311.14 21829.11 15844.21
etcd Test Comparison (Connections: 500 - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 1000 - Average Latency) PUT RANGE 15 30 45 60 75 SE +/- 0.71, N = 3 SE +/- 0.98, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 SE +/- 0.73, N = 3 SE +/- 1.51, N = 6 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 67.8 69.2 40.6 40.7 58.7 59.8 41.9 42.2
etcd Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency) 500 100 50 15 30 45 60 75 SE +/- 0.71, N = 3 SE +/- 1.82, N = 9 SE +/- 1.79, N = 9 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.73, N = 3 SE +/- 1.74, N = 12 SE +/- 1.66, N = 12 SE +/- 0.21, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 67.8 63.0 59.0 40.6 31.7 29.9 58.7 50.9 50.3 41.9 32.6 30.9
etcd Comparison (Test: PUT - Connections: 500 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 500 - Clients: 1000) Average Latency 15 30 45 60 75 SE +/- 0.71, N = 3 SE +/- 0.00, N = 3 SE +/- 0.73, N = 3 SE +/- 0.21, N = 3 67.8 40.6 58.7 41.9
etcd Connections Comparison (Test: PUT - - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Connections Comparison (Test: PUT - - Clients: 1000) 500 100 50 7K 14K 21K 28K 35K SE +/- 131.09, N = 3 SE +/- 392.03, N = 9 SE +/- 452.84, N = 9 SE +/- 6.47, N = 3 SE +/- 119.58, N = 3 SE +/- 166.43, N = 3 SE +/- 178.58, N = 3 SE +/- 530.09, N = 12 SE +/- 523.12, N = 12 SE +/- 76.06, N = 3 SE +/- 97.95, N = 3 SE +/- 97.60, N = 3 13947.87 15482.13 16573.19 22994.38 30106.84 32076.41 16043.00 19163.35 19495.97 21936.54 28950.57 30813.77
etcd Clients Comparison (Test: PUT - Connections: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 500) 1000 100 5K 10K 15K 20K 25K SE +/- 131.09, N = 3 SE +/- 154.99, N = 9 SE +/- 6.47, N = 3 SE +/- 210.10, N = 3 SE +/- 178.58, N = 3 SE +/- 162.97, N = 9 SE +/- 76.06, N = 3 SE +/- 107.83, N = 3 13947.87 7773.68 22994.38 16740.45 16043.00 7555.48 21936.54 16067.27
etcd Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency) 500 100 50 15 30 45 60 75 SE +/- 0.98, N = 3 SE +/- 2.12, N = 9 SE +/- 1.90, N = 9 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.22, N = 3 SE +/- 1.51, N = 6 SE +/- 1.57, N = 12 SE +/- 1.59, N = 12 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 69.2 64.4 61.8 40.7 31.6 29.7 59.8 53.5 52.6 42.2 32.7 31.0
etcd Comparison (Test: RANGE - Connections: 500 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 500 - Clients: 1000) Average Latency 15 30 45 60 75 SE +/- 0.98, N = 3 SE +/- 0.12, N = 3 SE +/- 1.51, N = 6 SE +/- 0.06, N = 3 69.2 40.7 59.8 42.2
etcd Test Comparison (Connections: 100 - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 1000 - Average Latency) RANGE PUT 14 28 42 56 70 SE +/- 2.12, N = 9 SE +/- 1.82, N = 9 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 1.57, N = 12 SE +/- 1.74, N = 12 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 64.4 63.0 31.6 31.7 53.5 50.9 32.7 32.6
etcd Comparison (Test: RANGE - Connections: 100 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 100 - Clients: 1000) Average Latency 14 28 42 56 70 SE +/- 2.12, N = 9 SE +/- 0.15, N = 3 SE +/- 1.57, N = 12 SE +/- 0.18, N = 3 64.4 31.6 53.5 32.7
etcd Test Comparison (Connections: 100 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 100 - Clients: 1000) RANGE PUT 6K 12K 18K 24K 30K SE +/- 438.82, N = 9 SE +/- 392.03, N = 9 SE +/- 136.35, N = 3 SE +/- 119.58, N = 3 SE +/- 414.34, N = 12 SE +/- 530.09, N = 12 SE +/- 123.00, N = 3 SE +/- 97.95, N = 3 15177.05 15482.13 30214.10 30106.84 18202.36 19163.35 28883.95 28950.57
etcd Test Comparison (Connections: 500 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 500 - Clients: 100) RANGE PUT 4K 8K 12K 16K 20K SE +/- 186.80, N = 6 SE +/- 154.99, N = 9 SE +/- 32.79, N = 3 SE +/- 210.10, N = 3 SE +/- 157.07, N = 9 SE +/- 162.97, N = 9 SE +/- 51.80, N = 3 SE +/- 107.83, N = 3 7871.69 7773.68 16375.19 16740.45 7311.14 7555.48 15844.21 16067.27
etcd Test Comparison (Connections: 50 - Clients: 1000 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 1000 - Average Latency) RANGE PUT 14 28 42 56 70 SE +/- 1.90, N = 9 SE +/- 1.79, N = 9 SE +/- 0.22, N = 3 SE +/- 0.18, N = 3 SE +/- 1.59, N = 12 SE +/- 1.66, N = 12 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 61.8 59.0 29.7 29.9 52.6 50.3 31.0 30.9
etcd Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency) 1000 100 14 28 42 56 70 SE +/- 1.90, N = 9 SE +/- 0.23, N = 9 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 1.59, N = 12 SE +/- 0.31, N = 9 SE +/- 0.07, N = 3 SE +/- 0.05, N = 6 61.8 12.2 29.7 5.6 52.6 12.4 31.0 5.6
etcd Comparison (Test: RANGE - Connections: 50 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 50 - Clients: 1000) Average Latency 14 28 42 56 70 SE +/- 1.90, N = 9 SE +/- 0.22, N = 3 SE +/- 1.59, N = 12 SE +/- 0.07, N = 3 61.8 29.7 52.6 31.0
etcd Test Comparison (Connections: 50 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 1000) RANGE PUT 7K 14K 21K 28K 35K SE +/- 428.03, N = 9 SE +/- 452.84, N = 9 SE +/- 208.41, N = 3 SE +/- 166.43, N = 3 SE +/- 466.92, N = 12 SE +/- 523.12, N = 12 SE +/- 55.90, N = 3 SE +/- 97.60, N = 3 15862.12 16573.19 32275.15 32076.41 18635.50 19495.97 30789.21 30813.77
etcd Clients Comparison (Test: RANGE - Connections: 50) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: RANGE - Connections: 50) 1000 100 7K 14K 21K 28K 35K SE +/- 428.03, N = 9 SE +/- 162.99, N = 9 SE +/- 208.41, N = 3 SE +/- 149.49, N = 3 SE +/- 466.92, N = 12 SE +/- 213.67, N = 9 SE +/- 55.90, N = 3 SE +/- 170.29, N = 6 15862.12 8177.71 32275.15 17702.59 18635.50 8026.12 30789.21 17733.58
etcd Test Comparison (Connections: 50 - Clients: 100 - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 100 - Average Latency) RANGE PUT 3 6 9 12 15 SE +/- 0.23, N = 9 SE +/- 0.57, N = 9 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.31, N = 9 SE +/- 0.55, N = 9 SE +/- 0.05, N = 6 SE +/- 0.00, N = 3 12.2 11.3 5.6 5.5 12.4 11.1 5.6 5.6
etcd Comparison (Test: RANGE - Connections: 50 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: RANGE - Connections: 50 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.23, N = 9 SE +/- 0.06, N = 3 SE +/- 0.31, N = 9 SE +/- 0.05, N = 6 12.2 5.6 12.4 5.6
etcd Test Comparison (Connections: 50 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test Comparison (Connections: 50 - Clients: 100) RANGE PUT 4K 8K 12K 16K 20K SE +/- 162.99, N = 9 SE +/- 548.13, N = 9 SE +/- 149.49, N = 3 SE +/- 103.48, N = 3 SE +/- 213.67, N = 9 SE +/- 580.79, N = 9 SE +/- 170.29, N = 6 SE +/- 13.84, N = 3 8177.71 9019.79 17702.59 17919.74 8026.12 9143.01 17733.58 17625.64
etcd Comparison (Test: PUT - Connections: 100 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 100 - Clients: 1000) Average Latency 14 28 42 56 70 SE +/- 1.82, N = 9 SE +/- 0.12, N = 3 SE +/- 1.74, N = 12 SE +/- 0.13, N = 3 63.0 31.7 50.9 32.6
etcd Clients Comparison (Test: PUT - Connections: 50 - - Average Latency) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 50 - - Average Latency) 1000 100 13 26 39 52 65 SE +/- 1.79, N = 9 SE +/- 0.57, N = 9 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 1.66, N = 12 SE +/- 0.55, N = 9 SE +/- 0.12, N = 3 SE +/- 0.00, N = 3 59.0 11.3 29.9 5.5 50.3 11.1 30.9 5.6
etcd Comparison (Test: PUT - Connections: 50 - Clients: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 50 - Clients: 1000) Average Latency 13 26 39 52 65 SE +/- 1.79, N = 9 SE +/- 0.18, N = 3 SE +/- 1.66, N = 12 SE +/- 0.12, N = 3 59.0 29.9 50.3 30.9
etcd Clients Comparison (Test: PUT - Connections: 50) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Clients Comparison (Test: PUT - Connections: 50) 1000 100 7K 14K 21K 28K 35K SE +/- 452.84, N = 9 SE +/- 548.13, N = 9 SE +/- 166.43, N = 3 SE +/- 103.48, N = 3 SE +/- 523.12, N = 12 SE +/- 580.79, N = 9 SE +/- 97.60, N = 3 SE +/- 13.84, N = 3 16573.19 9019.79 32076.41 17919.74 19495.97 9143.01 30813.77 17625.64
etcd Comparison (Test: PUT - Connections: 50 - Clients: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Comparison (Test: PUT - Connections: 50 - Clients: 100) Average Latency 3 6 9 12 15 SE +/- 0.57, N = 9 SE +/- 0.03, N = 3 SE +/- 0.55, N = 9 SE +/- 0.00, N = 3 11.3 5.5 11.1 5.6
FLAC Audio Encoding Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.4 Comparison WAV To FLAC 20 40 60 80 100 SE +/- 0.33, N = 25 SE +/- 0.14, N = 5 SE +/- 0.55, N = 25 SE +/- 0.02, N = 5 SE +/- 0.45, N = 5 54.31 45.33 51.60 43.51 90.29 1. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm
LAME MP3 Encoding Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.100 Comparison WAV To MP3 6 12 18 24 30 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 13.05 12.50 11.89 11.96 24.37 1. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm
Opus Codec Encoding Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better Opus Codec Encoding 1.4 Comparison WAV To Opus Encode 30 60 90 120 150 SE +/- 0.17, N = 5 SE +/- 0.02, N = 5 SE +/- 0.31, N = 5 SE +/- 0.02, N = 5 SE +/- 0.17, N = 5 71.50 67.62 65.45 64.44 129.79 1. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm
TSCP Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org Nodes Per Second, More Is Better TSCP 1.81 Comparison AI Chess Performance 200K 400K 600K 800K 1000K SE +/- 370.48, N = 5 SE +/- 1140.25, N = 5 SE +/- 238.60, N = 5 SE +/- 239.20, N = 5 SE +/- 350.28, N = 5 SE +/- 463.49, N = 5 738507 772486 810921 812117 887779 445471 1. (CC) gcc options: -O3 -march=native
WavPack Audio Encoding Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better WavPack Audio Encoding 5.3 Comparison WAV To WavPack 40 80 120 160 200 SE +/- 0.07, N = 5 SE +/- 0.13, N = 5 SE +/- 0.05, N = 5 SE +/- 0.08, N = 5 104.04 99.62 94.62 188.00 1. (CXX) g++ options: -rdynamic
Timed Wasmer Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Comparison Time To Compile 80 160 240 320 400 SE +/- 0.59, N = 3 SE +/- 0.10, N = 3 SE +/- 1.67, N = 3 SE +/- 1.65, N = 3 SE +/- 0.79, N = 3 215.92 204.89 198.46 188.16 372.86 1. (CC) gcc options: -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs
N-Queens Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better N-Queens 1.0 Comparison Elapsed Time 20 40 60 80 100 SE +/- 0.70, N = 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 59.48 55.76 56.18 56.24 63.00 109.66 1. (CC) gcc options: -static -fopenmp -O3 -march=native
Timed Godot Game Engine Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Comparison Time To Compile 800 1600 2400 3200 4000 SE +/- 7.67, N = 3 SE +/- 4.62, N = 3 SE +/- 4.83, N = 3 SE +/- 6.78, N = 3 SE +/- 3.05, N = 3 1922.64 1852.59 1835.92 1844.36 3498.30
Timed ImageMagick Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed ImageMagick Compilation 6.9.0 Comparison Time To Compile 50 100 150 200 250 SE +/- 0.66, N = 3 SE +/- 0.50, N = 3 SE +/- 0.41, N = 3 SE +/- 0.43, N = 3 SE +/- 0.49, N = 3 120.10 115.09 114.08 112.86 211.59
Timed Linux Kernel Compilation Build Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build Comparison allmodconfig defconfig 2K 4K 6K 8K 10K SE +/- 4.42, N = 3 SE +/- 1.10, N = 3 SE +/- 1.62, N = 3 SE +/- 1.28, N = 3 SE +/- 1.83, N = 3 SE +/- 5.72, N = 3 SE +/- 2.80, N = 3 SE +/- 2.04, N = 3 SE +/- 14.83, N = 3 SE +/- 9.15, N = 3 5759.51 1199.61 5536.03 1160.50 5375.95 1138.20 5371.02 1131.97 9463.57 1904.55
Timed MPlayer Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed MPlayer Compilation 1.5 Comparison Time To Compile 60 120 180 240 300 SE +/- 0.66, N = 3 SE +/- 1.17, N = 3 SE +/- 1.75, N = 3 SE +/- 1.68, N = 3 SE +/- 0.06, N = 3 158.06 152.52 148.87 150.11 254.69
Build2 Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Build2 0.15 Comparison Time To Compile 200 400 600 800 1000 SE +/- 1.02, N = 3 SE +/- 2.62, N = 3 SE +/- 2.22, N = 3 SE +/- 3.79, N = 3 SE +/- 4.32, N = 3 688.05 673.85 668.87 669.64 1064.90
Timed GDB GNU Debugger Compilation Comparison rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed GDB GNU Debugger Compilation 10.2 Comparison Time To Compile 90 180 270 360 450 SE +/- 1.39, N = 3 SE +/- 1.63, N = 3 249.25 393.65
Timed CPython Compilation Build Configuration Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration Comparison Default Released Build, PGO + LTO Optimized 200 400 600 800 1000 66.13 784.30 59.76 744.60 60.52 764.72 61.47 783.87 93.78 862.02
Timed PHP Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.1.9 Comparison Time To Compile 110 220 330 440 550 SE +/- 4.51, N = 3 SE +/- 1.19, N = 3 SE +/- 2.82, N = 3 SE +/- 2.08, N = 3 SE +/- 1.64, N = 3 364.44 334.21 346.68 343.16 519.40
Apache CouchDB Bulk Size Comparison (Inserts: 1000 - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Bulk Size Comparison (Inserts: 1000 - Rounds: 30) 500 300 100 150 300 450 600 750 SE +/- 0.74, N = 3 SE +/- 2.78, N = 3 SE +/- 3.82, N = 9 SE +/- 0.51, N = 3 SE +/- 3.79, N = 3 SE +/- 2.31, N = 3 SE +/- 3.77, N = 3 SE +/- 1.83, N = 3 SE +/- 2.80, N = 9 SE +/- 2.58, N = 3 SE +/- 0.91, N = 3 SE +/- 2.59, N = 6 464.69 377.97 262.44 438.30 366.67 247.76 676.09 384.07 266.25 679.40 394.74 258.52 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Inserts Comparison (Bulk Size: 500 - - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Inserts Comparison (Bulk Size: 500 - - Rounds: 30) 1000 3000 500 1000 1500 2000 2500 SE +/- 0.74, N = 3 SE +/- 0.87, N = 3 SE +/- 0.51, N = 3 SE +/- 1.95, N = 3 SE +/- 3.77, N = 3 SE +/- 11.33, N = 3 SE +/- 2.58, N = 3 SE +/- 13.77, N = 3 464.69 2261.83 438.30 2158.52 676.09 2083.07 679.40 2140.74 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 500 - Inserts: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 500 - Inserts: 1000) 30 150 300 450 600 750 SE +/- 0.74, N = 3 SE +/- 0.51, N = 3 SE +/- 3.77, N = 3 SE +/- 2.58, N = 3 464.69 438.30 676.09 679.40 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Bulk Size Comparison (Inserts: 3000 - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Bulk Size Comparison (Inserts: 3000 - Rounds: 30) 500 100 300 500 1000 1500 2000 2500 SE +/- 0.87, N = 3 SE +/- 1.11, N = 3 SE +/- 14.88, N = 5 SE +/- 1.95, N = 3 SE +/- 0.84, N = 3 SE +/- 2.19, N = 3 SE +/- 11.33, N = 3 SE +/- 1.88, N = 3 SE +/- 31.00, N = 9 SE +/- 13.77, N = 3 SE +/- 10.18, N = 3 SE +/- 2.59, N = 3 2261.83 887.89 1412.82 2158.52 860.53 1314.73 2083.07 855.61 1492.53 2140.74 871.54 1444.00 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 500 - Inserts: 3000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 500 - Inserts: 3000) 30 500 1000 1500 2000 2500 SE +/- 0.87, N = 3 SE +/- 1.95, N = 3 SE +/- 11.33, N = 3 SE +/- 13.77, N = 3 2261.83 2158.52 2083.07 2140.74 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Inserts Comparison (Bulk Size: 300 - - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Inserts Comparison (Bulk Size: 300 - - Rounds: 30) 1000 3000 300 600 900 1200 1500 SE +/- 2.78, N = 3 SE +/- 14.88, N = 5 SE +/- 3.79, N = 3 SE +/- 2.19, N = 3 SE +/- 1.83, N = 3 SE +/- 31.00, N = 9 SE +/- 0.91, N = 3 SE +/- 2.59, N = 3 377.97 1412.82 366.67 1314.73 384.07 1492.53 394.74 1444.00 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 300 - Inserts: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 300 - Inserts: 1000) 30 90 180 270 360 450 SE +/- 2.78, N = 3 SE +/- 3.79, N = 3 SE +/- 1.83, N = 3 SE +/- 0.91, N = 3 377.97 366.67 384.07 394.74 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Inserts Comparison (Bulk Size: 100 - - Rounds: 30) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Inserts Comparison (Bulk Size: 100 - - Rounds: 30) 1000 3000 200 400 600 800 1000 SE +/- 3.82, N = 9 SE +/- 1.11, N = 3 SE +/- 2.31, N = 3 SE +/- 0.84, N = 3 SE +/- 2.80, N = 9 SE +/- 1.88, N = 3 SE +/- 2.59, N = 6 SE +/- 10.18, N = 3 262.44 887.89 247.76 860.53 266.25 855.61 258.52 871.54 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 100 - Inserts: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 100 - Inserts: 1000) 30 60 120 180 240 300 SE +/- 3.82, N = 9 SE +/- 2.31, N = 3 SE +/- 2.80, N = 9 SE +/- 2.59, N = 6 262.44 247.76 266.25 258.52 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 100 - Inserts: 3000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 100 - Inserts: 3000) 30 200 400 600 800 1000 SE +/- 1.11, N = 3 SE +/- 0.84, N = 3 SE +/- 1.88, N = 3 SE +/- 10.18, N = 3 887.89 860.53 855.61 871.54 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB Rounds Comparison (Bulk Size: 300 - Inserts: 3000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.3.2 Rounds Comparison (Bulk Size: 300 - Inserts: 3000) 30 300 600 900 1200 1500 SE +/- 14.88, N = 5 SE +/- 2.19, N = 3 SE +/- 31.00, N = 9 SE +/- 2.59, N = 3 1412.82 1314.73 1492.53 1444.00 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Timed Erlang/OTP Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Erlang/OTP Compilation 25.0 Comparison Time To Compile 90 180 270 360 450 SE +/- 0.61, N = 3 SE +/- 0.12, N = 3 SE +/- 0.77, N = 3 SE +/- 0.74, N = 3 SE +/- 0.17, N = 3 310.70 298.12 301.84 330.42 405.21
Apache Spark Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark) 1000000 40000000 20000000 10000000 160 320 480 640 800 SE +/- 10.10, N = 3 SE +/- 6.99, N = 3 SE +/- 17.41, N = 3 SE +/- 3.66, N = 3 SE +/- 3.62, N = 3 SE +/- 4.60, N = 3 SE +/- 4.56, N = 3 SE +/- 3.78, N = 3 SE +/- 0.64, N = 3 SE +/- 0.86, N = 3 SE +/- 0.79, N = 3 SE +/- 1.02, N = 3 SE +/- 1.70, N = 3 SE +/- 0.55, N = 3 SE +/- 0.67, N = 3 SE +/- 0.62, N = 3 733.90 728.26 714.05 692.06 685.12 690.62 683.57 684.23 580.99 580.30 581.12 579.55 579.16 579.01 583.11 581.78
Apache Spark Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark) 500 2000 100 1000 160 320 480 640 800 SE +/- 10.10, N = 3 SE +/- 5.14, N = 3 SE +/- 9.68, N = 4 SE +/- 1.88, N = 3 SE +/- 3.62, N = 3 SE +/- 8.22, N = 3 SE +/- 1.77, N = 3 SE +/- 1.43, N = 3 SE +/- 0.64, N = 3 SE +/- 0.47, N = 9 SE +/- 1.54, N = 3 SE +/- 0.54, N = 4 SE +/- 1.70, N = 3 SE +/- 0.55, N = 3 SE +/- 0.46, N = 5 SE +/- 2.32, N = 3 733.90 733.77 727.52 717.10 685.12 690.63 694.41 695.32 580.99 580.68 581.45 580.24 579.16 582.61 581.85 583.50
Apache Spark Comparison (Row Count: 1000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 500) Calculate Pi Benchmark SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Repartition Test Time Group By Test Time Broadcast Inner Join Test Time Inner Join Test Time 160 320 480 640 800 SE +/- 10.096513371, N = 3 SE +/- 0.075456756, N = 3 SE +/- 0.158253119, N = 3 SE +/- 0.037643391, N = 3 SE +/- 0.085288962, N = 3 SE +/- 0.094366471, N = 3 SE +/- 0.056766652, N = 3 SE +/- 3.616590948, N = 3 SE +/- 0.073904401, N = 3 SE +/- 0.155432056, N = 3 SE +/- 0.076523207, N = 3 SE +/- 0.188967987, N = 3 SE +/- 0.103211248, N = 3 SE +/- 0.103943425, N = 3 SE +/- 0.635610275, N = 3 SE +/- 0.026873455, N = 3 SE +/- 0.017302603, N = 3 SE +/- 0.101989022, N = 3 SE +/- 0.152630685, N = 3 SE +/- 0.063047733, N = 3 SE +/- 0.517942458, N = 3 SE +/- 1.696546131, N = 3 SE +/- 0.114204323, N = 3 SE +/- 0.016927629, N = 3 SE +/- 0.069154351, N = 3 SE +/- 0.086808001, N = 3 SE +/- 0.486110869, N = 3 SE +/- 0.043852959, N = 3 733.900000000 11.230000000 33.760000000 9.460000000 10.130000000 6.620000000 7.260000000 685.120000000 10.430000000 32.270000000 9.100000000 9.950000000 6.290000000 7.010000000 580.990000000 9.890000000 31.790000000 9.000000000 9.840000000 6.120000000 7.530000000 579.160667240 10.480000000 31.720000000 9.210000000 10.030000000 6.510000000 7.030000000
Apache Spark Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark) 1000000 20000000 10000000 40000000 160 320 480 640 800 SE +/- 5.14, N = 3 SE +/- 22.40, N = 3 SE +/- 13.31, N = 3 SE +/- 16.56, N = 3 SE +/- 8.22, N = 3 SE +/- 2.10, N = 3 SE +/- 6.18, N = 3 SE +/- 8.50, N = 3 SE +/- 0.47, N = 9 SE +/- 1.08, N = 3 SE +/- 0.41, N = 3 SE +/- 0.49, N = 3 SE +/- 0.55, N = 3 SE +/- 0.28, N = 3 SE +/- 0.51, N = 3 SE +/- 1.28, N = 3 733.77 723.32 711.60 710.71 690.63 681.91 699.96 695.17 580.68 579.87 581.17 580.86 582.61 581.10 577.92 579.55
Apache Spark Comparison (Row Count: 1000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 2000) Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Broadcast Inner Join Test Time Repartition Test Time Group By Test Time SHA-512 Benchmark Time Inner Join Test Time 160 320 480 640 800 SE +/- 5.138863712, N = 3 SE +/- 0.013599313, N = 3 SE +/- 0.177939327, N = 3 SE +/- 0.181687585, N = 3 SE +/- 0.146972816, N = 3 SE +/- 0.139768323, N = 3 SE +/- 0.098619535, N = 3 SE +/- 8.221686317, N = 3 SE +/- 0.230080533, N = 3 SE +/- 0.011049874, N = 3 SE +/- 0.042552140, N = 3 SE +/- 0.090717982, N = 3 SE +/- 0.112867497, N = 3 SE +/- 0.094249006, N = 3 SE +/- 0.468273880, N = 9 SE +/- 0.090240232, N = 9 SE +/- 0.128969955, N = 9 SE +/- 0.039688685, N = 9 SE +/- 0.134671941, N = 9 SE +/- 0.121232499, N = 9 SE +/- 0.501143304, N = 9 SE +/- 0.548006604, N = 3 SE +/- 0.123827132, N = 3 SE +/- 0.269877699, N = 3 SE +/- 0.155773144, N = 3 SE +/- 0.230601906, N = 3 SE +/- 0.113414449, N = 3 SE +/- 0.401879123, N = 3 733.770000000 33.790000000 8.580000000 11.010000000 13.020000000 12.960000000 10.690000000 690.630000000 32.030000000 8.040000000 10.710000000 12.860000000 12.550000000 10.680000000 580.680000000 31.560000000 8.370000000 10.570000000 12.830000000 12.630000000 11.060000000 582.614894707 31.680000000 8.410000000 10.850000000 13.310000000 12.880000000 10.890000000
Apache Spark Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark) 500 100 1000 2000 160 320 480 640 800 SE +/- 6.99, N = 3 SE +/- 8.88, N = 3 SE +/- 14.94, N = 3 SE +/- 16.56, N = 3 SE +/- 4.60, N = 3 SE +/- 1.80, N = 3 SE +/- 6.51, N = 3 SE +/- 8.50, N = 3 SE +/- 0.86, N = 3 SE +/- 0.87, N = 3 SE +/- 0.56, N = 3 SE +/- 0.49, N = 3 SE +/- 0.55, N = 3 SE +/- 0.68, N = 3 SE +/- 1.66, N = 3 SE +/- 1.28, N = 3 728.26 724.99 721.00 710.71 690.62 694.62 697.90 695.17 580.30 579.98 581.69 580.86 579.01 581.19 581.60 579.55
Apache Spark Comparison (Row Count: 40000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 500) Calculate Pi Benchmark SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Broadcast Inner Join Test Time Repartition Test Time Inner Join Test Time Group By Test Time 160 320 480 640 800 SE +/- 6.99, N = 3 SE +/- 0.26, N = 3 SE +/- 0.10, N = 3 SE +/- 4.60, N = 3 SE +/- 0.55, N = 3 SE +/- 0.36, N = 3 SE +/- 0.85, N = 3 SE +/- 0.58, N = 3 SE +/- 0.39, N = 3 SE +/- 4.05, N = 3 SE +/- 0.86, N = 3 SE +/- 0.48, N = 3 SE +/- 0.11, N = 3 SE +/- 0.55, N = 3 SE +/- 1.56, N = 3 SE +/- 0.09, N = 3 SE +/- 0.76, N = 3 SE +/- 0.84, N = 3 SE +/- 1.02, N = 3 SE +/- 1.17, N = 3 728.26 189.39 33.77 690.62 183.20 31.96 157.08 138.04 158.11 89.23 580.30 172.06 31.51 579.01 172.69 31.71 147.55 131.53 152.21 82.35
Apache Spark Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark) 1000000 40000000 10000000 20000000 160 320 480 640 800 SE +/- 9.68, N = 4 SE +/- 8.88, N = 3 SE +/- 3.83, N = 3 SE +/- 8.94, N = 3 SE +/- 1.77, N = 3 SE +/- 1.80, N = 3 SE +/- 7.97, N = 3 SE +/- 8.48, N = 3 SE +/- 1.54, N = 3 SE +/- 0.87, N = 3 SE +/- 1.47, N = 3 SE +/- 1.38, N = 3 SE +/- 0.46, N = 5 SE +/- 0.68, N = 3 SE +/- 0.70, N = 3 SE +/- 3.74, N = 3 727.52 724.99 722.90 713.91 694.41 694.62 681.48 694.61 581.45 579.98 581.85 580.52 581.85 581.19 580.29 582.87
Apache Spark Comparison (Row Count: 1000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 100) Calculate Pi Benchmark SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Repartition Test Time Broadcast Inner Join Test Time Group By Test Time Inner Join Test Time 160 320 480 640 800 SE +/- 9.681628257, N = 4 SE +/- 0.113137090, N = 4 SE +/- 0.122562063, N = 4 SE +/- 0.025356347, N = 4 SE +/- 0.085253143, N = 4 SE +/- 0.023541873, N = 4 SE +/- 0.134671456, N = 4 SE +/- 1.768265132, N = 3 SE +/- 0.038555282, N = 3 SE +/- 0.257940983, N = 3 SE +/- 0.084920457, N = 3 SE +/- 0.102452612, N = 3 SE +/- 0.129389851, N = 3 SE +/- 0.004165140, N = 3 SE +/- 1.541717417, N = 3 SE +/- 0.093919752, N = 3 SE +/- 0.039099097, N = 3 SE +/- 0.070931558, N = 3 SE +/- 0.076264083, N = 3 SE +/- 0.130013375, N = 3 SE +/- 0.294062371, N = 3 SE +/- 0.461842438, N = 5 SE +/- 0.101368246, N = 5 SE +/- 0.089037280, N = 5 SE +/- 0.034264151, N = 5 SE +/- 0.069228259, N = 5 SE +/- 0.081615689, N = 5 SE +/- 0.044993077, N = 5 727.520000000 10.010000000 33.760000000 9.080000000 5.720000000 9.070000000 6.590000000 694.410000000 9.500000000 32.140000000 8.790000000 5.690000000 8.810000000 6.250000000 581.450000000 9.340000000 31.840000000 8.620000000 5.500000000 8.750000000 6.540000000 581.852210785 9.560000000 31.630000000 8.750000000 5.450000000 9.090000000 6.040000000
Apache Spark Comparison (Row Count: 40000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 100) Calculate Pi Benchmark SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Broadcast Inner Join Test Time Repartition Test Time Inner Join Test Time Group By Test Time 160 320 480 640 800 SE +/- 8.88, N = 3 SE +/- 0.34, N = 3 SE +/- 0.05, N = 3 SE +/- 1.80, N = 3 SE +/- 0.84, N = 3 SE +/- 0.23, N = 3 SE +/- 2.32, N = 3 SE +/- 1.31, N = 3 SE +/- 1.75, N = 3 SE +/- 2.29, N = 3 SE +/- 0.87, N = 3 SE +/- 0.58, N = 3 SE +/- 0.38, N = 3 SE +/- 0.68, N = 3 SE +/- 0.82, N = 3 SE +/- 0.10, N = 3 SE +/- 0.60, N = 3 SE +/- 0.42, N = 3 SE +/- 1.45, N = 3 SE +/- 3.33, N = 3 724.99 195.45 33.63 694.62 190.03 32.08 159.01 137.28 157.88 87.32 579.98 177.81 31.57 581.19 178.89 31.79 150.05 131.38 152.87 88.01
Apache Spark Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark) 20000000 10000000 40000000 1000000 160 320 480 640 800 SE +/- 11.19, N = 3 SE +/- 5.58, N = 3 SE +/- 14.94, N = 3 SE +/- 1.88, N = 3 SE +/- 2.66, N = 3 SE +/- 4.78, N = 3 SE +/- 6.51, N = 3 SE +/- 1.43, N = 3 SE +/- 0.66, N = 3 SE +/- 1.40, N = 3 SE +/- 0.56, N = 3 SE +/- 0.54, N = 4 SE +/- 1.10, N = 3 SE +/- 0.29, N = 3 SE +/- 1.66, N = 3 SE +/- 2.32, N = 3 722.93 722.36 721.00 717.10 687.06 690.24 697.90 695.32 579.19 580.37 581.69 580.24 580.24 580.46 581.60 583.50
Apache Spark Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark) 1000 2000 100 500 160 320 480 640 800 SE +/- 11.19, N = 3 SE +/- 22.40, N = 3 SE +/- 8.94, N = 3 SE +/- 17.41, N = 3 SE +/- 2.66, N = 3 SE +/- 2.10, N = 3 SE +/- 8.48, N = 3 SE +/- 4.56, N = 3 SE +/- 0.66, N = 3 SE +/- 1.08, N = 3 SE +/- 1.38, N = 3 SE +/- 0.79, N = 3 SE +/- 1.10, N = 3 SE +/- 0.28, N = 3 SE +/- 3.74, N = 3 SE +/- 0.67, N = 3 722.93 723.32 713.91 714.05 687.06 681.91 694.61 683.57 579.19 579.87 580.52 581.12 580.24 581.10 582.87 583.11
Apache Spark Comparison (Row Count: 20000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 1000) Calculate Pi Benchmark Broadcast Inner Join Test Time SHA-512 Benchmark Time Repartition Test Time Inner Join Test Time Calculate Pi Benchmark Using Dataframe Group By Test Time 160 320 480 640 800 SE +/- 11.19, N = 3 SE +/- 0.51, N = 3 SE +/- 0.20, N = 3 SE +/- 0.23, N = 3 SE +/- 0.32, N = 3 SE +/- 0.19, N = 3 SE +/- 0.79, N = 3 SE +/- 2.66, N = 3 SE +/- 0.09, N = 3 SE +/- 0.20, N = 3 SE +/- 0.23, N = 3 SE +/- 0.42, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.66, N = 3 SE +/- 0.83, N = 3 SE +/- 0.29, N = 3 SE +/- 1.03, N = 3 SE +/- 0.86, N = 3 SE +/- 0.14, N = 3 SE +/- 2.03, N = 3 SE +/- 1.10, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.20, N = 3 SE +/- 0.52, N = 3 SE +/- 0.32, N = 3 SE +/- 0.44, N = 3 722.93 84.01 100.73 75.18 85.12 33.81 37.31 687.06 80.64 95.92 71.70 81.35 32.05 35.27 579.19 75.96 91.39 72.98 78.42 31.75 35.83 580.24 76.66 92.42 68.54 79.29 31.22 34.70
Apache Spark Comparison (Row Count: 20000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 2000) Calculate Pi Benchmark SHA-512 Benchmark Time Repartition Test Time Broadcast Inner Join Test Time Inner Join Test Time Calculate Pi Benchmark Using Dataframe Group By Test Time 160 320 480 640 800 SE +/- 22.40, N = 3 SE +/- 0.14, N = 3 SE +/- 0.46, N = 3 SE +/- 0.57, N = 3 SE +/- 0.28, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 2.10, N = 3 SE +/- 0.37, N = 3 SE +/- 0.20, N = 3 SE +/- 0.08, N = 3 SE +/- 0.31, N = 3 SE +/- 0.09, N = 3 SE +/- 0.46, N = 3 SE +/- 1.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.28, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 SE +/- 0.89, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.41, N = 3 723.32 101.15 75.44 83.94 86.43 33.91 37.35 681.91 97.65 72.28 81.25 83.64 32.21 36.72 579.87 91.96 31.61 581.10 92.19 69.09 77.56 80.41 31.66 37.16
Apache Spark Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark) 100 1000 2000 500 160 320 480 640 800 SE +/- 3.83, N = 3 SE +/- 5.58, N = 3 SE +/- 13.31, N = 3 SE +/- 3.66, N = 3 SE +/- 7.97, N = 3 SE +/- 4.78, N = 3 SE +/- 6.18, N = 3 SE +/- 3.78, N = 3 SE +/- 1.47, N = 3 SE +/- 1.40, N = 3 SE +/- 0.41, N = 3 SE +/- 1.02, N = 3 SE +/- 0.70, N = 3 SE +/- 0.29, N = 3 SE +/- 0.51, N = 3 SE +/- 0.62, N = 3 722.90 722.36 711.60 692.06 681.48 690.24 699.96 684.23 581.85 580.37 581.17 579.55 580.29 580.46 577.92 581.78
Apache Spark Comparison (Row Count: 10000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 100) Calculate Pi Benchmark Repartition Test Time Broadcast Inner Join Test Time SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Inner Join Test Time Group By Test Time 160 320 480 640 800 SE +/- 3.83, N = 3 SE +/- 0.56, N = 3 SE +/- 0.25, N = 3 SE +/- 0.32, N = 3 SE +/- 0.10, N = 3 SE +/- 0.26, N = 3 SE +/- 0.30, N = 3 SE +/- 7.97, N = 3 SE +/- 0.18, N = 3 SE +/- 0.71, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.25, N = 3 SE +/- 1.47, N = 3 SE +/- 0.76, N = 3 SE +/- 0.62, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 SE +/- 1.64, N = 3 SE +/- 3.06, N = 3 SE +/- 0.70, N = 3 SE +/- 0.43, N = 3 SE +/- 0.21, N = 3 SE +/- 0.39, N = 3 SE +/- 0.06, N = 3 SE +/- 1.37, N = 3 SE +/- 0.24, N = 3 722.90 41.28 47.10 57.05 34.02 47.52 25.05 681.48 38.29 44.26 55.28 32.35 43.58 23.50 581.85 38.58 43.19 52.69 31.49 43.88 26.62 580.29 37.07 42.85 52.88 31.97 43.71 23.90
Apache Spark Comparison (Row Count: 10000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 1000) Calculate Pi Benchmark Broadcast Inner Join Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Group By Test Time 160 320 480 640 800 SE +/- 5.58, N = 3 SE +/- 0.09, N = 3 SE +/- 0.40, N = 3 SE +/- 0.23, N = 3 SE +/- 0.22, N = 3 SE +/- 0.18, N = 3 SE +/- 0.35, N = 3 SE +/- 4.78, N = 3 SE +/- 0.16, N = 3 SE +/- 0.14, N = 3 SE +/- 0.22, N = 3 SE +/- 0.11, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 1.40, N = 3 SE +/- 1.25, N = 3 SE +/- 0.56, N = 3 SE +/- 0.54, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.36, N = 3 SE +/- 0.29, N = 3 SE +/- 0.36, N = 3 SE +/- 0.21, N = 3 SE +/- 0.31, N = 3 SE +/- 0.05, N = 3 SE +/- 0.26, N = 3 SE +/- 0.20, N = 3 722.36 43.47 45.60 39.96 53.52 34.00 23.89 690.24 41.98 44.00 38.61 51.64 32.24 22.29 580.37 40.90 43.30 39.31 49.21 31.66 22.44 580.46 39.22 41.49 36.72 49.45 31.36 22.62
Apache Spark Comparison (Row Count: 40000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 1000) Calculate Pi Benchmark Group By Test Time SHA-512 Benchmark Time Broadcast Inner Join Test Time Inner Join Test Time Calculate Pi Benchmark Using Dataframe Repartition Test Time 160 320 480 640 800 SE +/- 14.94, N = 3 SE +/- 0.54, N = 3 SE +/- 0.22, N = 3 SE +/- 6.51, N = 3 SE +/- 2.33, N = 3 SE +/- 0.13, N = 3 SE +/- 0.25, N = 3 SE +/- 1.92, N = 3 SE +/- 0.16, N = 3 SE +/- 0.83, N = 3 SE +/- 0.56, N = 3 SE +/- 0.77, N = 3 SE +/- 0.16, N = 3 SE +/- 1.66, N = 3 SE +/- 0.85, N = 3 SE +/- 0.48, N = 3 SE +/- 1.46, N = 3 SE +/- 1.83, N = 3 SE +/- 0.10, N = 3 SE +/- 0.93, N = 3 721.00 189.73 33.51 697.90 88.02 183.35 158.24 162.01 32.40 138.87 581.69 172.45 31.54 581.60 79.60 172.19 147.55 151.54 31.61 131.43
Apache Spark Comparison (Row Count: 1000000 - Partitions: 1000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 1000000 - Partitions: 1000) Calculate Pi Benchmark Calculate Pi Benchmark Using Dataframe Broadcast Inner Join Test Time SHA-512 Benchmark Time Group By Test Time Repartition Test Time Inner Join Test Time 150 300 450 600 750 SE +/- 1.88, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 1.43, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.54, N = 4 SE +/- 0.05, N = 4 SE +/- 0.06, N = 4 SE +/- 0.12, N = 4 SE +/- 0.08, N = 4 SE +/- 0.07, N = 4 SE +/- 0.63, N = 4 SE +/- 2.32, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 717.10 33.39 7.29 11.38 11.39 10.06 8.33 695.32 32.36 6.99 11.18 11.10 10.05 8.01 580.24 31.88 6.90 10.78 10.93 9.74 8.63 583.50 31.54 7.05 11.14 11.18 9.95 7.81
Apache Spark Comparison (Row Count: 10000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 2000) Calculate Pi Benchmark Broadcast Inner Join Test Time SHA-512 Benchmark Time Inner Join Test Time Calculate Pi Benchmark Using Dataframe Repartition Test Time Group By Test Time 150 300 450 600 750 SE +/- 13.31, N = 3 SE +/- 0.27, N = 3 SE +/- 0.39, N = 3 SE +/- 0.21, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.28, N = 3 SE +/- 6.18, N = 3 SE +/- 0.28, N = 3 SE +/- 0.34, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.21, N = 3 SE +/- 0.13, N = 3 SE +/- 0.41, N = 3 SE +/- 0.24, N = 3 SE +/- 0.36, N = 3 SE +/- 1.45, N = 3 SE +/- 0.14, N = 3 SE +/- 0.66, N = 3 SE +/- 0.22, N = 3 SE +/- 0.51, N = 3 SE +/- 0.13, N = 3 SE +/- 0.24, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.39, N = 3 711.60 44.59 55.17 47.67 33.96 40.50 24.85 699.96 42.90 53.04 45.74 31.92 39.22 24.09 581.17 40.93 50.80 47.61 31.66 39.33 24.10 577.92 41.16 51.09 44.23 31.58 37.94 24.13
Apache Spark Comparison (Row Count: 20000000 - Partitions: 100) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 100) Calculate Pi Benchmark Broadcast Inner Join Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time Group By Test Time Calculate Pi Benchmark Using Dataframe 150 300 450 600 750 SE +/- 8.94, N = 3 SE +/- 0.19, N = 3 SE +/- 0.57, N = 3 SE +/- 0.55, N = 3 SE +/- 0.22, N = 3 SE +/- 0.45, N = 3 SE +/- 0.32, N = 3 SE +/- 8.48, N = 3 SE +/- 0.43, N = 3 SE +/- 0.32, N = 3 SE +/- 0.33, N = 3 SE +/- 0.34, N = 3 SE +/- 0.32, N = 3 SE +/- 0.23, N = 3 SE +/- 1.38, N = 3 SE +/- 0.59, N = 3 SE +/- 1.13, N = 3 SE +/- 2.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.73, N = 3 SE +/- 0.07, N = 3 SE +/- 3.74, N = 3 SE +/- 0.55, N = 3 SE +/- 0.48, N = 3 SE +/- 0.15, N = 3 SE +/- 0.67, N = 3 SE +/- 0.47, N = 3 SE +/- 0.18, N = 3 713.91 82.03 83.98 74.32 96.68 37.11 33.73 694.61 79.21 80.90 71.59 93.79 35.51 32.24 580.52 73.60 75.68 72.35 88.81 34.66 31.81 582.87 74.60 76.87 68.12 89.48 34.41 31.62
Apache Spark Comparison (Row Count: 20000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 20000000 - Partitions: 500) Calculate Pi Benchmark Broadcast Inner Join Test Time SHA-512 Benchmark Time Inner Join Test Time Repartition Test Time Calculate Pi Benchmark Using Dataframe Group By Test Time 150 300 450 600 750 SE +/- 17.41, N = 3 SE +/- 0.30, N = 3 SE +/- 0.31, N = 3 SE +/- 0.56, N = 3 SE +/- 0.15, N = 3 SE +/- 0.25, N = 3 SE +/- 0.10, N = 3 SE +/- 4.56, N = 3 SE +/- 0.49, N = 3 SE +/- 0.11, N = 3 SE +/- 0.75, N = 3 SE +/- 0.12, N = 3 SE +/- 0.22, N = 3 SE +/- 0.72, N = 3 SE +/- 0.79, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.49, N = 3 SE +/- 0.84, N = 3 SE +/- 0.15, N = 3 SE +/- 4.59, N = 3 SE +/- 0.67, N = 3 SE +/- 0.73, N = 3 SE +/- 0.33, N = 3 SE +/- 0.10, N = 3 SE +/- 0.31, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 714.05 83.53 99.64 83.84 73.22 33.72 37.00 683.57 80.77 96.85 80.99 71.30 31.84 36.37 581.12 75.23 90.56 78.03 70.90 31.76 39.26 583.11 76.27 91.24 77.63 67.86 31.74 35.99
Apache Spark Comparison (Row Count: 40000000 - Partitions: 2000) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 40000000 - Partitions: 2000) Calculate Pi Benchmark SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Broadcast Inner Join Test Time Inner Join Test Time Repartition Test Time Group By Test Time 150 300 450 600 750 SE +/- 16.56, N = 3 SE +/- 0.40, N = 3 SE +/- 0.06, N = 3 SE +/- 8.50, N = 3 SE +/- 0.21, N = 3 SE +/- 0.31, N = 3 SE +/- 1.89, N = 3 SE +/- 1.46, N = 3 SE +/- 0.91, N = 3 SE +/- 4.77, N = 3 SE +/- 0.49, N = 3 SE +/- 0.42, N = 3 SE +/- 0.10, N = 3 SE +/- 1.28, N = 3 SE +/- 0.47, N = 3 SE +/- 0.14, N = 3 SE +/- 0.50, N = 3 SE +/- 1.01, N = 3 SE +/- 0.77, N = 3 SE +/- 3.36, N = 3 710.71 192.81 33.79 695.17 185.51 32.20 157.25 159.12 137.45 83.87 580.86 175.84 31.65 579.55 175.24 31.32 148.66 151.60 131.39 81.61
Apache Spark Comparison (Row Count: 10000000 - Partitions: 500) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Comparison (Row Count: 10000000 - Partitions: 500) Calculate Pi Benchmark Broadcast Inner Join Test Time Inner Join Test Time Repartition Test Time SHA-512 Benchmark Time Calculate Pi Benchmark Using Dataframe Group By Test Time 150 300 450 600 750 SE +/- 3.66, N = 3 SE +/- 0.24, N = 3 SE +/- 0.42, N = 3 SE +/- 0.58, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.42, N = 3 SE +/- 3.78, N = 3 SE +/- 0.24, N = 3 SE +/- 0.39, N = 3 SE +/- 0.26, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.51, N = 3 SE +/- 1.02, N = 3 SE +/- 0.42, N = 3 SE +/- 0.80, N = 3 SE +/- 1.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.11, N = 3 SE +/- 1.78, N = 3 SE +/- 0.62, N = 3 SE +/- 0.45, N = 3 SE +/- 0.32, N = 3 SE +/- 0.25, N = 3 SE +/- 0.20, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 692.06 42.68 44.68 40.16 52.62 33.89 23.28 684.23 40.95 42.54 38.21 50.73 32.17 22.37 579.55 39.16 42.43 38.92 47.87 31.79 23.82 581.78 38.35 40.24 36.44 48.84 31.81 22.38
Apache Spark Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time) 1000000 40000000 20000000 10000000 40 80 120 160 200 SE +/- 0.075456756, N = 3 SE +/- 0.260000987, N = 3 SE +/- 0.307771793, N = 3 SE +/- 0.109148903, N = 3 SE +/- 0.073904401, N = 3 SE +/- 0.553867494, N = 3 SE +/- 0.105154004, N = 3 SE +/- 0.088475323, N = 3 SE +/- 0.026873455, N = 3 SE +/- 0.477080995, N = 3 SE +/- 0.160687224, N = 3 SE +/- 0.112654588, N = 3 SE +/- 0.114204323, N = 3 SE +/- 1.561648800, N = 3 SE +/- 0.331996595, N = 3 SE +/- 0.195921788, N = 3 11.230000000 189.390000000 99.640000000 52.620000000 10.430000000 183.200000000 96.850000000 50.730000000 9.890000000 172.060000000 90.560000000 47.870000000 10.480000000 172.690048331 91.240000000 48.840000000
Apache Spark Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time) 500 100 1000 2000 3 6 9 12 15 SE +/- 0.08, N = 3 SE +/- 0.11, N = 4 SE +/- 0.14, N = 3 SE +/- 0.14, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 4 SE +/- 0.12, N = 9 SE +/- 0.11, N = 3 SE +/- 0.10, N = 5 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 11.23 10.01 11.38 12.96 10.43 9.50 11.18 12.55 9.89 9.34 10.78 12.63 10.48 9.56 11.14 12.88
Apache Spark Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time) 20000000 10000000 40000000 1000000 40 80 120 160 200 SE +/- 0.19, N = 3 SE +/- 0.25, N = 3 SE +/- 0.09, N = 4 SE +/- 0.43, N = 3 SE +/- 0.71, N = 3 SE +/- 2.32, N = 3 SE +/- 0.10, N = 3 SE +/- 0.59, N = 3 SE +/- 0.62, N = 3 SE +/- 0.08, N = 3 SE +/- 0.55, N = 3 SE +/- 0.21, N = 3 SE +/- 0.60, N = 3 SE +/- 0.07, N = 5 82.03 47.10 5.72 79.21 44.26 159.01 5.69 73.60 43.19 5.50 74.60 42.85 150.05 5.45
Apache Spark Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time) 100 500 1000 2000 20 40 60 80 100 SE +/- 0.19, N = 3 SE +/- 0.30, N = 3 SE +/- 0.51, N = 3 SE +/- 0.57, N = 3 SE +/- 0.43, N = 3 SE +/- 0.49, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.59, N = 3 SE +/- 0.04, N = 3 SE +/- 0.83, N = 3 SE +/- 0.55, N = 3 SE +/- 0.73, N = 3 SE +/- 0.20, N = 3 SE +/- 0.89, N = 3 82.03 83.53 84.01 83.94 79.21 80.77 80.64 81.25 73.60 75.23 75.96 74.60 76.27 76.66 77.56
Apache Spark Row Count Comparison (Partitions: 100 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Repartition Test Time) 10000000 20000000 1000000 40000000 30 60 90 120 150 SE +/- 0.56, N = 3 SE +/- 0.55, N = 3 SE +/- 0.03, N = 4 SE +/- 0.18, N = 3 SE +/- 0.33, N = 3 SE +/- 0.08, N = 3 SE +/- 1.31, N = 3 SE +/- 0.76, N = 3 SE +/- 2.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.43, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 5 SE +/- 0.42, N = 3 41.28 74.32 9.08 38.29 71.59 8.79 137.28 38.58 72.35 8.62 37.07 68.12 8.75 131.38
Apache Spark Partitions Comparison (Row Count: 10000000 - - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Repartition Test Time) 100 500 1000 2000 9 18 27 36 45 SE +/- 0.56, N = 3 SE +/- 0.58, N = 3 SE +/- 0.23, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.26, N = 3 SE +/- 0.22, N = 3 SE +/- 0.21, N = 3 SE +/- 0.76, N = 3 SE +/- 1.07, N = 3 SE +/- 0.54, N = 3 SE +/- 0.66, N = 3 SE +/- 0.43, N = 3 SE +/- 0.25, N = 3 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 41.28 40.16 39.96 40.50 38.29 38.21 38.61 39.22 38.58 38.92 39.31 39.33 37.07 36.44 36.72 37.94
Apache Spark Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time) 10000000 20000000 40000000 1000000 30 60 90 120 150 SE +/- 0.236866720, N = 3 SE +/- 0.300364443, N = 3 SE +/- 0.094366471, N = 3 SE +/- 0.236232308, N = 3 SE +/- 0.489603948, N = 3 SE +/- 0.852271154, N = 3 SE +/- 0.103211248, N = 3 SE +/- 0.416062930, N = 3 SE +/- 0.043071403, N = 3 SE +/- 0.063047733, N = 3 SE +/- 0.448087864, N = 3 SE +/- 0.730826056, N = 3 SE +/- 0.764058299, N = 3 SE +/- 0.486110869, N = 3 42.680000000 83.530000000 6.620000000 40.950000000 80.770000000 157.080000000 6.290000000 39.160000000 75.230000000 6.120000000 38.350000000 76.270000000 147.548531194 6.510000000
Apache Spark Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time) 500 1000 100 2000 11 22 33 44 55 SE +/- 0.24, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.27, N = 3 SE +/- 0.24, N = 3 SE +/- 0.16, N = 3 SE +/- 0.71, N = 3 SE +/- 0.28, N = 3 SE +/- 0.42, N = 3 SE +/- 1.25, N = 3 SE +/- 0.62, N = 3 SE +/- 0.24, N = 3 SE +/- 0.45, N = 3 SE +/- 0.36, N = 3 SE +/- 0.21, N = 3 SE +/- 0.13, N = 3 42.68 43.47 47.10 44.59 40.95 41.98 44.26 42.90 39.16 40.90 43.19 40.93 38.35 39.22 42.85 41.16
Apache Spark Row Count Comparison (Partitions: 500 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Inner Join Test Time) 10000000 20000000 40000000 1000000 30 60 90 120 150 SE +/- 0.422261678, N = 3 SE +/- 0.562607380, N = 3 SE +/- 0.056766652, N = 3 SE +/- 0.391685283, N = 3 SE +/- 0.747944666, N = 3 SE +/- 0.391834664, N = 3 SE +/- 0.103943425, N = 3 SE +/- 0.798930107, N = 3 SE +/- 0.488163973, N = 3 SE +/- 0.517942458, N = 3 SE +/- 0.324188438, N = 3 SE +/- 0.097366593, N = 3 SE +/- 1.021947894, N = 3 SE +/- 0.043852959, N = 3 44.680000000 83.840000000 7.260000000 42.540000000 80.990000000 158.110000000 7.010000000 42.430000000 78.030000000 7.530000000 40.240000000 77.630000000 152.207485397 7.030000000
Apache Spark Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time) 500 1000 2000 100 11 22 33 44 55 SE +/- 0.42, N = 3 SE +/- 0.40, N = 3 SE +/- 0.21, N = 3 SE +/- 0.26, N = 3 SE +/- 0.39, N = 3 SE +/- 0.14, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.80, N = 3 SE +/- 0.56, N = 3 SE +/- 1.45, N = 3 SE +/- 1.64, N = 3 SE +/- 0.32, N = 3 SE +/- 0.21, N = 3 SE +/- 0.15, N = 3 SE +/- 1.37, N = 3 44.68 45.60 47.67 47.52 42.54 44.00 45.74 43.58 42.43 43.30 47.61 43.88 40.24 41.49 44.23 43.71
Apache Spark Row Count Comparison (Partitions: 100 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Inner Join Test Time) 20000000 40000000 10000000 1000000 30 60 90 120 150 SE +/- 0.574015178, N = 3 SE +/- 0.257232291, N = 3 SE +/- 0.134671456, N = 4 SE +/- 0.323667212, N = 3 SE +/- 1.752337079, N = 3 SE +/- 0.120293064, N = 3 SE +/- 0.004165140, N = 3 SE +/- 1.129567495, N = 3 SE +/- 1.642152192, N = 3 SE +/- 0.294062371, N = 3 SE +/- 0.475686548, N = 3 SE +/- 1.445788055, N = 3 SE +/- 1.372283254, N = 3 SE +/- 0.044993077, N = 5 83.980000000 47.520000000 6.590000000 80.900000000 157.880000000 43.580000000 6.250000000 75.680000000 43.880000000 6.540000000 76.870000000 152.872557219 43.710000000 6.040000000
Apache Spark Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time) 100 1000 500 2000 20 40 60 80 100 SE +/- 0.57, N = 3 SE +/- 0.32, N = 3 SE +/- 0.56, N = 3 SE +/- 0.28, N = 3 SE +/- 0.32, N = 3 SE +/- 0.42, N = 3 SE +/- 0.75, N = 3 SE +/- 0.31, N = 3 SE +/- 1.13, N = 3 SE +/- 0.86, N = 3 SE +/- 0.49, N = 3 SE +/- 0.48, N = 3 SE +/- 0.52, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 83.98 85.12 83.84 86.43 80.90 81.35 80.99 83.64 75.68 78.42 78.03 76.87 79.29 77.63 80.41
Apache Spark Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time) 10000000 20000000 40000000 1000000 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.51, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.12, N = 3 SE +/- 1.25, N = 3 SE +/- 0.83, N = 3 SE +/- 0.06, N = 4 SE +/- 0.36, N = 3 SE +/- 0.20, N = 3 SE +/- 1.46, N = 3 SE +/- 0.06, N = 3 43.47 84.01 7.29 41.98 80.64 158.24 6.99 40.90 75.96 6.90 39.22 76.66 147.55 7.05
Apache Spark Row Count Comparison (Partitions: 1000 - Group By Test Time) rk1-mainline-nvme rk1-rok-nvme rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Group By Test Time) 40000000 10000000 1000000 20000000 20 40 60 80 100 SE +/- 2.33, N = 3 SE +/- 0.28, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.85, N = 3 SE +/- 0.20, N = 3 SE +/- 0.09, N = 3 SE +/- 0.44, N = 3 SE +/- 0.35, N = 3 SE +/- 0.03, N = 3 SE +/- 0.79, N = 3 SE +/- 0.36, N = 3 SE +/- 0.08, N = 4 SE +/- 2.03, N = 3 88.02 22.29 11.10 35.27 79.60 22.62 11.18 34.70 23.89 11.39 37.31 22.44 10.93 35.83
Apache Spark Partitions Comparison (Row Count: 40000000 - - Group By Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Group By Test Time) 1000 2000 500 100 20 40 60 80 100 SE +/- 2.33, N = 3 SE +/- 4.77, N = 3 SE +/- 4.05, N = 3 SE +/- 2.29, N = 3 SE +/- 0.85, N = 3 SE +/- 3.36, N = 3 SE +/- 1.17, N = 3 SE +/- 3.33, N = 3 88.02 83.87 89.23 87.32 79.60 81.61 82.35 88.01
Apache Spark Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time) 20000000 40000000 10000000 1000000 40 80 120 160 200 SE +/- 0.20, N = 3 SE +/- 0.54, N = 3 SE +/- 0.22, N = 3 SE +/- 0.14, N = 3 SE +/- 0.20, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.29, N = 3 SE +/- 0.77, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 4 SE +/- 0.10, N = 3 SE +/- 0.48, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 100.73 189.73 53.52 11.38 95.92 183.35 51.64 11.18 91.39 172.45 49.21 10.78 92.42 172.19 49.45 11.14
Apache Spark Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time) 1000 500 2000 100 20 40 60 80 100 SE +/- 0.20, N = 3 SE +/- 0.31, N = 3 SE +/- 0.14, N = 3 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.37, N = 3 SE +/- 0.34, N = 3 SE +/- 0.29, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.67, N = 3 100.73 99.64 101.15 96.68 95.92 96.85 97.65 93.79 91.39 90.56 91.96 88.81 92.42 91.24 92.19 89.48
Apache Spark Row Count Comparison (Partitions: 500 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Repartition Test Time) 10000000 20000000 1000000 40000000 30 60 90 120 150 SE +/- 0.579061882, N = 3 SE +/- 0.150029474, N = 3 SE +/- 0.037643391, N = 3 SE +/- 0.263873750, N = 3 SE +/- 0.119615928, N = 3 SE +/- 0.076523207, N = 3 SE +/- 0.575990239, N = 3 SE +/- 1.074726167, N = 3 SE +/- 0.840434214, N = 3 SE +/- 0.101989022, N = 3 SE +/- 0.254871419, N = 3 SE +/- 0.310887433, N = 3 SE +/- 0.069154351, N = 3 SE +/- 0.835252655, N = 3 40.160000000 73.220000000 9.460000000 38.210000000 71.300000000 9.100000000 138.040000000 38.920000000 70.900000000 9.000000000 36.440000000 67.860000000 9.210000000 131.531132677
Apache Spark Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time) 1000 500 2000 100 40 80 120 160 200 SE +/- 0.54, N = 3 SE +/- 0.26, N = 3 SE +/- 0.40, N = 3 SE +/- 0.34, N = 3 SE +/- 0.13, N = 3 SE +/- 0.55, N = 3 SE +/- 0.21, N = 3 SE +/- 0.84, N = 3 SE +/- 0.77, N = 3 SE +/- 0.48, N = 3 SE +/- 0.42, N = 3 SE +/- 0.58, N = 3 SE +/- 0.48, N = 3 SE +/- 1.56, N = 3 SE +/- 0.47, N = 3 SE +/- 0.82, N = 3 189.73 189.39 192.81 195.45 183.35 183.20 185.51 190.03 172.45 172.06 175.84 177.81 172.19 172.69 175.24 178.89
Apache Spark Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time) 40000000 20000000 10000000 1000000 40 80 120 160 200 SE +/- 0.40, N = 3 SE +/- 0.14, N = 3 SE +/- 0.39, N = 3 SE +/- 0.14, N = 3 SE +/- 0.21, N = 3 SE +/- 0.37, N = 3 SE +/- 0.34, N = 3 SE +/- 0.11, N = 3 SE +/- 0.42, N = 3 SE +/- 0.02, N = 3 SE +/- 0.36, N = 3 SE +/- 0.12, N = 9 SE +/- 0.47, N = 3 SE +/- 0.11, N = 3 SE +/- 0.24, N = 3 SE +/- 0.11, N = 3 192.81 101.15 55.17 12.96 185.51 97.65 53.04 12.55 175.84 91.96 50.80 12.63 175.24 92.19 51.09 12.88
Apache Spark Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time) 500 1000 2000 100 13 26 39 52 65 SE +/- 0.11, N = 3 SE +/- 0.22, N = 3 SE +/- 0.39, N = 3 SE +/- 0.32, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.34, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 3 SE +/- 0.36, N = 3 SE +/- 0.05, N = 3 SE +/- 0.20, N = 3 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.39, N = 3 52.62 53.52 55.17 57.05 50.73 51.64 53.04 55.28 47.87 49.21 50.80 52.69 48.84 49.45 51.09 52.88
Apache Spark Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time) 40000000 20000000 10000000 1000000 40 80 120 160 200 SE +/- 0.34, N = 3 SE +/- 0.22, N = 3 SE +/- 0.32, N = 3 SE +/- 0.11, N = 4 SE +/- 0.84, N = 3 SE +/- 0.34, N = 3 SE +/- 0.14, N = 3 SE +/- 0.04, N = 3 SE +/- 0.58, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.82, N = 3 SE +/- 0.67, N = 3 SE +/- 0.39, N = 3 SE +/- 0.10, N = 5 195.45 96.68 57.05 10.01 190.03 93.79 55.28 9.50 177.81 88.81 52.69 9.34 178.89 89.48 52.88 9.56
Apache Spark Row Count Comparison (Partitions: 1000 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Inner Join Test Time) 10000000 20000000 40000000 1000000 40 80 120 160 200 SE +/- 0.399790551, N = 3 SE +/- 0.315382741, N = 3 SE +/- 0.105150363, N = 3 SE +/- 0.136942862, N = 3 SE +/- 0.420756743, N = 3 SE +/- 1.923212084, N = 3 SE +/- 0.035374915, N = 3 SE +/- 0.557375853, N = 3 SE +/- 0.855084002, N = 3 SE +/- 0.633875719, N = 4 SE +/- 0.211182878, N = 3 SE +/- 0.524371080, N = 3 SE +/- 1.834767926, N = 3 SE +/- 0.108422107, N = 3 45.600000000 85.120000000 8.330000000 44.000000000 81.350000000 162.010000000 8.010000000 43.300000000 78.420000000 8.630000000 41.490000000 79.290000000 151.543861997 7.810000000
Apache Spark Row Count Comparison (Partitions: 1000 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Repartition Test Time) 20000000 10000000 40000000 1000000 30 60 90 120 150 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.23, N = 3 SE +/- 0.22, N = 3 SE +/- 0.83, N = 3 SE +/- 0.07, N = 3 SE +/- 1.03, N = 3 SE +/- 0.54, N = 3 SE +/- 0.07, N = 4 SE +/- 0.20, N = 3 SE +/- 0.31, N = 3 SE +/- 0.93, N = 3 SE +/- 0.18, N = 3 75.18 39.96 10.06 71.70 38.61 138.87 10.05 72.98 39.31 9.74 68.54 36.72 131.43 9.95
Apache Spark Partitions Comparison (Row Count: 20000000 - - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Repartition Test Time) 1000 2000 100 500 20 40 60 80 100 SE +/- 0.23, N = 3 SE +/- 0.46, N = 3 SE +/- 0.55, N = 3 SE +/- 0.15, N = 3 SE +/- 0.23, N = 3 SE +/- 0.20, N = 3 SE +/- 0.33, N = 3 SE +/- 0.12, N = 3 SE +/- 1.03, N = 3 SE +/- 2.01, N = 3 SE +/- 0.84, N = 3 SE +/- 0.20, N = 3 SE +/- 0.14, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 75.18 75.44 74.32 73.22 71.70 72.28 71.59 71.30 72.98 72.35 70.90 68.54 69.09 68.12 67.86
Apache Spark Row Count Comparison (Partitions: 2000 - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-nvme rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Repartition Test Time) 20000000 10000000 40000000 1000000 30 60 90 120 150 SE +/- 0.46, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.20, N = 3 SE +/- 0.21, N = 3 SE +/- 0.91, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.77, N = 3 SE +/- 0.16, N = 3 SE +/- 0.66, N = 3 SE +/- 0.04, N = 9 75.44 40.50 11.01 72.28 39.22 137.45 10.71 69.09 37.94 131.39 10.85 39.33 10.57
Apache Spark Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time) 10000000 20000000 1000000 40000000 30 60 90 120 150 SE +/- 0.27, N = 3 SE +/- 0.57, N = 3 SE +/- 0.18, N = 3 SE +/- 0.28, N = 3 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 SE +/- 1.89, N = 3 SE +/- 0.24, N = 3 SE +/- 0.13, N = 9 SE +/- 0.13, N = 3 SE +/- 0.89, N = 3 SE +/- 0.27, N = 3 SE +/- 0.50, N = 3 44.59 83.94 8.58 42.90 81.25 8.04 157.25 40.93 8.37 41.16 77.56 8.41 148.66
Apache Spark Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe) 10000000 20000000 40000000 1000000 8 16 24 32 40 SE +/- 0.18, N = 3 SE +/- 0.19, N = 3 SE +/- 0.22, N = 3 SE +/- 0.08, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 4 SE +/- 0.26, N = 3 SE +/- 0.32, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 34.00 33.81 33.51 33.39 32.24 32.05 32.40 32.36 31.66 31.75 31.54 31.88 31.36 31.22 31.61 31.54
Apache Spark Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe) 1000 100 2000 500 8 16 24 32 40 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.32, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.29, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.26, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 34.00 34.02 33.96 33.89 32.24 32.35 31.92 32.17 31.66 31.49 31.66 31.79 31.36 31.97 31.58 31.81
Apache Spark Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe) 1000 2000 100 500 8 16 24 32 40 SE +/- 0.19, N = 3 SE +/- 0.11, N = 3 SE +/- 0.32, N = 3 SE +/- 0.25, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.22, N = 3 SE +/- 0.14, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 33.81 33.91 33.73 33.72 32.05 32.21 32.24 31.84 31.75 31.61 31.81 31.76 31.22 31.66 31.62 31.74
Apache Spark Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe) 10000000 1000000 20000000 40000000 8 16 24 32 40 SE +/- 0.10, N = 3 SE +/- 0.12, N = 4 SE +/- 0.32, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.26, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.29, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 5 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 34.02 33.76 33.73 33.63 32.35 32.14 32.24 32.08 31.49 31.84 31.81 31.57 31.97 31.63 31.62 31.79
Apache Spark Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe) 40000000 10000000 20000000 1000000 8 16 24 32 40 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 SE +/- 0.31, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 9 SE +/- 0.14, N = 3 SE +/- 0.04, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 33.79 33.96 33.91 33.79 32.20 31.92 32.21 32.03 31.65 31.66 31.61 31.56 31.32 31.58 31.66 31.68
Apache Spark Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe) 2000 500 100 1000 8 16 24 32 40 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.31, N = 3 SE +/- 0.36, N = 3 SE +/- 0.23, N = 3 SE +/- 0.16, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.38, N = 3 SE +/- 0.16, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 33.79 33.77 33.63 33.51 32.20 31.96 32.08 32.40 31.65 31.51 31.57 31.54 31.32 31.71 31.79 31.61
Apache Spark Row Count Comparison (Partitions: 100 - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 100 - Group By Test Time) 20000000 1000000 40000000 10000000 20 40 60 80 100 SE +/- 0.45, N = 3 SE +/- 0.02, N = 4 SE +/- 0.30, N = 3 SE +/- 0.32, N = 3 SE +/- 0.13, N = 3 SE +/- 2.29, N = 3 SE +/- 0.25, N = 3 SE +/- 0.73, N = 3 SE +/- 0.13, N = 3 SE +/- 3.06, N = 3 SE +/- 0.47, N = 3 SE +/- 0.08, N = 5 SE +/- 3.33, N = 3 SE +/- 0.24, N = 3 37.11 9.07 25.05 35.51 8.81 87.32 23.50 34.66 8.75 26.62 34.41 9.09 88.01 23.90
Apache Spark Partitions Comparison (Row Count: 20000000 - - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 20000000 - - Group By Test Time) 100 2000 1000 500 9 18 27 36 45 SE +/- 0.45, N = 3 SE +/- 0.10, N = 3 SE +/- 0.79, N = 3 SE +/- 0.10, N = 3 SE +/- 0.32, N = 3 SE +/- 0.46, N = 3 SE +/- 0.15, N = 3 SE +/- 0.72, N = 3 SE +/- 0.73, N = 3 SE +/- 2.03, N = 3 SE +/- 4.59, N = 3 SE +/- 0.47, N = 3 SE +/- 0.41, N = 3 SE +/- 0.44, N = 3 SE +/- 0.13, N = 3 37.11 37.35 37.31 37.00 35.51 36.72 35.27 36.37 34.66 35.83 39.26 34.41 37.16 34.70 35.99
Apache Spark Row Count Comparison (Partitions: 2000 - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Inner Join Test Time) 10000000 20000000 40000000 1000000 40 80 120 160 200 SE +/- 0.21, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.31, N = 3 SE +/- 1.46, N = 3 SE +/- 0.09, N = 3 SE +/- 1.45, N = 3 SE +/- 0.50, N = 9 SE +/- 0.15, N = 3 SE +/- 0.05, N = 3 SE +/- 1.01, N = 3 SE +/- 0.40, N = 3 47.67 86.43 10.69 45.74 83.64 159.12 10.68 47.61 11.06 44.23 80.41 151.60 10.89
Apache Spark Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time) 1000 500 100 2000 40 80 120 160 200 SE +/- 0.25, N = 3 SE +/- 0.85, N = 3 SE +/- 2.32, N = 3 SE +/- 1.89, N = 3 SE +/- 1.46, N = 3 SE +/- 0.76, N = 3 SE +/- 0.60, N = 3 SE +/- 0.50, N = 3 158.24 157.08 159.01 157.25 147.55 147.55 150.05 148.66
Apache Spark Partitions Comparison (Row Count: 10000000 - - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 10000000 - - Group By Test Time) 1000 2000 500 100 6 12 18 24 30 SE +/- 0.35, N = 3 SE +/- 0.28, N = 3 SE +/- 0.42, N = 3 SE +/- 0.30, N = 3 SE +/- 0.28, N = 3 SE +/- 0.13, N = 3 SE +/- 0.51, N = 3 SE +/- 0.25, N = 3 SE +/- 0.36, N = 3 SE +/- 0.22, N = 3 SE +/- 1.78, N = 3 SE +/- 3.06, N = 3 SE +/- 0.20, N = 3 SE +/- 0.39, N = 3 SE +/- 0.17, N = 3 SE +/- 0.24, N = 3 23.89 24.85 23.28 25.05 22.29 24.09 22.37 23.50 22.44 24.10 23.82 26.62 22.62 24.13 22.38 23.90
Apache Spark Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe) 40000000 10000000 1000000 20000000 8 16 24 32 40 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.16, N = 3 SE +/- 0.25, N = 3 SE +/- 0.36, N = 3 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.22, N = 3 SE +/- 0.11, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 33.77 33.89 33.76 33.72 31.96 32.17 32.27 31.84 31.51 31.79 31.79 31.76 31.71 31.81 31.72 31.74
Apache Spark Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe) 2000 100 500 1000 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.12, N = 4 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.23, N = 3 SE +/- 0.26, N = 3 SE +/- 0.16, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 9 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 4 SE +/- 0.12, N = 3 SE +/- 0.09, N = 5 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 33.79 33.76 33.76 33.39 32.03 32.14 32.27 32.36 31.56 31.84 31.79 31.88 31.68 31.63 31.72 31.54
Apache Spark Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time) 1000 2000 500 100 40 80 120 160 200 SE +/- 1.92, N = 3 SE +/- 1.46, N = 3 SE +/- 0.39, N = 3 SE +/- 1.75, N = 3 SE +/- 1.83, N = 3 SE +/- 1.01, N = 3 SE +/- 1.02, N = 3 SE +/- 1.45, N = 3 162.01 159.12 158.11 157.88 151.54 151.60 152.21 152.87
Apache Spark Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time) 2000 1000 100 500 2 4 6 8 10 SE +/- 0.18, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 4 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 9 SE +/- 0.06, N = 4 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.27, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 5 SE +/- 0.49, N = 3 8.58 7.29 5.72 6.62 8.04 6.99 5.69 6.29 8.37 6.90 5.50 6.12 8.41 7.05 5.45 6.51
Apache Spark Partitions Comparison (Row Count: 40000000 - - Repartition Test Time) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 40000000 - - Repartition Test Time) 1000 500 2000 100 30 60 90 120 150 SE +/- 0.83, N = 3 SE +/- 0.58, N = 3 SE +/- 0.91, N = 3 SE +/- 1.31, N = 3 SE +/- 0.93, N = 3 SE +/- 0.84, N = 3 SE +/- 0.77, N = 3 SE +/- 0.42, N = 3 138.87 138.04 137.45 137.28 131.43 131.53 131.39 131.38
Apache Spark Partitions Comparison (Row Count: 1000000 - - Repartition Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Repartition Test Time) 100 500 2000 1000 3 6 9 12 15 SE +/- 0.03, N = 4 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 9 SE +/- 0.07, N = 4 SE +/- 0.03, N = 5 SE +/- 0.07, N = 3 SE +/- 0.16, N = 3 SE +/- 0.18, N = 3 9.08 9.46 11.01 10.06 8.79 9.10 10.71 10.05 8.62 9.00 10.57 9.74 8.75 9.21 10.85 9.95
Apache Spark Partitions Comparison (Row Count: 1000000 - - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Group By Test Time) 1000 100 2000 500 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.02, N = 4 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.08, N = 4 SE +/- 0.13, N = 3 SE +/- 0.13, N = 9 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 5 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 11.39 9.07 13.02 10.13 11.10 8.81 12.86 9.95 10.93 8.75 12.83 9.84 11.18 9.09 13.31 10.03
Apache Spark Row Count Comparison (Partitions: 2000 - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 2000 - Group By Test Time) 1000000 10000000 20000000 40000000 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 SE +/- 0.46, N = 3 SE +/- 4.77, N = 3 SE +/- 0.13, N = 9 SE +/- 0.22, N = 3 SE +/- 0.23, N = 3 SE +/- 0.39, N = 3 SE +/- 0.41, N = 3 SE +/- 3.36, N = 3 13.02 24.85 37.35 12.86 24.09 36.72 83.87 12.83 24.10 13.31 24.13 37.16 81.61
Apache Spark Row Count Comparison (Partitions: 500 - Group By Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count Comparison (Partitions: 500 - Group By Test Time) 1000000 40000000 20000000 10000000 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.42, N = 3 SE +/- 0.19, N = 3 SE +/- 4.05, N = 3 SE +/- 0.72, N = 3 SE +/- 0.51, N = 3 SE +/- 0.15, N = 3 SE +/- 4.59, N = 3 SE +/- 1.78, N = 3 SE +/- 0.09, N = 3 SE +/- 1.17, N = 3 SE +/- 0.13, N = 3 SE +/- 0.17, N = 3 10.13 37.00 23.28 9.95 89.23 36.37 22.37 9.84 39.26 23.82 10.03 82.35 35.99 22.38
Apache Spark Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time) rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time) 2000 1000 500 100 3 6 9 12 15 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 4 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.50, N = 9 SE +/- 0.63, N = 4 SE +/- 0.52, N = 3 SE +/- 0.29, N = 3 SE +/- 0.40, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 5 10.69 8.33 7.26 6.59 10.68 8.01 7.01 6.25 11.06 8.63 7.53 6.54 10.89 7.81 7.03 6.04
Timed Eigen Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Eigen Compilation 3.3.9 Comparison Time To Compile 40 80 120 160 200 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 2.34, N = 3 SE +/- 1.77, N = 3 SE +/- 0.03, N = 3 173.21 166.90 192.10 202.51 166.00
SQLite Threads / Copies Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.30.1 Threads / Copies Comparison 1 8 16 24 32 40 SE +/- 0.28, N = 15 SE +/- 0.11, N = 3 SE +/- 0.35, N = 3 SE +/- 0.04, N = 3 36.07 31.28 36.30 33.27 1. (CC) gcc options: -O2 -lreadline -ltermcap -lz -lm
ClickHouse Comparison rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 Comparison 100M Rows Hits Dataset, First Run / Cold Cache 100M Rows Hits Dataset, Second Run 100M Rows Hits Dataset, Third Run 10 20 30 40 50 SE +/- 0.56, N = 3 SE +/- 0.67, N = 3 SE +/- 0.37, N = 3 SE +/- 0.29, N = 3 SE +/- 0.32, N = 3 SE +/- 0.71, N = 3 43.45 46.15 45.72 38.83 41.37 41.81
Apache Spark TPC-DS Scale Factor Comparison (Q96) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q96) 10 50 1 100 3 6 9 12 15 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.03, N = 4 SE +/- 0.19, N = 3 7.16 10.91 5.75 6.64 10.18 5.73 13.53 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 10) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 10) Q96 Q58 Q03 Q19 Q48 Q59 Q77 Q27 Q32 Q31 Q33 Q21 Q37 Q29 Q13 Q71 Q06 Q53 Q49 Q42 Q63 Q02 Q04 Q14 Q68 Q62 Q64 Q91 Q44 Q89 Q23 Q82 Q66 Q05 Q70 Q85 Q94 Q80 Q09 Q76 Q67 Q88 Q40 Q56 Q78 Q75 Q38 Q26 Q43 Q46 Q07 Q97 Q22 Q10 Q52 Q17 Q86 Q41 Q69 Q61 Q45 Q55 Q90 Q98 Q20 Q81 Q79 Q92 Q57 Q54 Q15 Q01 Q95 Q83 Q28 Q50 Q11 Q73 Q25 Q74 Q93 Q84 Q18 Q72 Q51 Q47 Q08 Q30 Q12 Q87 Q99 Q65 Q60 Q39 Q36 Q35 Q34 Q24 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 0.09, N = 4 SE +/- 0.03, N = 4 SE +/- 0.21, N = 4 SE +/- 0.10, N = 4 SE +/- 0.10, N = 4 SE +/- 0.24, N = 4 SE +/- 0.20, N = 4 SE +/- 0.25, N = 4 SE +/- 0.26, N = 3 SE +/- 0.16, N = 4 SE +/- 0.17, N = 4 SE +/- 0.27, N = 4 SE +/- 0.41, N = 4 SE +/- 0.16, N = 4 SE +/- 0.21, N = 4 SE +/- 0.14, N = 4 SE +/- 0.08, N = 4 SE +/- 0.11, N = 4 SE +/- 0.06, N = 4 SE +/- 0.13, N = 4 SE +/- 0.25, N = 4 SE +/- 0.36, N = 4 SE +/- 0.35, N = 4 SE +/- 0.14, N = 4 SE +/- 0.10, N = 4 SE +/- 0.32, N = 4 SE +/- 0.02, N = 3 SE +/- 0.04, N = 4 SE +/- 0.10, N = 4 SE +/- 0.43, N = 4 SE +/- 0.22, N = 4 SE +/- 0.18, N = 4 SE +/- 0.37, N = 4 SE +/- 0.14, N = 4 SE +/- 0.03, N = 4 SE +/- 0.08, N = 3 SE +/- 0.46, N = 4 SE +/- 0.10, N = 4 SE +/- 0.21, N = 3 SE +/- 0.13, N = 4 SE +/- 0.39, N = 4 SE +/- 0.11, N = 4 SE +/- 0.11, N = 4 SE +/- 0.31, N = 4 SE +/- 0.35, N = 4 SE +/- 0.28, N = 4 SE +/- 0.27, N = 4 SE +/- 0.09, N = 4 SE +/- 0.16, N = 4 SE +/- 0.32, N = 4 SE +/- 0.17, N = 4 SE +/- 0.40, N = 4 SE +/- 0.12, N = 4 SE +/- 0.10, N = 4 SE +/- 0.36, N = 4 SE +/- 0.04, N = 4 SE +/- 0.07, N = 4 SE +/- 0.17, N = 4 SE +/- 0.05, N = 4 SE +/- 0.13, N = 4 SE +/- 0.14, N = 4 SE +/- 0.03, N = 4 SE +/- 0.02, N = 4 SE +/- 0.03, N = 4 SE +/- 0.17, N = 3 SE +/- 0.14, N = 4 SE +/- 0.05, N = 4 SE +/- 0.07, N = 4 SE +/- 0.07, N = 4 SE +/- 0.21, N = 4 SE +/- 0.14, N = 4 SE +/- 0.09, N = 4 SE +/- 0.11, N = 4 SE +/- 0.21, N = 4 SE +/- 0.25, N = 4 SE +/- 0.27, N = 4 SE +/- 0.10, N = 4 SE +/- 0.27, N = 4 SE +/- 0.13, N = 4 SE +/- 0.26, N = 4 SE +/- 0.07, N = 4 SE +/- 0.12, N = 4 SE +/- 1.21, N = 4 SE +/- 0.18, N = 4 SE +/- 0.16, N = 4 SE +/- 0.13, N = 4 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 SE +/- 0.72, N = 3 SE +/- 0.36, N = 3 SE +/- 0.84, N = 4 SE +/- 0.34, N = 4 SE +/- 0.31, N = 4 SE +/- 0.13, N = 4 SE +/- 0.12, N = 4 SE +/- 0.22, N = 3 SE +/- 0.11, N = 4 SE +/- 0.06, N = 3 SE +/- 0.34, N = 3 SE +/- 0.17, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 2 SE +/- 0.15, N = 3 SE +/- 0.27, N = 2 SE +/- 0.14, N = 3 SE +/- 0.63, N = 3 SE +/- 0.26, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 SE +/- 0.40, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.30, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.24, N = 3 SE +/- 0.36, N = 3 SE +/- 0.31, N = 3 SE +/- 0.58, N = 3 SE +/- 0.27, N = 3 SE +/- 0.13, N = 3 SE +/- 0.51, N = 3 SE +/- 0.25, N = 2 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.46, N = 3 SE +/- 0.19, N = 3 SE +/- 0.16, N = 3 SE +/- 0.60, N = 3 SE +/- 0.32, N = 3 SE +/- 0.29, N = 3 SE +/- 0.09, N = 3 SE +/- 0.75, N = 3 SE +/- 0.28, N = 3 SE +/- 0.13, N = 2 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.26, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.38, N = 3 SE +/- 0.11, N = 3 SE +/- 0.29, N = 3 SE +/- 0.08, N = 3 SE +/- 0.34, N = 3 SE +/- 0.10, N = 3 SE +/- 0.33, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.19, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 2 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.16, N = 3 SE +/- 0.42, N = 3 SE +/- 0.19, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.23, N = 3 SE +/- 0.51, N = 3 SE +/- 0.22, N = 3 SE +/- 0.37, N = 3 SE +/- 0.06, N = 3 SE +/- 0.79, N = 3 SE +/- 0.09, N = 3 SE +/- 0.41, N = 3 SE +/- 0.14, N = 3 SE +/- 0.21, N = 3 SE +/- 0.40, N = 3 SE +/- 0.17, N = 2 SE +/- 0.08, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 0.51, N = 3 SE +/- 0.20, N = 3 SE +/- 0.63, N = 3 SE +/- 0.93, N = 3 SE +/- 0.46, N = 3 SE +/- 0.64, N = 3 7.16 13.84 8.48 11.81 10.49 13.10 15.25 12.92 9.74 18.64 14.10 12.54 13.82 35.87 11.80 13.12 18.81 9.75 18.93 8.69 9.55 11.32 50.14 22.76 12.51 9.19 51.48 9.78 6.54 11.01 33.00 16.99 14.03 23.85 13.44 14.85 9.93 48.08 12.05 12.52 33.19 17.18 17.68 13.02 44.14 27.49 17.69 10.32 8.55 12.66 12.58 16.99 26.57 14.14 8.76 35.11 9.17 7.17 13.82 7.10 9.76 8.63 7.46 5.00 5.09 11.54 11.91 9.07 16.48 16.97 10.39 11.29 10.21 10.74 17.46 22.00 35.77 11.19 35.36 19.80 27.15 9.13 13.78 118.28 26.32 19.10 11.83 11.91 5.14 17.66 10.23 18.64 14.21 10.42 11.92 15.91 11.91 17.46 6.64 14.74 9.02 11.15 10.00 12.51 14.57 13.43 9.38 19.33 13.60 12.10 13.36 34.69 11.43 12.71 19.40 9.46 19.51 8.44 9.83 11.63 48.88 22.19 12.81 8.98 50.33 10.00 6.40 10.78 33.70 16.64 13.75 23.38 13.71 14.56 10.12 47.18 11.83 12.30 32.61 17.48 17.38 12.80 43.40 27.04 17.41 10.48 8.42 12.47 12.76 17.23 26.94 14.33 8.65 34.68 9.28 7.09 13.97 7.03 9.84 8.70 7.52 5.04 5.05 11.46 11.99 9.01 16.38 17.07 10.33 11.23 10.16 10.79 17.54 21.90 35.90 11.15 35.47 19.74 27.07 9.15 13.81 118.08 26.28 19.08 11.84 11.90 5.14 18.04 10.20 18.12 14.32 10.75 12.48 16.57 12.04 16.79 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 50) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 50) Q96 Q27 Q31 Q92 Q32 Q72 Q82 Q59 Q60 Q68 Q71 Q07 Q70 Q40 Q85 Q06 Q64 Q43 Q23 Q25 Q01 Q62 Q97 Q53 Q52 Q83 Q28 Q66 Q18 Q55 Q49 Q45 Q42 Q73 Q54 Q74 Q35 Q56 Q14 Q98 Q46 Q63 Q19 Q87 Q48 Q91 Q77 Q13 Q81 Q22 Q50 Q51 Q11 Q33 Q57 Q09 Q05 Q26 Q34 Q44 Q41 Q47 Q20 Q12 Q36 Q15 Q79 Q29 Q93 Q58 Q95 Q99 Q38 Q61 Q24 Q65 Q86 Q69 Q88 Q76 Q03 Q94 Q08 Q10 Q75 Q30 Q04 Q67 Q89 Q21 Q84 Q02 Q80 Q37 Q78 Q17 Q39 Q90 100 200 300 400 500 SE +/- 0.08, N = 3 SE +/- 0.47, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 5.27, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 SE +/- 0.32, N = 3 SE +/- 0.18, N = 3 SE +/- 1.15, N = 2 SE +/- 0.48, N = 3 SE +/- 0.35, N = 3 SE +/- 0.58, N = 3 SE +/- 0.28, N = 3 SE +/- 0.91, N = 3 SE +/- 1.53, N = 3 SE +/- 0.34, N = 3 SE +/- 1.35, N = 3 SE +/- 1.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.27, N = 3 SE +/- 0.18, N = 3 SE +/- 0.36, N = 3 SE +/- 0.08, N = 3 SE +/- 0.48, N = 3 SE +/- 0.17, N = 2 SE +/- 0.20, N = 3 SE +/- 0.23, N = 3 SE +/- 0.37, N = 3 SE +/- 0.13, N = 3 SE +/- 0.30, N = 3 SE +/- 0.02, N = 2 SE +/- 0.16, N = 3 SE +/- 1.15, N = 3 SE +/- 0.27, N = 3 SE +/- 0.09, N = 3 SE +/- 0.35, N = 3 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.08, N = 3 SE +/- 0.18, N = 3 SE +/- 0.51, N = 3 SE +/- 0.24, N = 3 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.11, N = 3 SE +/- 0.42, N = 3 SE +/- 0.54, N = 3 SE +/- 0.37, N = 3 SE +/- 0.66, N = 3 SE +/- 0.28, N = 3 SE +/- 0.40, N = 3 SE +/- 0.60, N = 3 SE +/- 0.25, N = 3 SE +/- 0.56, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.22, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.71, N = 3 SE +/- 0.24, N = 3 SE +/- 0.10, N = 3 SE +/- 1.14, N = 3 SE +/- 0.71, N = 3 SE +/- 0.54, N = 3 SE +/- 0.36, N = 3 SE +/- 0.29, N = 3 SE +/- 0.66, N = 3 SE +/- 0.39, N = 2 SE +/- 0.49, N = 3 SE +/- 0.84, N = 3 SE +/- 0.31, N = 3 SE +/- 0.29, N = 3 SE +/- 0.85, N = 3 SE +/- 0.40, N = 3 SE +/- 0.08, N = 3 SE +/- 0.33, N = 3 SE +/- 0.44, N = 3 SE +/- 0.37, N = 3 SE +/- 0.38, N = 3 SE +/- 0.32, N = 3 SE +/- 0.56, N = 3 SE +/- 0.63, N = 3 SE +/- 0.22, N = 3 SE +/- 0.26, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 2.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.64, N = 3 SE +/- 1.40, N = 3 SE +/- 0.36, N = 3 SE +/- 0.37, N = 3 SE +/- 0.19, N = 3 SE +/- 0.39, N = 3 SE +/- 0.41, N = 3 SE +/- 0.43, N = 3 SE +/- 0.41, N = 3 SE +/- 11.04, N = 3 SE +/- 0.80, N = 3 SE +/- 0.53, N = 3 SE +/- 0.21, N = 3 SE +/- 0.47, N = 3 SE +/- 0.38, N = 3 SE +/- 0.21, N = 3 SE +/- 0.53, N = 3 SE +/- 0.37, N = 3 SE +/- 0.47, N = 2 SE +/- 0.46, N = 3 SE +/- 3.02, N = 3 SE +/- 0.30, N = 3 SE +/- 1.31, N = 3 SE +/- 0.72, N = 3 SE +/- 0.20, N = 3 SE +/- 0.27, N = 3 SE +/- 0.11, N = 3 SE +/- 0.25, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.66, N = 3 SE +/- 0.24, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.28, N = 3 SE +/- 0.34, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.64, N = 3 SE +/- 0.22, N = 3 SE +/- 0.24, N = 3 SE +/- 2.04, N = 3 SE +/- 0.14, N = 2 SE +/- 0.09, N = 3 SE +/- 0.06, N = 2 SE +/- 0.37, N = 3 SE +/- 0.36, N = 3 SE +/- 0.32, N = 3 SE +/- 0.27, N = 3 SE +/- 0.31, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 SE +/- 0.38, N = 3 SE +/- 0.11, N = 3 SE +/- 0.65, N = 3 SE +/- 0.53, N = 3 SE +/- 0.37, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 1.08, N = 3 SE +/- 0.30, N = 3 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.40, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.63, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.16, N = 3 SE +/- 2.38, N = 3 SE +/- 0.28, N = 3 SE +/- 0.17, N = 2 SE +/- 0.13, N = 3 SE +/- 0.89, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.48, N = 3 SE +/- 0.23, N = 3 SE +/- 0.21, N = 2 SE +/- 1.14, N = 3 SE +/- 0.40, N = 3 SE +/- 0.28, N = 3 SE +/- 0.44, N = 3 SE +/- 0.26, N = 3 SE +/- 0.15, N = 3 SE +/- 1.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.72, N = 3 SE +/- 0.51, N = 3 SE +/- 0.51, N = 3 SE +/- 0.34, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 1.43, N = 3 SE +/- 0.11, N = 3 SE +/- 2.63, N = 3 SE +/- 0.43, N = 3 SE +/- 0.36, N = 3 SE +/- 0.37, N = 3 10.91 22.10 35.80 12.35 14.40 445.11 40.31 24.11 23.59 21.68 22.27 21.52 23.76 42.82 19.59 49.09 170.85 14.17 178.13 112.65 15.85 12.97 48.41 15.36 13.59 13.63 42.77 20.07 20.87 13.93 40.27 13.15 13.56 16.29 37.77 97.52 25.60 20.67 75.66 5.16 22.29 15.01 18.23 44.42 16.97 10.92 24.66 19.78 15.86 36.12 50.08 59.46 103.28 22.31 24.44 24.13 43.17 16.02 17.68 7.74 7.37 33.34 5.21 5.27 22.14 17.77 21.24 118.41 85.82 24.38 18.23 16.26 43.19 7.70 57.15 42.42 12.23 20.28 36.30 20.50 14.18 19.04 17.20 20.16 59.60 15.98 154.31 106.61 17.65 15.80 11.68 17.55 154.53 22.76 145.29 119.35 15.19 9.97 10.18 20.69 33.52 13.18 15.29 419.79 38.46 25.24 22.57 22.60 23.19 20.72 22.95 41.43 20.22 47.67 165.96 13.77 173.15 109.51 15.41 12.61 47.08 14.94 13.22 13.26 41.62 20.62 21.41 13.60 39.34 13.46 13.25 16.65 36.96 95.45 25.07 21.10 77.16 5.26 21.87 14.73 17.89 43.60 16.67 10.73 24.24 19.45 15.60 36.66 49.36 58.63 101.84 22.00 24.78 24.46 43.74 16.23 17.91 7.84 7.28 33.73 5.27 5.21 22.39 17.59 21.04 117.34 85.15 24.20 18.10 16.37 43.48 7.65 56.78 42.69 12.30 20.17 36.14 20.59 14.12 18.96 17.27 20.24 59.37 16.04 153.78 106.30 17.70 15.83 11.70 17.58 154.37 22.74 145.20 119.31 15.19 9.82 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q27) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q27) 50 10 1 500 100 7 14 21 28 35 SE +/- 0.47, N = 3 SE +/- 0.20, N = 4 SE +/- 0.14, N = 3 SE +/- 0.39, N = 3 SE +/- 0.27, N = 2 SE +/- 0.05, N = 4 SE +/- 0.46, N = 3 SE +/- 0.26, N = 3 22.10 12.92 9.12 20.69 13.43 8.99 29.86 28.46 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q31) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q31) 50 10 1 500 100 12 24 36 48 60 SE +/- 0.17, N = 3 SE +/- 0.26, N = 3 SE +/- 0.05, N = 3 SE +/- 0.41, N = 3 SE +/- 0.63, N = 3 SE +/- 0.14, N = 4 SE +/- 0.67, N = 3 SE +/- 0.70, N = 3 35.80 18.64 12.08 33.52 19.33 12.29 49.00 51.49 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q92) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q92) 50 1 10 500 100 4 8 12 16 20 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 4 SE +/- 0.43, N = 3 SE +/- 0.08, N = 4 SE +/- 0.16, N = 3 SE +/- 0.44, N = 3 SE +/- 0.13, N = 3 12.35 7.58 9.07 13.18 7.79 9.01 16.04 16.24 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q58) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q58) 10 1 50 100 500 8 16 24 32 40 SE +/- 0.09, N = 4 SE +/- 0.04, N = 2 SE +/- 0.54, N = 3 SE +/- 0.34, N = 3 SE +/- 0.05, N = 2 SE +/- 0.28, N = 3 SE +/- 0.53, N = 3 SE +/- 1.31, N = 3 13.84 10.17 24.38 14.74 9.92 24.20 35.61 34.21 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q03) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q03) 10 1 50 500 100 5 10 15 20 25 SE +/- 0.03, N = 4 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 4 SE +/- 0.28, N = 3 SE +/- 0.21, N = 2 SE +/- 0.20, N = 3 8.48 6.75 14.18 9.02 6.79 14.12 19.48 19.51 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q32) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q32) 50 10 1 500 100 5 10 15 20 25 SE +/- 0.17, N = 3 SE +/- 0.25, N = 4 SE +/- 0.07, N = 3 SE +/- 0.41, N = 3 SE +/- 0.14, N = 3 SE +/- 0.04, N = 4 SE +/- 0.33, N = 3 SE +/- 0.17, N = 3 14.40 9.74 7.68 15.29 9.38 7.70 22.59 22.65 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q72) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q72) 50 1 10 100 100 200 300 400 500 SE +/- 5.27, N = 3 SE +/- 0.12, N = 3 SE +/- 1.21, N = 4 SE +/- 11.04, N = 3 SE +/- 0.25, N = 4 SE +/- 0.40, N = 3 SE +/- 1.63, N = 3 445.11 19.61 118.28 419.79 19.11 118.08 135.02 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q19) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q19) 10 50 1 500 100 6 12 18 24 30 SE +/- 0.21, N = 4 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 SE +/- 0.37, N = 3 SE +/- 0.05, N = 4 SE +/- 0.52, N = 3 SE +/- 0.67, N = 3 11.81 18.23 8.17 11.15 17.89 8.02 25.80 25.57 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q48) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q48) 10 1 50 500 100 6 12 18 24 30 SE +/- 0.10, N = 4 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 4 SE +/- 0.32, N = 3 SE +/- 0.27, N = 3 SE +/- 0.17, N = 3 10.49 7.89 16.97 10.00 7.65 16.67 23.13 23.00 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q82) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q82) 50 10 1 500 100 9 18 27 36 45 SE +/- 0.08, N = 3 SE +/- 0.22, N = 4 SE +/- 0.10, N = 2 SE +/- 0.80, N = 3 SE +/- 0.19, N = 3 SE +/- 0.07, N = 4 SE +/- 0.43, N = 3 SE +/- 0.16, N = 3 40.31 16.99 8.88 38.46 16.64 8.86 26.02 26.06 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q36) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q36) 1 50 500 100 10 7 14 21 28 35 SE +/- 0.06, N = 2 SE +/- 0.71, N = 3 SE +/- 0.13, N = 4 SE +/- 0.12, N = 3 SE +/- 0.63, N = 3 SE +/- 0.57, N = 3 SE +/- 0.49, N = 3 SE +/- 0.63, N = 3 9.25 22.14 11.92 8.83 22.39 30.73 31.04 12.48 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 1) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 1) Q36 Q29 Q88 Q09 Q55 Q49 Q22 Q48 Q30 Q92 Q99 Q95 Q05 Q62 Q72 Q37 Q58 Q54 Q06 Q84 Q34 Q35 Q17 Q50 Q78 Q74 Q90 Q67 Q19 Q31 Q13 Q65 Q33 Q91 Q24 Q27 Q77 Q47 Q89 Q43 Q81 Q97 Q75 Q85 Q63 Q57 Q86 Q69 Q28 Q15 Q12 Q21 Q38 Q45 Q40 Q79 Q68 Q02 Q04 Q61 Q52 Q10 Q20 Q51 Q03 Q60 Q70 Q08 Q01 Q71 Q25 Q80 Q93 Q76 Q98 Q11 Q96 Q44 Q94 Q83 Q16 Q42 Q32 Q53 Q07 Q64 Q46 Q82 Q59 Q87 Q41 Q26 Q23 Q73 Q56 Q18 Q66 Q39 Q14 5 10 15 20 25 SE +/- 0.06, N = 2 SE +/- 0.09, N = 3 SE +/- 0.14, N = 2 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 2 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.22, N = 2 SE +/- 0.08, N = 3 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 2 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 2 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 2 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.28, N = 3 SE +/- 0.21, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 3 SE +/- 0.19, N = 3 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.22, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 2 SE +/- 0.03, N = 2 SE +/- 0.02, N = 2 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 2 SE +/- 0.15, N = 2 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.19, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.33, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 4 SE +/- 0.12, N = 3 SE +/- 0.05, N = 4 SE +/- 0.06, N = 4 SE +/- 0.08, N = 4 SE +/- 0.18, N = 4 SE +/- 0.07, N = 4 SE +/- 0.07, N = 3 SE +/- 0.08, N = 4 SE +/- 0.02, N = 2 SE +/- 0.04, N = 3 SE +/- 0.11, N = 4 SE +/- 0.06, N = 3 SE +/- 0.25, N = 4 SE +/- 0.09, N = 3 SE +/- 0.05, N = 2 SE +/- 0.10, N = 4 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.13, N = 2 SE +/- 0.08, N = 4 SE +/- 0.12, N = 4 SE +/- 0.14, N = 4 SE +/- 0.07, N = 4 SE +/- 0.05, N = 4 SE +/- 0.06, N = 4 SE +/- 0.13, N = 4 SE +/- 0.05, N = 4 SE +/- 0.14, N = 4 SE +/- 0.11, N = 4 SE +/- 0.06, N = 4 SE +/- 0.09, N = 4 SE +/- 0.06, N = 4 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.16, N = 4 SE +/- 0.10, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 3 SE +/- 0.06, N = 4 SE +/- 0.13, N = 4 SE +/- 0.19, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 4 SE +/- 0.11, N = 4 SE +/- 0.18, N = 4 SE +/- 0.12, N = 3 SE +/- 0.02, N = 4 SE +/- 0.02, N = 4 SE +/- 0.08, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 4 SE +/- 0.04, N = 3 SE +/- 0.06, N = 4 SE +/- 0.07, N = 4 SE +/- 0.06, N = 4 SE +/- 0.10, N = 4 SE +/- 0.01, N = 3 SE +/- 0.02, N = 4 SE +/- 0.16, N = 4 SE +/- 0.02, N = 4 SE +/- 0.19, N = 4 SE +/- 0.07, N = 4 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.01, N = 4 SE +/- 0.10, N = 4 SE +/- 0.10, N = 4 SE +/- 0.11, N = 4 SE +/- 0.10, N = 4 SE +/- 0.04, N = 3 SE +/- 0.10, N = 4 SE +/- 0.02, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 4 SE +/- 0.03, N = 4 SE +/- 0.03, N = 4 SE +/- 0.02, N = 3 SE +/- 0.10, N = 4 SE +/- 0.03, N = 4 SE +/- 0.04, N = 4 SE +/- 0.07, N = 4 SE +/- 0.04, N = 4 SE +/- 0.19, N = 4 SE +/- 0.06, N = 3 SE +/- 0.07, N = 4 SE +/- 0.04, N = 4 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.14, N = 4 SE +/- 0.23, N = 4 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.08, N = 4 SE +/- 0.13, N = 3 SE +/- 0.12, N = 4 SE +/- 0.11, N = 4 9.25 11.63 11.83 8.19 6.80 11.14 10.75 7.89 9.00 7.58 7.83 7.46 12.11 7.63 19.61 5.22 10.17 11.16 9.11 7.13 8.41 11.22 11.72 8.56 14.03 11.72 6.76 12.31 8.17 12.08 8.26 10.10 10.20 8.32 2.72 9.12 11.24 12.59 8.70 7.24 8.76 9.71 14.43 12.00 7.79 10.64 8.13 11.07 11.14 7.57 4.95 7.99 10.18 7.53 8.07 8.51 8.46 9.77 15.16 6.54 6.78 11.45 4.97 13.30 6.75 10.25 10.29 8.75 8.93 8.99 11.21 13.45 7.71 8.82 4.87 12.75 5.75 8.64 6.11 9.21 6.31 6.70 7.68 7.88 8.48 17.15 8.67 8.88 9.09 10.09 6.23 7.89 8.08 8.30 9.88 10.59 11.27 3.76 9.01 8.83 11.19 11.39 7.90 6.57 10.77 10.42 7.65 9.26 7.79 7.62 7.26 11.79 7.83 19.11 5.09 9.92 10.89 9.33 7.30 8.61 11.48 11.99 8.75 14.33 11.95 6.63 12.08 8.02 12.29 8.40 10.27 10.04 8.19 2.68 8.99 11.39 12.43 8.81 7.15 8.87 9.83 14.26 11.86 7.88 10.76 8.04 10.95 11.02 7.49 4.90 7.91 10.08 7.60 8.00 8.44 8.53 9.69 15.04 6.49 6.73 11.53 4.94 13.22 6.79 10.19 10.35 8.80 8.98 9.04 11.27 13.52 7.75 8.78 4.85 12.70 5.73 8.61 6.09 9.24 6.29 6.72 7.70 7.90 8.46 17.19 8.69 8.86 9.11 10.07 6.22 7.88 8.07 8.31 9.87 10.58 11.27 3.72 9.03 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q59) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q59) 10 50 1 500 100 8 16 24 32 40 SE +/- 0.10, N = 4 SE +/- 0.13, N = 3 SE +/- 0.15, N = 2 SE +/- 0.23, N = 2 SE +/- 0.53, N = 3 SE +/- 0.04, N = 4 SE +/- 1.04, N = 3 SE +/- 0.85, N = 3 13.10 24.11 9.09 12.51 25.24 9.11 36.06 36.21 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q77) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q77) 10 50 1 100 8 16 24 32 40 SE +/- 0.24, N = 4 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 SE +/- 0.05, N = 4 SE +/- 0.30, N = 3 15.25 24.66 11.24 14.57 24.24 11.39 33.67 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q60) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q60) 50 1 500 100 10 7 14 21 28 35 SE +/- 0.32, N = 3 SE +/- 0.04, N = 3 SE +/- 0.34, N = 4 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.70, N = 3 SE +/- 0.71, N = 3 SE +/- 0.51, N = 3 23.59 10.25 14.21 22.57 10.19 31.17 30.69 14.32 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q68) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q68) 50 10 1 500 100 7 14 21 28 35 SE +/- 0.18, N = 3 SE +/- 0.14, N = 4 SE +/- 0.09, N = 3 SE +/- 0.47, N = 3 SE +/- 0.27, N = 3 SE +/- 0.07, N = 4 SE +/- 0.26, N = 3 SE +/- 0.84, N = 3 21.68 12.51 8.46 22.60 12.81 8.53 30.48 31.31 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q71) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q71) 50 10 1 500 100 7 14 21 28 35 SE +/- 1.15, N = 2 SE +/- 0.21, N = 4 SE +/- 0.08, N = 3 SE +/- 0.38, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 4 SE +/- 0.82, N = 3 SE +/- 0.15, N = 3 22.27 13.12 8.99 23.19 12.71 9.04 30.91 31.44 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q29) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q29) 1 10 50 100 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.41, N = 4 SE +/- 1.14, N = 3 SE +/- 0.04, N = 4 SE +/- 0.40, N = 3 SE +/- 0.16, N = 3 SE +/- 0.23, N = 3 11.63 35.87 118.41 11.19 34.69 117.34 47.47 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q88) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q88) 1 10 50 500 100 13 26 39 52 65 SE +/- 0.14, N = 2 SE +/- 0.39, N = 4 SE +/- 0.85, N = 3 SE +/- 0.12, N = 3 SE +/- 0.21, N = 3 SE +/- 1.14, N = 3 SE +/- 0.43, N = 3 SE +/- 1.29, N = 3 11.83 17.18 36.30 11.39 17.48 36.14 53.70 55.68 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q07) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q07) 50 10 1 500 100 7 14 21 28 35 SE +/- 0.48, N = 3 SE +/- 0.32, N = 4 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 4 SE +/- 1.17, N = 2 SE +/- 0.64, N = 3 21.52 12.58 8.48 20.72 12.76 8.46 27.83 29.32 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q33) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q33) 10 1 50 500 100 7 14 21 28 35 SE +/- 0.16, N = 4 SE +/- 0.09, N = 3 SE +/- 0.40, N = 3 SE +/- 0.26, N = 3 SE +/- 0.09, N = 4 SE +/- 0.37, N = 3 SE +/- 0.12, N = 3 SE +/- 0.45, N = 3 14.10 10.20 22.31 13.60 10.04 22.00 29.04 29.17 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q09) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q09) 1 10 50 500 100 9 18 27 36 45 SE +/- 0.11, N = 3 SE +/- 0.10, N = 4 SE +/- 0.25, N = 3 SE +/- 0.05, N = 4 SE +/- 0.28, N = 3 SE +/- 0.16, N = 3 SE +/- 0.61, N = 2 SE +/- 0.49, N = 3 8.19 12.05 24.13 7.90 11.83 24.46 39.80 41.19 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q21) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q21) 10 1 50 500 100 5 10 15 20 25 SE +/- 0.17, N = 4 SE +/- 0.03, N = 3 SE +/- 0.26, N = 3 SE +/- 0.17, N = 3 SE +/- 0.08, N = 4 SE +/- 0.34, N = 3 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 12.54 7.99 15.80 12.10 7.91 15.83 21.02 20.57 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q70) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q70) 50 10 1 100 500 8 16 24 32 40 SE +/- 0.35, N = 3 SE +/- 0.14, N = 4 SE +/- 0.01, N = 3 SE +/- 0.53, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 0.83, N = 3 SE +/- 1.37, N = 3 23.76 13.44 10.29 22.95 13.71 10.35 35.15 35.88 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q55) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q55) 1 50 10 500 100 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.14, N = 4 SE +/- 0.06, N = 4 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 SE +/- 0.34, N = 3 SE +/- 0.36, N = 3 6.80 13.93 8.63 6.57 13.60 8.70 17.95 18.22 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q37) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q37) 10 1 50 500 100 5 10 15 20 25 SE +/- 0.27, N = 4 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 SE +/- 0.24, N = 3 13.82 5.22 22.76 13.36 5.09 22.74 21.40 20.99 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q49) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q49) 1 10 50 100 10 20 30 40 50 SE +/- 0.08, N = 2 SE +/- 0.11, N = 4 SE +/- 0.37, N = 3 SE +/- 0.08, N = 4 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 11.14 18.93 40.27 10.77 19.51 39.34 44.00 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q40) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q40) 50 10 1 100 10 20 30 40 50 SE +/- 0.58, N = 3 SE +/- 0.11, N = 4 SE +/- 0.13, N = 3 SE +/- 0.37, N = 3 SE +/- 0.26, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 2 42.82 17.68 8.07 41.43 17.38 8.00 24.08 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q13) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q13) 10 50 1 500 100 7 14 21 28 35 SE +/- 0.16, N = 4 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 3 SE +/- 0.11, N = 4 SE +/- 0.38, N = 2 SE +/- 0.50, N = 3 11.80 19.78 8.26 11.43 19.45 8.40 28.72 28.19 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q85) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q85) 50 10 1 500 100 6 12 18 24 30 SE +/- 0.28, N = 3 SE +/- 0.03, N = 4 SE +/- 0.03, N = 3 SE +/- 0.47, N = 2 SE +/- 0.29, N = 3 SE +/- 0.19, N = 3 SE +/- 0.20, N = 3 SE +/- 0.30, N = 3 19.59 14.85 12.00 20.22 14.56 11.86 24.60 25.23 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q22) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q22) 1 50 10 500 100 14 28 42 56 70 SE +/- 0.05, N = 3 SE +/- 0.54, N = 3 SE +/- 0.40, N = 4 SE +/- 0.18, N = 4 SE +/- 0.38, N = 3 SE +/- 0.14, N = 3 SE +/- 0.40, N = 3 SE +/- 0.29, N = 3 10.75 36.12 26.57 10.42 36.66 26.94 61.50 60.75 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q06) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q06) 10 50 1 500 100 11 22 33 44 55 SE +/- 0.14, N = 4 SE +/- 0.91, N = 3 SE +/- 0.03, N = 3 SE +/- 0.30, N = 3 SE +/- 0.46, N = 3 SE +/- 0.05, N = 4 SE +/- 0.05, N = 2 SE +/- 0.17, N = 3 18.81 49.09 9.11 19.40 47.67 9.33 23.61 23.74 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q53) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q53) 10 50 1 500 100 5 10 15 20 25 SE +/- 0.08, N = 4 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.25, N = 3 SE +/- 0.07, N = 4 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 9.75 15.36 7.88 9.46 14.94 7.90 19.96 20.06 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q42) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q42) 10 50 1 500 100 4 8 12 16 20 SE +/- 0.06, N = 4 SE +/- 0.30, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.34, N = 3 SE +/- 0.03, N = 4 SE +/- 0.25, N = 3 SE +/- 0.15, N = 3 8.69 13.56 6.70 8.44 13.25 6.72 17.61 17.72 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q64) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q64) 50 10 1 100 40 80 120 160 200 SE +/- 1.53, N = 3 SE +/- 0.32, N = 4 SE +/- 0.18, N = 3 SE +/- 3.02, N = 3 SE +/- 0.51, N = 3 SE +/- 0.19, N = 4 SE +/- 2.48, N = 3 170.85 51.48 17.15 165.96 50.33 17.19 151.38 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q63) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q63) 10 50 1 500 100 5 10 15 20 25 SE +/- 0.13, N = 4 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.06, N = 2 SE +/- 0.05, N = 3 SE +/- 0.31, N = 3 SE +/- 0.33, N = 3 9.55 15.01 7.79 9.83 14.73 7.88 19.86 19.93 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q43) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q43) 50 10 1 500 100 5 10 15 20 25 SE +/- 0.34, N = 3 SE +/- 0.09, N = 4 SE +/- 0.06, N = 3 SE +/- 0.30, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 4 SE +/- 0.32, N = 3 SE +/- 0.17, N = 2 14.17 8.55 7.24 13.77 8.42 7.15 19.23 18.71 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q30) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q30) 1 50 10 500 100 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.32, N = 3 SE +/- 0.06, N = 4 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 SE +/- 0.28, N = 3 9.00 15.98 11.91 9.26 16.04 11.90 18.89 19.51 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q23) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q23) 50 10 1 100 50 100 150 200 250 SE +/- 1.35, N = 3 SE +/- 0.43, N = 4 SE +/- 0.02, N = 3 SE +/- 1.31, N = 3 SE +/- 0.46, N = 3 SE +/- 0.23, N = 4 SE +/- 0.08, N = 3 178.13 33.00 8.08 173.15 33.70 8.07 223.12 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q25) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q25) 50 1 10 500 100 30 60 90 120 150 SE +/- 1.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.27, N = 4 SE +/- 0.72, N = 3 SE +/- 0.11, N = 4 SE +/- 0.79, N = 3 SE +/- 0.28, N = 3 SE +/- 0.33, N = 3 112.65 11.21 35.36 109.51 11.27 35.47 41.30 41.97 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q01) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q01) 50 1 10 100 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 4 SE +/- 0.20, N = 3 SE +/- 0.10, N = 4 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 15.85 8.93 11.29 15.41 8.98 11.23 20.13 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q62) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q62) 50 1 10 500 100 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.10, N = 4 SE +/- 0.27, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.22, N = 3 12.97 7.63 9.19 12.61 7.83 8.98 15.61 15.66 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q97) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q97) 50 10 1 100 20 40 60 80 100 SE +/- 0.27, N = 3 SE +/- 0.17, N = 4 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 SE +/- 0.06, N = 4 SE +/- 0.24, N = 3 48.41 16.99 9.71 47.08 17.23 9.83 78.07 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q52) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q52) 50 10 1 500 100 5 10 15 20 25 SE +/- 0.36, N = 3 SE +/- 0.10, N = 4 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.02, N = 4 SE +/- 0.29, N = 3 SE +/- 0.18, N = 3 13.59 8.76 6.78 13.22 8.65 6.73 19.14 18.87 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q83) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q83) 50 10 1 100 4 8 12 16 20 SE +/- 0.08, N = 3 SE +/- 0.11, N = 4 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.25, N = 3 13.63 10.74 9.21 13.26 10.79 9.24 15.75 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q28) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q28) 50 1 10 500 100 15 30 45 60 75 SE +/- 0.48, N = 3 SE +/- 0.21, N = 3 SE +/- 0.21, N = 4 SE +/- 0.66, N = 3 SE +/- 0.12, N = 3 SE +/- 0.51, N = 3 SE +/- 0.64, N = 3 SE +/- 2.08, N = 3 42.77 11.14 17.46 41.62 11.02 17.54 67.04 68.17 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q99) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q99) 1 50 100 10 5 10 15 20 25 SE +/- 0.22, N = 2 SE +/- 0.29, N = 3 SE +/- 0.36, N = 3 SE +/- 0.02, N = 2 SE +/- 0.13, N = 3 SE +/- 0.64, N = 2 SE +/- 0.16, N = 3 7.83 16.26 10.23 7.62 16.37 22.45 10.20 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q95) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q95) 1 50 10 100 6 12 18 24 30 SE +/- 0.08, N = 3 SE +/- 0.36, N = 3 SE +/- 0.09, N = 4 SE +/- 0.04, N = 3 SE +/- 0.17, N = 2 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 7.46 18.23 10.21 7.26 18.10 10.16 26.65 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q66) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q66) 50 10 500 100 1 7 14 21 28 35 SE +/- 0.17, N = 2 SE +/- 0.18, N = 4 SE +/- 0.08, N = 3 SE +/- 0.24, N = 3 SE +/- 0.16, N = 3 SE +/- 0.43, N = 3 SE +/- 0.44, N = 3 SE +/- 0.13, N = 3 20.07 14.03 11.27 20.62 13.75 27.08 27.68 11.27 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q02) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q02) 10 1 50 500 100 7 14 21 28 35 SE +/- 0.25, N = 4 SE +/- 0.14, N = 3 SE +/- 0.12, N = 3 SE +/- 0.36, N = 3 SE +/- 0.06, N = 4 SE +/- 0.09, N = 3 SE +/- 0.07, N = 2 SE +/- 0.29, N = 3 11.32 9.77 17.55 11.63 9.69 17.58 27.90 27.55 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q05) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q05) 1 10 50 100 15 30 45 60 75 SE +/- 0.19, N = 3 SE +/- 0.37, N = 4 SE +/- 0.56, N = 3 SE +/- 0.11, N = 4 SE +/- 0.60, N = 3 SE +/- 1.08, N = 3 SE +/- 0.44, N = 3 12.11 23.85 43.17 11.79 23.38 43.74 66.74 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q18) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q18) 50 10 1 500 100 7 14 21 28 35 SE +/- 0.20, N = 3 SE +/- 0.12, N = 4 SE +/- 0.19, N = 3 SE +/- 0.21, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 4 SE +/- 0.23, N = 3 SE +/- 0.54, N = 3 20.87 13.78 10.59 21.41 13.81 10.58 27.73 27.88 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q04) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q04) 10 1 50 100 40 80 120 160 200 SE +/- 0.36, N = 4 SE +/- 0.22, N = 3 SE +/- 0.56, N = 3 SE +/- 0.31, N = 3 SE +/- 0.10, N = 4 SE +/- 0.72, N = 3 SE +/- 1.16, N = 3 50.14 15.16 154.31 48.88 15.04 153.78 192.45 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q14) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q14) 10 50 500 100 1 20 40 60 80 100 SE +/- 0.35, N = 4 SE +/- 0.35, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 2.04, N = 3 SE +/- 1.32, N = 3 SE +/- 2.66, N = 3 SE +/- 0.11, N = 4 22.76 75.66 9.01 22.19 77.16 100.36 101.62 9.03 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q54) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q54) 1 50 10 500 100 9 18 27 36 45 SE +/- 0.13, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 4 SE +/- 0.10, N = 4 SE +/- 0.12, N = 3 SE +/- 0.42, N = 3 SE +/- 0.13, N = 2 SE +/- 0.19, N = 3 11.16 37.77 16.97 10.89 36.96 17.07 33.99 33.83 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q84) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q84) 1 10 50 500 100 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.07, N = 4 SE +/- 0.21, N = 3 SE +/- 0.05, N = 4 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 7.13 9.13 11.68 7.30 9.15 11.70 13.55 13.57 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q34) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q34) 1 50 500 100 10 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 SE +/- 0.13, N = 2 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.46, N = 3 8.41 17.68 11.91 8.61 17.91 22.81 23.95 12.04 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q45) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q45) 50 1 10 500 100 4 8 12 16 20 SE +/- 0.13, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 4 SE +/- 0.28, N = 3 SE +/- 0.03, N = 4 SE +/- 0.05, N = 3 SE +/- 0.37, N = 3 SE +/- 0.16, N = 3 13.15 7.53 9.76 13.46 7.60 9.84 16.90 16.86 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q35) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q35) 1 50 500 100 10 8 16 24 32 40 SE +/- 0.17, N = 3 SE +/- 0.27, N = 3 SE +/- 0.12, N = 4 SE +/- 0.08, N = 4 SE +/- 0.22, N = 3 SE +/- 0.28, N = 3 SE +/- 0.17, N = 3 SE +/- 0.93, N = 3 11.22 25.60 15.91 11.48 25.07 36.50 36.60 16.57 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q17) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q17) 1 10 50 500 100 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.36, N = 4 SE +/- 1.40, N = 3 SE +/- 0.12, N = 4 SE +/- 0.15, N = 3 SE +/- 0.43, N = 3 SE +/- 0.71, N = 3 SE +/- 0.40, N = 3 11.72 35.11 119.35 11.99 34.68 119.31 43.55 42.92 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q91) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q91) 10 50 1 100 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.04, N = 2 SE +/- 0.25, N = 2 SE +/- 0.27, N = 3 SE +/- 0.06, N = 4 SE +/- 0.17, N = 3 9.78 10.92 8.32 10.00 10.73 8.19 12.21 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q50) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q50) 1 50 10 100 20 40 60 80 100 SE +/- 0.02, N = 3 SE +/- 0.37, N = 3 SE +/- 0.25, N = 4 SE +/- 0.14, N = 4 SE +/- 0.11, N = 3 SE +/- 0.22, N = 3 SE +/- 0.82, N = 3 8.56 50.08 22.00 8.75 49.36 21.90 81.06 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q73) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q73) 50 10 1 500 100 5 10 15 20 25 SE +/- 0.02, N = 2 SE +/- 0.10, N = 4 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 4 SE +/- 0.37, N = 3 SE +/- 0.46, N = 3 16.29 11.19 8.30 16.65 11.15 8.31 21.30 21.92 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q44) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q44) 10 50 1 500 100 6 12 18 24 30 SE +/- 0.04, N = 4 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 4 SE +/- 0.23, N = 3 SE +/- 0.66, N = 3 6.54 7.74 8.64 6.40 7.84 8.61 25.03 25.22 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q74) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q74) 50 1 10 100 30 60 90 120 150 SE +/- 1.15, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 4 SE +/- 0.64, N = 3 SE +/- 0.05, N = 4 SE +/- 0.09, N = 3 SE +/- 1.38, N = 3 97.52 11.72 19.80 95.45 11.95 19.74 112.49 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q78) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q78) 1 10 50 100 40 80 120 160 200 SE +/- 0.08, N = 3 SE +/- 0.31, N = 4 SE +/- 0.64, N = 3 SE +/- 0.07, N = 4 SE +/- 0.13, N = 3 SE +/- 2.63, N = 3 SE +/- 2.62, N = 3 14.03 44.14 145.29 14.33 43.40 145.20 186.01 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q89) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q89) 10 1 50 500 100 6 12 18 24 30 SE +/- 0.10, N = 4 SE +/- 0.01, N = 2 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 4 SE +/- 0.51, N = 3 SE +/- 0.42, N = 3 SE +/- 0.16, N = 3 11.01 8.70 17.65 10.78 8.81 17.70 23.46 23.22 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q56) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q56) 50 10 1 500 100 7 14 21 28 35 SE +/- 0.09, N = 3 SE +/- 0.11, N = 4 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 4 SE +/- 0.14, N = 3 SE +/- 0.32, N = 3 20.67 13.02 9.88 21.10 12.80 9.87 28.05 27.59 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q90) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q90) 1 10 500 100 50 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.03, N = 4 SE +/- 0.37, N = 3 SE +/- 0.06, N = 4 SE +/- 0.13, N = 3 SE +/- 0.31, N = 3 SE +/- 0.43, N = 3 SE +/- 0.37, N = 3 6.76 7.46 9.97 6.63 7.52 12.10 12.11 9.82 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q98) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q98) 50 10 1 100 1.2015 2.403 3.6045 4.806 6.0075 SE +/- 0.04, N = 3 SE +/- 0.02, N = 4 SE +/- 0.02, N = 2 SE +/- 0.14, N = 2 SE +/- 0.08, N = 2 SE +/- 0.02, N = 4 SE +/- 0.05, N = 3 5.16 5.00 4.87 5.26 5.04 4.85 5.34 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q46) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q46) 50 10 1 500 100 7 14 21 28 35 SE +/- 0.27, N = 3 SE +/- 0.16, N = 4 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.34, N = 3 SE +/- 0.06, N = 3 SE +/- 0.29, N = 3 SE +/- 0.26, N = 3 22.29 12.66 8.67 21.87 12.47 8.69 29.87 30.04 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q94) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q94) 10 50 1 100 7 14 21 28 35 SE +/- 0.08, N = 3 SE +/- 0.33, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.44, N = 3 SE +/- 0.03, N = 4 SE +/- 0.28, N = 3 9.93 19.04 6.11 10.12 18.96 6.09 27.97 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q80) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q80) 10 1 50 100 30 60 90 120 150 SE +/- 0.46, N = 4 SE +/- 0.04, N = 3 SE +/- 2.12, N = 3 SE +/- 0.75, N = 3 SE +/- 0.10, N = 4 SE +/- 1.43, N = 3 SE +/- 1.28, N = 3 48.08 13.45 154.53 47.18 13.52 154.37 100.24 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q67) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q67) 1 10 50 100 50 100 150 200 250 SE +/- 0.11, N = 3 SE +/- 0.13, N = 4 SE +/- 0.63, N = 3 SE +/- 0.13, N = 4 SE +/- 0.11, N = 3 SE +/- 0.51, N = 3 SE +/- 1.23, N = 3 12.31 33.19 106.61 12.08 32.61 106.30 205.56 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q87) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q87) 50 1 500 100 10 15 30 45 60 75 SE +/- 0.51, N = 3 SE +/- 0.01, N = 3 SE +/- 0.72, N = 3 SE +/- 0.36, N = 3 SE +/- 0.05, N = 4 SE +/- 0.70, N = 3 SE +/- 0.15, N = 3 SE +/- 0.23, N = 3 44.42 10.09 17.66 43.60 10.07 68.19 67.97 18.04 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q76) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q76) 10 1 50 500 100 7 14 21 28 35 SE +/- 0.21, N = 3 SE +/- 0.03, N = 2 SE +/- 0.40, N = 3 SE +/- 0.13, N = 2 SE +/- 0.10, N = 4 SE +/- 0.40, N = 3 SE +/- 0.72, N = 3 SE +/- 0.17, N = 3 12.52 8.82 20.50 12.30 8.78 20.59 28.59 29.14 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q65) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q65) 1 50 100 10 16 32 48 64 80 SE +/- 0.02, N = 3 SE +/- 0.84, N = 3 SE +/- 0.84, N = 4 SE +/- 0.06, N = 4 SE +/- 0.48, N = 3 SE +/- 1.31, N = 3 SE +/- 0.21, N = 3 10.10 42.42 18.64 10.27 42.69 73.38 18.12 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q81) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q81) 50 1 10 100 5 10 15 20 25 SE +/- 0.42, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.23, N = 3 15.86 8.76 11.54 15.60 8.87 11.46 18.70 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q75) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q75) 10 1 50 100 20 40 60 80 100 SE +/- 0.35, N = 4 SE +/- 0.15, N = 3 SE +/- 0.38, N = 3 SE +/- 0.38, N = 3 SE +/- 0.13, N = 4 SE +/- 1.20, N = 3 SE +/- 0.98, N = 3 27.49 14.43 59.60 27.04 14.26 59.37 96.42 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q38) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q38) 10 1 50 500 100 15 30 45 60 75 SE +/- 0.28, N = 4 SE +/- 0.07, N = 3 SE +/- 0.66, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 4 SE +/- 0.89, N = 3 SE +/- 0.18, N = 3 SE +/- 0.66, N = 3 17.69 10.18 43.19 17.41 10.08 43.48 68.08 67.38 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q26) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q26) 10 50 1 500 100 5 10 15 20 25 SE +/- 0.27, N = 4 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.29, N = 3 SE +/- 0.30, N = 3 SE +/- 0.14, N = 4 SE +/- 0.61, N = 3 SE +/- 0.57, N = 3 10.32 16.02 7.89 10.48 16.23 7.88 20.59 20.44 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q24) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q24) 1 50 100 10 13 26 39 52 65 SE +/- 0.02, N = 3 SE +/- 0.49, N = 3 SE +/- 0.11, N = 4 SE +/- 0.05, N = 4 SE +/- 0.08, N = 3 SE +/- 0.74, N = 3 SE +/- 0.64, N = 3 2.72 57.15 17.46 2.68 56.78 39.99 16.79 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q51) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q51) 50 1 10 100 20 40 60 80 100 SE +/- 0.66, N = 3 SE +/- 0.07, N = 3 SE +/- 0.18, N = 4 SE +/- 0.65, N = 3 SE +/- 0.19, N = 4 SE +/- 0.17, N = 2 SE +/- 1.20, N = 3 59.46 13.30 26.32 58.63 13.22 26.28 101.72 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q11) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q11) 50 1 10 100 30 60 90 120 150 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.27, N = 4 SE +/- 0.53, N = 3 SE +/- 0.05, N = 4 SE +/- 0.37, N = 3 SE +/- 0.56, N = 3 103.28 12.75 35.77 101.84 12.70 35.90 121.65 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q57) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q57) 50 1 10 500 100 7 14 21 28 35 SE +/- 0.60, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 4 SE +/- 0.03, N = 3 SE +/- 0.07, N = 4 SE +/- 0.16, N = 3 SE +/- 0.61, N = 3 SE +/- 0.74, N = 3 24.44 10.64 16.48 24.78 10.76 16.38 31.63 31.67 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q10) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q10) 10 1 50 500 100 7 14 21 28 35 SE +/- 0.12, N = 4 SE +/- 0.17, N = 3 SE +/- 0.37, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 4 SE +/- 0.15, N = 3 SE +/- 1.72, N = 2 SE +/- 0.08, N = 3 14.14 11.45 20.16 14.33 11.53 20.24 27.69 27.59 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q47) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q47) 1 50 10 500 100 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.16, N = 4 SE +/- 0.16, N = 4 SE +/- 0.40, N = 3 SE +/- 0.08, N = 3 SE +/- 0.43, N = 3 SE +/- 0.31, N = 3 12.59 33.34 19.10 12.43 33.73 19.08 49.44 50.05 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q41) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q41) 50 10 1 500 100 2 4 6 8 10 SE +/- 0.10, N = 3 SE +/- 0.07, N = 4 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 4 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 7.37 7.17 6.23 7.28 7.09 6.22 7.32 7.29 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q86) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q86) 10 1 50 500 100 4 8 12 16 20 SE +/- 0.04, N = 4 SE +/- 0.03, N = 3 SE +/- 0.31, N = 3 SE +/- 0.23, N = 3 SE +/- 0.11, N = 4 SE +/- 0.23, N = 3 SE +/- 0.13, N = 3 SE +/- 0.31, N = 3 9.17 8.13 12.23 9.28 8.04 12.30 15.40 15.57 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q20) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q20) 50 10 1 500 100 1.197 2.394 3.591 4.788 5.985 SE +/- 0.08, N = 3 SE +/- 0.03, N = 4 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 4 SE +/- 0.02, N = 2 SE +/- 0.07, N = 3 5.21 5.09 4.97 5.27 5.05 4.94 5.22 5.32 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q12) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q12) 50 1 500 100 10 1.1858 2.3716 3.5574 4.7432 5.929 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 4 SE +/- 0.13, N = 3 SE +/- 0.02, N = 4 SE +/- 0.09, N = 2 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 5.27 4.95 5.14 5.21 4.90 5.23 5.22 5.14 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q69) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q69) 1 10 50 500 100 6 12 18 24 30 SE +/- 0.28, N = 3 SE +/- 0.17, N = 4 SE +/- 0.29, N = 3 SE +/- 0.18, N = 4 SE +/- 0.02, N = 3 SE +/- 0.21, N = 2 SE +/- 0.42, N = 3 SE +/- 0.33, N = 3 11.07 13.82 20.28 10.95 13.97 20.17 26.08 26.76 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q15) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q15) 1 50 10 500 100 6 12 18 24 30 SE +/- 0.09, N = 3 SE +/- 0.24, N = 3 SE +/- 0.21, N = 4 SE +/- 0.02, N = 4 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.11, N = 3 SE +/- 0.30, N = 3 7.57 17.77 10.39 7.49 17.59 10.33 26.11 26.19 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q61) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q61) 10 1 50 500 100 2 4 6 8 10 SE +/- 0.05, N = 4 SE +/- 0.04, N = 3 SE +/- 0.39, N = 2 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 7.10 6.54 7.70 7.03 6.49 7.65 7.71 7.51 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q79) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q79) 50 1 10 500 100 7 14 21 28 35 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.14, N = 4 SE +/- 0.08, N = 3 SE +/- 0.06, N = 4 SE +/- 0.05, N = 3 SE +/- 0.49, N = 3 SE +/- 0.27, N = 3 21.24 8.51 11.91 21.04 8.44 11.99 30.27 30.33 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q93) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q93) 50 1 10 100 30 60 90 120 150 SE +/- 0.71, N = 3 SE +/- 0.02, N = 2 SE +/- 0.26, N = 4 SE +/- 2.38, N = 3 SE +/- 0.04, N = 3 SE +/- 0.41, N = 3 SE +/- 1.70, N = 3 85.82 7.71 27.15 85.15 7.75 27.07 140.11 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q08) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q08) 1 50 10 500 100 5 10 15 20 25 SE +/- 0.12, N = 3 SE +/- 0.44, N = 3 SE +/- 0.13, N = 4 SE +/- 0.01, N = 4 SE +/- 0.26, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 2 SE +/- 0.28, N = 3 8.75 17.20 11.83 8.80 17.27 11.84 22.66 22.24 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q16) rk1-mainline-nvme rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q16) 1 2 4 6 8 10 SE +/- 0.16, N = 3 SE +/- 0.10, N = 4 6.31 6.29 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 500) OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 500) Q92 Q90 Q89 Q88 Q87 Q86 Q85 Q84 Q82 Q79 Q76 Q73 Q71 Q69 Q68 Q66 Q63 Q62 Q61 Q60 Q59 Q57 Q56 Q55 Q54 Q53 Q52 Q48 Q47 Q46 Q45 Q44 Q43 Q42 Q41 Q39 Q38 Q37 Q36 Q35 Q34 Q33 Q32 Q31 Q30 Q28 Q27 Q26 Q25 Q22 Q21 Q20 Q19 Q18 Q17 Q15 Q14 Q13 Q12 Q10 Q09 Q08 Q07 Q06 Q03 Q02 Q70 Q58 20 40 60 80 100 SE +/- 0.44, N = 3 SE +/- 0.31, N = 3 SE +/- 0.42, N = 3 SE +/- 0.43, N = 3 SE +/- 0.70, N = 3 SE +/- 0.13, N = 3 SE +/- 0.20, N = 3 SE +/- 0.08, N = 3 SE +/- 0.43, N = 3 SE +/- 0.49, N = 3 SE +/- 0.72, N = 3 SE +/- 0.37, N = 3 SE +/- 0.82, N = 3 SE +/- 0.42, N = 3 SE +/- 0.26, N = 3 SE +/- 0.43, N = 3 SE +/- 0.31, N = 3 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.70, N = 3 SE +/- 1.04, N = 3 SE +/- 0.61, N = 3 SE +/- 0.14, N = 3 SE +/- 0.34, N = 3 SE +/- 0.13, N = 2 SE +/- 0.11, N = 3 SE +/- 0.29, N = 3 SE +/- 0.27, N = 3 SE +/- 0.43, N = 3 SE +/- 0.29, N = 3 SE +/- 0.37, N = 3 SE +/- 0.23, N = 3 SE +/- 0.32, N = 3 SE +/- 0.25, N = 3 SE +/- 0.09, N = 3 SE +/- 0.37, N = 3 SE +/- 0.18, N = 3 SE +/- 0.33, N = 3 SE +/- 0.57, N = 3 SE +/- 0.28, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.06, N = 3 SE +/- 0.64, N = 3 SE +/- 0.46, N = 3 SE +/- 0.61, N = 3 SE +/- 0.28, N = 3 SE +/- 0.40, N = 3 SE +/- 0.28, N = 3 SE +/- 0.02, N = 2 SE +/- 0.52, N = 3 SE +/- 0.23, N = 3 SE +/- 0.71, N = 3 SE +/- 0.11, N = 3 SE +/- 1.32, N = 3 SE +/- 0.38, N = 2 SE +/- 0.09, N = 2 SE +/- 1.72, N = 2 SE +/- 0.61, N = 2 SE +/- 0.13, N = 2 SE +/- 1.17, N = 2 SE +/- 0.05, N = 2 SE +/- 0.21, N = 2 SE +/- 0.07, N = 2 SE +/- 1.37, N = 3 SE +/- 1.31, N = 3 16.04 12.10 23.46 53.70 68.19 15.40 24.60 13.55 26.02 30.27 28.59 21.30 30.91 26.08 30.48 27.08 19.86 15.61 7.71 31.17 36.06 31.63 28.05 17.95 33.99 19.96 19.14 23.13 49.44 29.87 16.90 25.03 19.23 17.61 7.32 24.99 68.08 21.40 30.73 36.50 22.81 29.04 22.59 49.00 18.89 67.04 29.86 20.59 41.30 61.50 21.02 5.22 25.80 27.73 43.55 26.11 100.36 28.72 5.23 27.69 39.80 22.66 27.83 23.61 19.48 27.90 35.88 34.21 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Scale Factor Comparison (Q39) rk1-rok-nvme rk1-mainline-nvme OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Scale Factor Comparison (Q39) 500 50 100 10 1 6 12 18 24 30 SE +/- 0.37, N = 3 SE +/- 0.36, N = 3 SE +/- 1.30, N = 3 SE +/- 0.20, N = 3 SE +/- 0.12, N = 4 SE +/- 0.36, N = 3 SE +/- 0.31, N = 4 SE +/- 0.07, N = 3 24.99 15.19 22.77 10.75 3.72 15.19 10.42 3.76 1. (CC) gcc options: -O3 -fcommon -lm
Apache Spark TPC-DS Comparison (Scale Factor: 100) OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-DS 3.5 Comparison (Scale Factor: 100) Q99 Q98 Q97 Q96 Q95 Q94 Q93 Q92 Q91 Q89 Q88 Q87 Q86 Q85 Q84 Q83 Q82 Q81 Q80 Q79 Q78 Q77 Q76 Q75 Q74 Q73 Q72 Q71 Q70 Q69 Q68 Q67 Q66 Q65 Q64 Q63 Q62 Q61 Q60 Q59 Q58 Q57 Q56 Q55 Q54 Q53 Q52 Q51 Q50 Q49 Q48 Q47 Q46 Q45 Q44 Q43 Q42 Q41 Q40 Q38 Q37 Q36 Q35 Q34 Q33 Q32 Q31 Q30 Q29 Q28 Q27 Q26 Q25 Q24 Q23 Q22 Q21 Q20 Q19 Q18 Q17 Q15 Q14 Q13 Q12 Q11 Q10 Q09 Q08 Q07 Q06 Q05 Q04 Q03 Q02 Q01 Q90 Q39 50 100 150 200 250 SE +/- 0.64, N = 2 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.28, N = 3 SE +/- 1.70, N = 3 SE +/- 0.13, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 SE +/- 1.29, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 SE +/- 0.30, N = 3 SE +/- 0.03, N = 3 SE +/- 0.25, N = 3 SE +/- 0.16, N = 3 SE +/- 0.23, N = 3 SE +/- 1.28, N = 3 SE +/- 0.27, N = 3 SE +/- 2.62, N = 3 SE +/- 0.30, N = 3 SE +/- 0.17, N = 3 SE +/- 0.98, N = 3 SE +/- 1.38, N = 3 SE +/- 0.46, N = 3 SE +/- 1.63, N = 3 SE +/- 0.15, N = 3 SE +/- 0.83, N = 3 SE +/- 0.33, N = 3 SE +/- 0.84, N = 3 SE +/- 1.23, N = 3 SE +/- 0.44, N = 3 SE +/- 1.31, N = 3 SE +/- 2.48, N = 3 SE +/- 0.33, N = 3 SE +/- 0.22, N = 3 SE +/- 0.16, N = 3 SE +/- 0.71, N = 3 SE +/- 0.85, N = 3 SE +/- 0.53, N = 3 SE +/- 0.74, N = 3 SE +/- 0.32, N = 3 SE +/- 0.36, N = 3 SE +/- 0.19, N = 3 SE +/- 0.21, N = 3 SE +/- 0.18, N = 3 SE +/- 1.20, N = 3 SE +/- 0.82, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.31, N = 3 SE +/- 0.26, N = 3 SE +/- 0.16, N = 3 SE +/- 0.66, N = 3 SE +/- 0.17, N = 2 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 2 SE +/- 0.66, N = 3 SE +/- 0.24, N = 3 SE +/- 0.49, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.45, N = 3 SE +/- 0.17, N = 3 SE +/- 0.70, N = 3 SE +/- 0.28, N = 3 SE +/- 0.23, N = 3 SE +/- 2.08, N = 3 SE +/- 0.26, N = 3 SE +/- 0.57, N = 3 SE +/- 0.33, N = 3 SE +/- 0.74, N = 3 SE +/- 0.08, N = 3 SE +/- 0.29, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.67, N = 3 SE +/- 0.54, N = 3 SE +/- 0.40, N = 3 SE +/- 0.30, N = 3 SE +/- 2.66, N = 3 SE +/- 0.50, N = 3 SE +/- 0.08, N = 3 SE +/- 0.56, N = 3 SE +/- 0.08, N = 3 SE +/- 0.49, N = 3 SE +/- 0.28, N = 3 SE +/- 0.64, N = 3 SE +/- 0.17, N = 3 SE +/- 0.44, N = 3 SE +/- 1.16, N = 3 SE +/- 0.20, N = 3 SE +/- 0.29, N = 3 SE +/- 0.05, N = 3 SE +/- 0.43, N = 3 SE +/- 1.30, N = 3 22.45 5.34 78.07 13.53 26.65 27.97 140.11 16.24 12.21 23.22 55.68 67.97 15.57 25.23 13.57 15.75 26.06 18.70 100.24 30.33 186.01 33.67 29.14 96.42 112.49 21.92 135.02 31.44 35.15 26.76 31.31 205.56 27.68 73.38 151.38 19.93 15.66 7.51 30.69 36.21 35.61 31.67 27.59 18.22 33.83 20.06 18.87 101.72 81.06 44.00 23.00 50.05 30.04 16.86 25.22 18.71 17.72 7.29 24.08 67.38 20.99 31.04 36.60 23.95 29.17 22.65 51.49 19.51 47.47 68.17 28.46 20.44 41.97 39.99 223.12 60.75 20.57 5.32 25.57 27.88 42.92 26.19 101.62 28.19 5.22 121.65 27.59 41.19 22.24 29.32 23.74 66.74 192.45 19.51 27.55 20.13 12.11 22.77 1. (CC) gcc options: -O3 -fcommon -lm
Timed LLVM Compilation Build System Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System Comparison Unix Makefiles Ninja 800 1600 2400 3200 4000 SE +/- 5.63, N = 3 SE +/- 5.47, N = 3 SE +/- 3.39, N = 3 SE +/- 1.73, N = 3 SE +/- 6.63, N = 3 SE +/- 3.31, N = 3 SE +/- 2.47, N = 3 SE +/- 1.23, N = 3 3722.37 3662.54 3577.04 3524.42 3524.74 3480.73 3511.13 3468.30
Timed Gem5 Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 23.0.1 Comparison Time To Compile 500 1000 1500 2000 2500 SE +/- 3.08, N = 3 SE +/- 0.90, N = 3 SE +/- 2.55, N = 3 SE +/- 0.96, N = 3 2329.03 2257.24 2222.42 2220.18
Timed Node.js Compilation Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 19.8.1 Comparison Time To Compile 700 1400 2100 2800 3500 SE +/- 2.91, N = 3 SE +/- 1.20, N = 3 SE +/- 3.73, N = 3 SE +/- 0.29, N = 3 3378.82 3261.91 3289.07 3283.24
Apache Spark TPC-H Scale Factor Comparison (Geometric Mean Of All Queries) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Geometric Mean Of All Queries) 1 1.0584 2.1168 3.1752 4.2336 5.292 SE +/- 0.02205715, N = 3 SE +/- 0.03832583, N = 8 4.70394366 4.58796121
Apache Spark TPC-H Comparison (Scale Factor: 1) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Comparison (Scale Factor: 1) Geometric Mean Of All Queries Q22 Q21 Q20 Q19 Q18 Q17 Q16 Q15 Q14 Q13 Q12 Q11 Q10 Q09 Q08 Q07 Q06 Q05 Q04 Q03 Q02 Q01 4 8 12 16 20 SE +/- 0.02205715, N = 3 SE +/- 0.05419067, N = 3 SE +/- 0.45650715, N = 3 SE +/- 0.16740673, N = 3 SE +/- 0.08247514, N = 3 SE +/- 0.02944973, N = 3 SE +/- 0.11188602, N = 3 SE +/- 0.04807800, N = 3 SE +/- 0.01587727, N = 3 SE +/- 0.09844103, N = 3 SE +/- 0.05404231, N = 3 SE +/- 0.07812445, N = 3 SE +/- 0.00889576, N = 3 SE +/- 0.12475642, N = 3 SE +/- 0.03195754, N = 3 SE +/- 0.07990249, N = 3 SE +/- 0.01424190, N = 3 SE +/- 0.06400088, N = 3 SE +/- 0.08288138, N = 3 SE +/- 0.15831346, N = 3 SE +/- 0.17085945, N = 3 SE +/- 0.06585723, N = 3 SE +/- 0.17776740, N = 3 SE +/- 0.03832583, N = 8 SE +/- 0.40940044, N = 8 SE +/- 0.09251555, N = 8 SE +/- 0.02853109, N = 8 SE +/- 0.04107179, N = 8 SE +/- 0.15655408, N = 8 SE +/- 0.05677966, N = 8 SE +/- 0.04873253, N = 8 SE +/- 0.02096419, N = 8 SE +/- 0.08797017, N = 8 SE +/- 0.02994103, N = 8 SE +/- 0.07037349, N = 8 SE +/- 0.02504461, N = 8 SE +/- 0.08702141, N = 8 SE +/- 0.06360940, N = 8 SE +/- 0.01870892, N = 8 SE +/- 0.12029949, N = 8 SE +/- 0.02204410, N = 8 SE +/- 0.06264325, N = 8 SE +/- 0.15490647, N = 8 SE +/- 0.07160103, N = 8 SE +/- 0.10497115, N = 8 SE +/- 0.10385415, N = 8 4.70394366 2.63550258 18.00248718 4.95553335 3.45616110 8.85217094 7.48008188 2.36529143 3.73393631 3.48376338 3.30999152 4.41146898 2.22946509 5.48864635 8.09893131 5.12595320 5.67845901 3.14496096 6.45101420 6.35284599 6.21926069 5.12156471 8.99111398 4.58796121 3.25603971 16.83148050 4.59865994 3.26604420 8.63420987 7.14879584 2.37898293 3.52197197 3.41781682 3.00252223 4.26149431 2.23056737 5.45098496 7.73483688 5.01394421 5.71245319 2.87266311 6.25091559 5.94609463 6.01340967 5.17664826 8.89810467
Apache Spark TPC-H Scale Factor Comparison (Q22) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q22) 1 0.7326 1.4652 2.1978 2.9304 3.663 SE +/- 0.05419067, N = 3 SE +/- 0.40940044, N = 8 2.63550258 3.25603971
Apache Spark TPC-H Scale Factor Comparison (Q21) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q21) 1 4 8 12 16 20 SE +/- 0.46, N = 3 SE +/- 0.09, N = 8 18.00 16.83
Apache Spark TPC-H Scale Factor Comparison (Q20) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q20) 1 1.115 2.23 3.345 4.46 5.575 SE +/- 0.16740673, N = 3 SE +/- 0.02853109, N = 8 4.95553335 4.59865994
Apache Spark TPC-H Scale Factor Comparison (Q19) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q19) 1 0.7776 1.5552 2.3328 3.1104 3.888 SE +/- 0.08247514, N = 3 SE +/- 0.04107179, N = 8 3.45616110 3.26604420
Apache Spark TPC-H Scale Factor Comparison (Q18) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q18) 1 2 4 6 8 10 SE +/- 0.02944973, N = 3 SE +/- 0.15655408, N = 8 8.85217094 8.63420987
Apache Spark TPC-H Scale Factor Comparison (Q17) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q17) 1 2 4 6 8 10 SE +/- 0.11188602, N = 3 SE +/- 0.05677966, N = 8 7.48008188 7.14879584
Apache Spark TPC-H Scale Factor Comparison (Q16) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q16) 1 0.5353 1.0706 1.6059 2.1412 2.6765 SE +/- 0.04807800, N = 3 SE +/- 0.04873253, N = 8 2.36529143 2.37898293
Apache Spark TPC-H Scale Factor Comparison (Q15) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q15) 1 0.8401 1.6802 2.5203 3.3604 4.2005 SE +/- 0.01587727, N = 3 SE +/- 0.02096419, N = 8 3.73393631 3.52197197
Apache Spark TPC-H Scale Factor Comparison (Q14) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q14) 1 0.7838 1.5676 2.3514 3.1352 3.919 SE +/- 0.09844103, N = 3 SE +/- 0.08797017, N = 8 3.48376338 3.41781682
Apache Spark TPC-H Scale Factor Comparison (Q13) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q13) 1 0.7447 1.4894 2.2341 2.9788 3.7235 SE +/- 0.05404231, N = 3 SE +/- 0.02994103, N = 8 3.30999152 3.00252223
Apache Spark TPC-H Scale Factor Comparison (Q12) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q12) 1 0.9926 1.9852 2.9778 3.9704 4.963 SE +/- 0.07812445, N = 3 SE +/- 0.07037349, N = 8 4.41146898 4.26149431
Apache Spark TPC-H Scale Factor Comparison (Q11) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q11) 1 0.5019 1.0038 1.5057 2.0076 2.5095 SE +/- 0.00889576, N = 3 SE +/- 0.02504461, N = 8 2.22946509 2.23056737
Apache Spark TPC-H Scale Factor Comparison (Q10) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q10) 1 1.2349 2.4698 3.7047 4.9396 6.1745 SE +/- 0.12475642, N = 3 SE +/- 0.08702141, N = 8 5.48864635 5.45098496
Apache Spark TPC-H Scale Factor Comparison (Q09) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q09) 1 2 4 6 8 10 SE +/- 0.03195754, N = 3 SE +/- 0.06360940, N = 8 8.09893131 7.73483688
Apache Spark TPC-H Scale Factor Comparison (Q08) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q08) 1 1.1533 2.3066 3.4599 4.6132 5.7665 SE +/- 0.07990249, N = 3 SE +/- 0.01870892, N = 8 5.12595320 5.01394421
Apache Spark TPC-H Scale Factor Comparison (Q07) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q07) 1 1.2853 2.5706 3.8559 5.1412 6.4265 SE +/- 0.01424190, N = 3 SE +/- 0.12029949, N = 8 5.67845901 5.71245319
Apache Spark TPC-H Scale Factor Comparison (Q06) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q06) 1 0.7076 1.4152 2.1228 2.8304 3.538 SE +/- 0.06400088, N = 3 SE +/- 0.02204410, N = 8 3.14496096 2.87266311
Apache Spark TPC-H Scale Factor Comparison (Q05) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q05) 1 2 4 6 8 10 SE +/- 0.08288138, N = 3 SE +/- 0.06264325, N = 8 6.45101420 6.25091559
Apache Spark TPC-H Scale Factor Comparison (Q04) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q04) 1 2 4 6 8 10 SE +/- 0.15831346, N = 3 SE +/- 0.15490647, N = 8 6.35284599 5.94609463
Apache Spark TPC-H Scale Factor Comparison (Q03) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q03) 1 2 4 6 8 10 SE +/- 0.17085945, N = 3 SE +/- 0.07160103, N = 8 6.21926069 6.01340967
Apache Spark TPC-H Scale Factor Comparison (Q02) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q02) 1 1.1647 2.3294 3.4941 4.6588 5.8235 SE +/- 0.06585723, N = 3 SE +/- 0.10497115, N = 8 5.12156471 5.17664826
Apache Spark TPC-H Scale Factor Comparison (Q01) rk1-mainline-emmc rk1-rok-emmc OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark TPC-H 3.5 Scale Factor Comparison (Q01) 1 3 6 9 12 15 SE +/- 0.17776740, N = 3 SE +/- 0.10385415, N = 8 8.99111398 8.89810467
Timed GCC Compilation Comparison OpenBenchmarking.org Seconds, Fewer Is Better Timed GCC Compilation 13.2 Comparison Time To Compile 900 1800 2700 3600 4500 SE +/- 12.28, N = 3 4406.83
Monkey Audio Encoding Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi4-raspbian-sd OpenBenchmarking.org Seconds, Fewer Is Better Monkey Audio Encoding 3.99.6 Comparison WAV To APE 11 22 33 44 55 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.66, N = 25 20.28 19.48 18.57 18.67 46.56 1. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt
Stockfish Comparison rk1-mainline-emmc rk1-mainline-nvme rk1-rok-emmc rk1-rok-nvme pi5-raspbian-nvme pi4-raspbian-sd OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 15 Comparison Total Time 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 385132.57, N = 9 SE +/- 121318.23, N = 9 SE +/- 138882.38, N = 7 SE +/- 88074.41, N = 9 SE +/- 38968.66, N = 9 SE +/- 21647.79, N = 9 5271840 4873747 4863765 4326446 3116572 1136660 1. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver
Phoronix Test Suite v10.8.5