m4.4xlarge Amazon EC2 Cloud Benchmarks - December 2017 vs. February 2018 Testing for a future article. Using m4.4xlarge Amazon EC2 instance type in Ohio, comparing older December 2017 Linux results to February 2018 updated Linux distributions performance. Tests by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/1802104-FO-2018AMAZO63&sor .
Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System System Layer Vulkan Screen Resolution Dec 17 Feb 18 Amazon Linux 2 Clear Linux RHEL Server 7 SUSE SLES 12 SP3 Ubuntu 16.04 LTS Amazon Linux 2 Clear Linux RHEL Server 7 SUSE SLES 12 SP3 Ubuntu 16.04 LTS Intel Xeon E5-2686 v4 @ 2.30GHz (8 Cores / 16 Threads) Xen HVM domU Intel 440FX- 82441FX PMC 64512MB 8GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Amazon Linux 2.0 4.9.62-10.57.amzn2.x86_64 (x86_64) GCC 7.2.1 20170915 xfs Xen HVM domU 4.2.amazon 10GB Clear Linux OS 19700 4.13.12-56.aws (x86_64) 1.0.39 GCC 7.2.1 20170910 + Clang 5.0.0 + LLVM 5.0.0 ext4 cirrusdrmfb Red Hat Enterprise Linux Server 7.4 3.10.0-693.el7.x86_64 (x86_64) GCC 4.8.5 20150623 xfs 1024x768 Intel 440FX- 82441FX PMC Cirrus Logic GD 5446 Intel 82599 Virtual Function SUSE Linux Enterprise Server 12 SP3 12.3 4.4.92-6.30-default (x86_64) GCC 4.8.5 ext4 8GB Ubuntu 16.04 4.4.0-1041-aws (x86_64) Xen HVM domU (4.2.amazon BIOS) Amazon Linux 2 4.9.77-41.59.amzn2.x86_64 (x86_64) GCC 7.2.1 20170915 xfs 4 x 16384 MB RAM 30GB Clear Linux OS 20740 4.14.12-59.aws (x86_64) 1.0.39 GCC 7.3.0 + Clang 5.0.1 + LLVM 5.0.1 ext4 64512MB 10GB Intel 82599 Virtual Function Red Hat Enterprise Linux Server 7.4 3.10.0-693.17.1.el7.x86_64 (x86_64) GCC 4.8.5 20150623 xfs 1024x768 SUSE Linux Enterprise Server 12 SP3 12.3 4.4.114-94.11-default (x86_64) GCC 4.8.5 ext4 8GB Ubuntu 16.04 4.4.0-1050-aws (x86_64) GCC 5.4.0 20160609 OpenBenchmarking.org Compiler Details - Dec 17: Amazon Linux 2: --build=x86_64-redhat-linux --disable-libunwind-exceptions --disable-multilib --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libatomic --enable-libcilkrts --enable-libitm --enable-libmpx --enable-libquadmath --enable-libsanitizer --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic - Dec 17: Clear Linux: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - Dec 17: RHEL Server 7: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - Dec 17: SUSE SLES 12 SP3: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --disable-plugin --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --host=x86_64-suse-linux --mandir=/usr/share/man --with-arch-32=i586 --with-slibdir=/lib64 --with-tune=generic --without-system-libunwind - Dec 17: Ubuntu 16.04 LTS: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Feb 18: Amazon Linux 2: --build=x86_64-redhat-linux --disable-libunwind-exceptions --disable-multilib --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libatomic --enable-libcilkrts --enable-libitm --enable-libmpx --enable-libquadmath --enable-libsanitizer --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic - Feb 18: Clear Linux: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - Feb 18: RHEL Server 7: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - Feb 18: SUSE SLES 12 SP3: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --disable-plugin --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --host=x86_64-suse-linux --mandir=/usr/share/man --with-arch-32=i586 --with-slibdir=/lib64 --with-tune=generic --without-system-libunwind - Feb 18: Ubuntu 16.04 LTS: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v System Details - Dec 17: Amazon Linux 2: Python 2.7.5. - Dec 17: Clear Linux: Python 2.7.12. - Dec 17: RHEL Server 7: Python 2.7.5. SELinux: Enabled. - Dec 17: SUSE SLES 12 SP3: Python 2.7.13. - Dec 17: Ubuntu 16.04 LTS: Python 2.7.12. Environment Details - Dec 17: SUSE SLES 12 SP3: LIBGL_DEBUG=quiet - Feb 18: Clear Linux: CFFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl-sort-common CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-fvisibility-inlines-hidden FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize THEANO_FLAGS=floatX=float32 openmp=true gcc.cxxflags="-ftree-vectorize-mavx" - Feb 18: SUSE SLES 12 SP3: LIBGL_DEBUG=quiet Disk Details - Feb 18: Amazon Linux 2: NOOP / attr2,inode64,noatime,noquota,rw - Feb 18: RHEL Server 7: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel - Feb 18: Ubuntu 16.04 LTS: none / data=ordered,discard,relatime,rw Python Details - Feb 18: Amazon Linux 2: Python 2.7.5 - Feb 18: Clear Linux: Python 3.6.4 - Feb 18: RHEL Server 7: Python 2.7.5 - Feb 18: SUSE SLES 12 SP3: Python 2.7.13 - Feb 18: Ubuntu 16.04 LTS: Python 2.7.12 + Python 3.5.2 Security Details - Feb 18: Amazon Linux 2: KPTI + Full generic retpoline Protection - Feb 18: Clear Linux: KPTI Protection - Feb 18: RHEL Server 7: SELinux Protection - Feb 18: SUSE SLES 12 SP3: KPTI + Barriers + Full generic retpoline Protection - Feb 18: Ubuntu 16.04 LTS: KPTI Protection Disk Mount Options Details - Feb 18: Clear Linux: data=ordered,relatime,rw,stripe=256
rodinia: OpenMP LavaMD rodinia: OpenMP CFD Solver go-benchmark: http go-benchmark: json go-benchmark: build go-benchmark: garbage himeno: Poisson Pressure Solver build-linux-kernel: Time To Compile compress-gzip: 2GB File Compression encode-flac: WAV To FLAC encode-mp3: WAV To MP3 ffmpeg: H.264 HD To NTSC DV openssl: RSA 4096-bit Performance perl-benchmark: Pod2html perl-benchmark: Interpreter redis: GET redis: SET pybench: Total For Average Test Times phpbench: PHP Benchmark Suite dolfyn: Computational Fluid Dynamics graphics-magick: Sharpen graphics-magick: Resizing graphics-magick: HWB Color Space graphics-magick: Local Adaptive Thresholding c-ray: Total Time stockfish: Total Time rbenchmark: systemd-boot-total: Total systemd-boot-total: Userspace systemd-boot-total: Kernel sqlite: Default Test Directory stress-ng: Memory Copying stress-ng: Forking stress-ng: System V Message Passing stress-ng: Semaphores stress-ng: Socket Activity stress-ng: Context Switching hackbench: 16 - Process hackbench: 16 - Thread hackbench: 32 - Process schbench: 8 - 8 schbench: 8 - 16 schbench: 16 - 8 schbench: 16 - 16 schbench: 32 - 8 schbench: 32 - 16 crafty: Elapsed Time botan: AES-256 - Encrypt botan: Blowfish - Encrypt botan: CAST-256 - Encrypt botan: KASUMI - Encrypt botan: Twofish - Encrypt blake2: mafft: Multiple Sequence Alignment nginx: Static Web Page Serving povray: Trace Time openssl: RSA 4096-bit Performance Dec 17 Feb 18 Amazon Linux 2 Clear Linux RHEL Server 7 SUSE SLES 12 SP3 Ubuntu 16.04 LTS Amazon Linux 2 Clear Linux RHEL Server 7 SUSE SLES 12 SP3 Ubuntu 16.04 LTS 142.20 31.46 9029 11774995 18211772783 2458881 1634.03 107.48 14.41 8.77 13.86 913.67 0.19707410 0.00136237 1162050.17 898315.23 2393 146108 116 147 160 66 18.26 4601 9749 6936 1517 62.97 33.35 7895 10059809 18916363867 2248314 1588.99 92.39 5.50 8.41 13.48 8.91 981.97 0.19714943 0.00122207 1627781.67 1202463.25 1847 423815 117 147 160 69 14.69 4702 0.2580 612.30 326.10 286.10 89.49 15.53 10.08 17.08 974.63 0.20894897 0.00156785 1116937.08 860253.31 2439 140237 30.79 15.83 4478 37473 33785 2129 132.77 46.14 1519.19 84.82 12.36 10.03 17.14 9.10 987.93 0.19370366 0.00096575 1375590.25 1051987.37 2183 109406 30.50 102 152 167 69 15.61 4683 84221 56939 27281 128.28 42.24 6511 11934349 22662656196 2393988 1533.76 89.15 14.44 8.65 15.52 9.03 985.67 0.19713420 0.00095212 1274924.83 976316.06 2109 320707 30.25 119 153 164 69 15.57 4835 1.1358 11013 7279 3733 129.53 29.46 8944 10584904 18497453157 2254882 1671.16 98.47 14.49 8.79 13.86 983.67 0.19728241 0.00151685 720298.19 608436.77 2394 144601 118 147 161 66 16.94 4551 7799 5246 1752 20.66 6611.03 47472.94 7121513.63 2975130.21 9291.03 1157544.89 73.34 84.28 129.30 55936 117888 112427 179968 187989 294741 5397216 1251.49 163.83 85.91 58.02 212.55 5.37 4.76 23256.82 81.42 1020.80 62.81 31.31 9529 10033966 18477048057 2240359 1667.58 91.50 5.37 8.41 13.47 8.93 982.40 0.19162808 0.00123346 914670.88 780646.17 511571 122 155 170 69 14.68 4645 0.2547 596.60 346.60 250 22.81 6906.40 58016.31 7715221.96 2965228.33 7813.19 2058642.06 45.86 47.27 81.55 75853 183040 178773 383829 394069 753323 5399095 1387.93 166.22 86.53 58.72 219.25 5.37 4.62 1020.13 91.16 15.56 10.15 17.16 972.23 0.20912333 0.00184399 711523.71 616528.58 2442 139663 29.84 15.89 4478 33753 29797 2351 25.68 4922.41 48059.52 3771782.89 817497.33 9168.63 2126165.42 52.11 51.95 102.14 79147 168533 160000 326827 324864 675499 5315611 1260.87 176.47 82.56 53.26 202.27 4.85 88.16 1002.80 132.57 41.71 1615.19 85.44 12.39 17.93 8.86 0.19893783 0.00106251 772643.31 666078.60 2189 31.10 15.60 4428 41029 38040 2419 7541.81 46037.28 5634958.44 2833822.71 10077.29 2521014.69 47.52 49.26 94.10 83584 175019 169728 346624 348160 715093 5286783 4.85 4.32 1019.80 128.67 46.94 7005 11990813 22662883888 2431212 1509.12 92.09 14.47 8.68 15.74 9.08 985.03 0.19978381 0.00109300 765510.48 639295.35 2009 29.83 119 153 164 68 15.56 4718 7650 3884 3766 24.40 6633.35 42996.46 3664267.10 730364.50 9689.54 2050120.87 50.30 49.92 101.87 64256 121216 117717 195669 195499 333312 5268520 1314.41 168.75 83.12 57.98 209.51 4.84 4.86 26900.46 84.71 1019.57 OpenBenchmarking.org
Rodinia Test: OpenMP LavaMD Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 SUSE SLES 12 SP3 30 60 90 120 150 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.43, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.45, N = 3 62.81 128.67 129.53 132.57 62.97 128.28 132.77 142.20 1. (CXX) g++ options:
Rodinia Test: OpenMP CFD Solver Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP CFD Solver Amazon Linux 2 Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS 11 22 33 44 55 SE +/- 0.06, N = 3 SE +/- 0.52, N = 3 SE +/- 0.08, N = 3 SE +/- 0.20, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 29.46 31.31 41.71 46.94 31.46 33.35 42.24 46.14 1. (CXX) g++ options:
Go Benchmarks Test: http Dec 17 Feb 18 OpenBenchmarking.org Nanoseconds/Operation, Fewer Is Better Go Benchmarks Test: http Ubuntu 16.04 LTS Clear Linux Amazon Linux 2 2K 4K 6K 8K 10K SE +/- 17.10, N = 3 SE +/- 14.25, N = 3 SE +/- 11.59, N = 3 SE +/- 10.41, N = 3 SE +/- 70.76, N = 3 SE +/- 65.39, N = 3 6511 7895 9029 7005 8944 9529
Go Benchmarks Test: json Feb 18 Dec 17 OpenBenchmarking.org Nanoseconds/Operation, Fewer Is Better Go Benchmarks Test: json Clear Linux Amazon Linux 2 Ubuntu 16.04 LTS 3M 6M 9M 12M 15M SE +/- 5216.47, N = 3 SE +/- 10320.74, N = 3 SE +/- 124259.80, N = 3 SE +/- 11997.69, N = 3 SE +/- 5974.78, N = 3 SE +/- 37890.61, N = 3 10033966 10584904 11990813 10059809 11774995 11934349
Go Benchmarks Test: build Dec 17 Feb 18 OpenBenchmarking.org Nanoseconds/Operation, Fewer Is Better Go Benchmarks Test: build Amazon Linux 2 Clear Linux Ubuntu 16.04 LTS 5000M 10000M 15000M 20000M 25000M SE +/- 27621503.59, N = 3 SE +/- 75730836.70, N = 3 SE +/- 39963285.02, N = 3 SE +/- 27568866.45, N = 3 SE +/- 41837321.94, N = 3 SE +/- 160394872.41, N = 3 18211772783 18916363867 22662656196 18477048057 18497453157 22662883888
Go Benchmarks Test: garbage Feb 18 Dec 17 OpenBenchmarking.org Nanoseconds/Operation, Fewer Is Better Go Benchmarks Test: garbage Clear Linux Amazon Linux 2 Ubuntu 16.04 LTS 500K 1000K 1500K 2000K 2500K SE +/- 2672.64, N = 3 SE +/- 828.76, N = 3 SE +/- 1969.38, N = 3 SE +/- 1216.07, N = 3 SE +/- 3520.64, N = 3 SE +/- 4600.86, N = 3 2240359 2254882 2431212 2248314 2393988 2458881
Himeno Benchmark Poisson Pressure Solver Feb 18 Dec 17 OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Amazon Linux 2 Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS 400 800 1200 1600 2000 SE +/- 1.63, N = 3 SE +/- 3.03, N = 3 SE +/- 0.39, N = 3 SE +/- 0.63, N = 3 SE +/- 16.38, N = 3 SE +/- 0.63, N = 3 SE +/- 0.57, N = 3 SE +/- 0.98, N = 3 1671.16 1667.58 1615.19 1509.12 1634.03 1588.99 1533.76 1519.19 1. (CC) gcc options: -O3 -mavx2
Timed Linux Kernel Compilation Time To Compile Dec 17 Feb 18 OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile SUSE SLES 12 SP3 Ubuntu 16.04 LTS RHEL Server 7 Clear Linux Amazon Linux 2 20 40 60 80 100 SE +/- 0.92, N = 3 SE +/- 0.86, N = 3 SE +/- 0.97, N = 3 SE +/- 0.98, N = 3 SE +/- 0.46, N = 3 SE +/- 0.95, N = 3 SE +/- 0.93, N = 3 SE +/- 1.04, N = 3 SE +/- 1.08, N = 3 SE +/- 0.99, N = 3 84.82 89.15 89.49 92.39 107.48 85.44 91.16 91.50 92.09 98.47
Gzip Compression 2GB File Compression Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression Clear Linux SUSE SLES 12 SP3 Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 4 8 12 16 20 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 5.37 12.39 14.47 14.49 15.56 5.50 12.36 14.41 14.44 15.53
FLAC Audio Encoding WAV To FLAC Dec 17 Feb 18 OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.3.1 WAV To FLAC Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 SUSE SLES 12 SP3 RHEL Server 7 3 6 9 12 15 SE +/- 0.01, N = 5 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.02, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 8.41 8.65 8.77 10.03 10.08 8.41 8.68 8.79 10.15 1. (CXX) g++ options: -fvisibility=hidden -lm
LAME MP3 Encoding WAV To MP3 Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.99.5 WAV To MP3 Clear Linux Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 4 8 12 16 20 SE +/- 0.01, N = 5 SE +/- 0.00, N = 5 SE +/- 0.05, N = 5 SE +/- 0.01, N = 5 SE +/- 0.06, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.05, N = 5 SE +/- 0.01, N = 5 SE +/- 0.10, N = 5 13.47 13.86 15.74 17.16 17.93 13.48 13.86 15.52 17.08 17.14 1. (CC) gcc options: -O3 -ffast-math -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lm
FFmpeg H.264 HD To NTSC DV Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 3.3.3 H.264 HD To NTSC DV SUSE SLES 12 SP3 Clear Linux Ubuntu 16.04 LTS 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 8.86 8.93 9.08 8.91 9.03 9.10 1. (CC) gcc options: -lavdevice -lavfilter -lavformat -lavcodec -lswresample -lswscale -lavutil -ldl -lm -pthread -std=c11 -fomit-frame-pointer -O3 -fno-math-errno -fno-signed-zeros -fno-tree-vectorize -MMD -MF -MT
OpenSSL RSA 4096-bit Performance Dec 17 Feb 18 OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.0.1g RSA 4096-bit Performance SUSE SLES 12 SP3 Ubuntu 16.04 LTS Amazon Linux 2 Clear Linux RHEL Server 7 200 400 600 800 1000 SE +/- 0.33, N = 3 SE +/- 0.22, N = 3 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 SE +/- 1.68, N = 3 SE +/- 0.52, N = 3 SE +/- 0.23, N = 3 SE +/- 0.50, N = 3 SE +/- 0.09, N = 3 987.93 985.67 981.97 974.63 913.67 985.03 983.67 982.40 972.23 1. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl
Perl Benchmarks Test: Pod2html Feb 18 Dec 17 OpenBenchmarking.org seconds, Fewer Is Better Perl Benchmarks Test: Pod2html Clear Linux SUSE SLES 12 SP3 Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 0.0471 0.0942 0.1413 0.1884 0.2355 SE +/- 0.00215561, N = 3 SE +/- 0.00298295, N = 3 SE +/- 0.00147134, N = 3 SE +/- 0.00164852, N = 3 SE +/- 0.00146440, N = 3 SE +/- 0.00111653, N = 3 SE +/- 0.00305347, N = 3 SE +/- 0.00312577, N = 3 SE +/- 0.00152771, N = 3 SE +/- 0.00158891, N = 3 0.19162808 0.19728241 0.19893783 0.19978381 0.20912333 0.19370366 0.19707410 0.19713420 0.19714943 0.20894897
Perl Benchmarks Test: Interpreter Dec 17 Feb 18 OpenBenchmarking.org seconds, Fewer Is Better Perl Benchmarks Test: Interpreter Ubuntu 16.04 LTS SUSE SLES 12 SP3 Clear Linux Amazon Linux 2 RHEL Server 7 0.0004 0.0008 0.0012 0.0016 0.002 SE +/- 0.00000160, N = 3 SE +/- 0.00000162, N = 3 SE +/- 0.00000185, N = 3 SE +/- 0.00000177, N = 3 SE +/- 0.00000152, N = 3 SE +/- 0.00000176, N = 3 SE +/- 0.00000390, N = 3 SE +/- 0.00000055, N = 3 SE +/- 0.00000345, N = 3 SE +/- 0.00000141, N = 3 0.00095212 0.00096575 0.00122207 0.00136237 0.00156785 0.00106251 0.00109300 0.00123346 0.00151685 0.00184399
Redis Test: GET Dec 17 Feb 18 OpenBenchmarking.org Requests Per Second, More Is Better Redis 3.0.1 Test: GET Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS Amazon Linux 2 RHEL Server 7 300K 600K 900K 1200K 1500K SE +/- 882.71, N = 3 SE +/- 7149.40, N = 3 SE +/- 17814.24, N = 3 SE +/- 9673.80, N = 3 SE +/- 4391.51, N = 3 SE +/- 4092.12, N = 3 SE +/- 4151.01, N = 3 SE +/- 1862.66, N = 3 SE +/- 1907.38, N = 3 SE +/- 10021.03, N = 3 1627781.67 1375590.25 1274924.83 1162050.17 1116937.08 914670.88 772643.31 765510.48 720298.19 711523.71 1. (CC) gcc options: -ggdb -rdynamic -lm -pthread
Redis Test: SET Dec 17 Feb 18 OpenBenchmarking.org Requests Per Second, More Is Better Redis 3.0.1 Test: SET Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS Amazon Linux 2 RHEL Server 7 300K 600K 900K 1200K 1500K SE +/- 5936.25, N = 3 SE +/- 7055.31, N = 3 SE +/- 5919.37, N = 3 SE +/- 7106.24, N = 3 SE +/- 16754.69, N = 6 SE +/- 1536.47, N = 3 SE +/- 1154.66, N = 3 SE +/- 3799.22, N = 3 SE +/- 1332.08, N = 3 SE +/- 3528.15, N = 3 1202463.25 1051987.37 976316.06 898315.23 860253.31 780646.17 666078.60 639295.35 616528.58 608436.77 1. (CC) gcc options: -ggdb -rdynamic -lm -pthread
PyBench Total For Average Test Times Dec 17 Feb 18 OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2008-08-14 Total For Average Test Times Clear Linux Ubuntu 16.04 LTS SUSE SLES 12 SP3 Amazon Linux 2 RHEL Server 7 500 1000 1500 2000 2500 SE +/- 2.33, N = 3 SE +/- 1.76, N = 3 SE +/- 1.73, N = 3 SE +/- 4.58, N = 3 SE +/- 4.00, N = 3 SE +/- 4.26, N = 3 SE +/- 3.38, N = 3 SE +/- 1.20, N = 3 SE +/- 2.85, N = 3 1847 2109 2183 2393 2439 2009 2189 2394 2442
PHPBench PHP Benchmark Suite Feb 18 Dec 17 OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 RHEL Server 7 SUSE SLES 12 SP3 110K 220K 330K 440K 550K SE +/- 1655.08, N = 3 SE +/- 539.31, N = 3 SE +/- 417.30, N = 3 SE +/- 990.17, N = 3 SE +/- 1015.07, N = 3 SE +/- 219.54, N = 3 SE +/- 369.97, N = 3 SE +/- 800.43, N = 3 511571 144601 139663 423815 320707 146108 140237 109406
Dolfyn Computational Fluid Dynamics Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better Dolfyn 0.527 Computational Fluid Dynamics Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 7 14 21 28 35 SE +/- 0.19, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.17, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 29.83 29.84 31.10 30.25 30.50 30.79
GraphicsMagick Operation: Sharpen Feb 18 Dec 17 OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.19 Operation: Sharpen Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 SUSE SLES 12 SP3 30 60 90 120 150 122 119 118 119 117 116 102 1. (CC) gcc options: -fopenmp -pthread -lz -lm -lgomp -lpthread
GraphicsMagick Operation: Resizing Feb 18 Dec 17 OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.19 Operation: Resizing Clear Linux Ubuntu 16.04 LTS SUSE SLES 12 SP3 Amazon Linux 2 30 60 90 120 150 155 153 147 153 152 147 147 1. (CC) gcc options: -fopenmp -pthread -lz -lm -lgomp -lpthread
GraphicsMagick Operation: HWB Color Space Feb 18 Dec 17 OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.19 Operation: HWB Color Space Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS Amazon Linux 2 40 80 120 160 200 SE +/- 0.33, N = 3 170 164 161 167 164 160 160 1. (CC) gcc options: -fopenmp -pthread -lz -lm -lgomp -lpthread
GraphicsMagick Operation: Local Adaptive Thresholding Feb 18 Dec 17 OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.19 Operation: Local Adaptive Thresholding Clear Linux Ubuntu 16.04 LTS SUSE SLES 12 SP3 Amazon Linux 2 15 30 45 60 75 69 68 66 69 69 69 66 1. (CC) gcc options: -fopenmp -pthread -lz -lm -lgomp -lpthread
C-Ray Total Time Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time Clear Linux Ubuntu 16.04 LTS SUSE SLES 12 SP3 RHEL Server 7 Amazon Linux 2 4 8 12 16 20 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 14.68 15.56 15.60 15.89 16.94 14.69 15.57 15.61 15.83 18.26 1. (CC) gcc options: -lm -lpthread -O3
Stockfish Total Time Feb 18 Dec 17 OpenBenchmarking.org ms, Fewer Is Better Stockfish 2014-11-26 Total Time SUSE SLES 12 SP3 RHEL Server 7 Amazon Linux 2 Clear Linux Ubuntu 16.04 LTS 1000 2000 3000 4000 5000 SE +/- 4.06, N = 3 SE +/- 8.54, N = 3 SE +/- 1.53, N = 3 SE +/- 2.19, N = 3 SE +/- 11.59, N = 3 SE +/- 2.85, N = 3 SE +/- 1.00, N = 3 SE +/- 4.26, N = 3 SE +/- 1.15, N = 3 SE +/- 4.51, N = 3 4428 4478 4551 4645 4718 4478 4601 4683 4702 4835 1. (CXX) g++ options: -lpthread -fno-exceptions -fno-rtti -ansi -pedantic -O3 -msse -msse3 -mpopcnt -flto
R Benchmark Feb 18 Dec 17 OpenBenchmarking.org Seconds, Fewer Is Better R Benchmark Clear Linux Ubuntu 16.04 LTS 0.2556 0.5112 0.7668 1.0224 1.278 SE +/- 0.0011, N = 3 SE +/- 0.0001, N = 3 SE +/- 0.0088, N = 3 0.2547 0.2580 1.1358 1. Clear Linux: R scripting front-end version 3.4.3 (2017-11-30) 2. Ubuntu 16.04 LTS: R scripting front-end version 3.2.3 (2015-12-10)
Systemd Total Boot Time Test: Total Feb 18 Dec 17 OpenBenchmarking.org ms, Fewer Is Better Systemd Total Boot Time Test: Total Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 RHEL Server 7 SUSE SLES 12 SP3 20K 40K 60K 80K 100K 596.60 7650.00 7799.00 33753.00 41029.00 612.30 9749.00 11013.00 37473.00 84221.00
Systemd Total Boot Time Test: Userspace Dec 17 Feb 18 OpenBenchmarking.org ms, Fewer Is Better Systemd Total Boot Time Test: Userspace Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 RHEL Server 7 SUSE SLES 12 SP3 12K 24K 36K 48K 60K 326.10 6936.00 7279.00 33785.00 56939.00 346.60 3884.00 5246.00 29797.00 38040.00
Systemd Total Boot Time Test: Kernel Feb 18 Dec 17 OpenBenchmarking.org ms, Fewer Is Better Systemd Total Boot Time Test: Kernel Clear Linux Amazon Linux 2 RHEL Server 7 SUSE SLES 12 SP3 Ubuntu 16.04 LTS 6K 12K 18K 24K 30K 250.00 1752.00 2351.00 2419.00 3766.00 286.10 1517.00 2129.00 3733.00 27281.00
SQLite Test Target: Default Test Directory OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.8.10.2 Test Target: Default Test Directory Amazon Linux 2 Clear Linux Ubuntu 16.04 LTS RHEL Server 7 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 SE +/- 0.01, N = 3 20.66 22.81 24.40 25.68 -O2 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -lcurses -O2 -O2 1. (CC) gcc options: -ldl -lpthread
Stress-NG Test: Memory Copying OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Memory Copying SUSE SLES 12 SP3 Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 RHEL Server 7 1600 3200 4800 6400 8000 SE +/- 157.30, N = 6 SE +/- 83.28, N = 3 SE +/- 59.09, N = 3 SE +/- 41.71, N = 3 SE +/- 78.90, N = 3 7541.81 6906.40 6633.35 6611.03 4922.41 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Forking OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Forking Clear Linux RHEL Server 7 Amazon Linux 2 SUSE SLES 12 SP3 Ubuntu 16.04 LTS 12K 24K 36K 48K 60K SE +/- 165.99, N = 3 SE +/- 73.38, N = 3 SE +/- 263.81, N = 3 SE +/- 272.29, N = 3 SE +/- 329.03, N = 3 58016.31 48059.52 47472.94 46037.28 42996.46 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: System V Message Passing Clear Linux Amazon Linux 2 SUSE SLES 12 SP3 RHEL Server 7 Ubuntu 16.04 LTS 1.7M 3.4M 5.1M 6.8M 8.5M SE +/- 114420.09, N = 5 SE +/- 7878.33, N = 3 SE +/- 289861.60, N = 6 SE +/- 12948.19, N = 3 SE +/- 52835.54, N = 3 7715221.96 7121513.63 5634958.44 3771782.89 3664267.10 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Semaphores Amazon Linux 2 Clear Linux SUSE SLES 12 SP3 RHEL Server 7 Ubuntu 16.04 LTS 600K 1200K 1800K 2400K 3000K SE +/- 53265.88, N = 3 SE +/- 38846.21, N = 6 SE +/- 45403.14, N = 3 SE +/- 4653.41, N = 3 SE +/- 17428.53, N = 6 2975130.21 2965228.33 2833822.71 817497.33 730364.50 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Socket Activity SUSE SLES 12 SP3 Ubuntu 16.04 LTS Amazon Linux 2 RHEL Server 7 Clear Linux 2K 4K 6K 8K 10K SE +/- 89.96, N = 3 SE +/- 83.60, N = 3 SE +/- 96.72, N = 3 SE +/- 80.55, N = 3 SE +/- 72.76, N = 3 10077.29 9689.54 9291.03 9168.63 7813.19 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Context Switching SUSE SLES 12 SP3 RHEL Server 7 Clear Linux Ubuntu 16.04 LTS Amazon Linux 2 500K 1000K 1500K 2000K 2500K SE +/- 3492.19, N = 3 SE +/- 5130.30, N = 3 SE +/- 3732.26, N = 3 SE +/- 14656.21, N = 3 SE +/- 80088.91, N = 6 2521014.69 2126165.42 2058642.06 2050120.87 1157544.89 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Hackbench Count: 16 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Process Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS RHEL Server 7 Amazon Linux 2 16 32 48 64 80 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 SE +/- 4.67, N = 6 45.86 47.52 50.30 52.11 73.34 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -lpthread
Hackbench Count: 16 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Thread Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS RHEL Server 7 Amazon Linux 2 20 40 60 80 100 SE +/- 0.21, N = 3 SE +/- 0.14, N = 3 SE +/- 0.12, N = 3 SE +/- 0.08, N = 3 SE +/- 0.61, N = 3 47.27 49.26 49.92 51.95 84.28 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -lpthread
Hackbench Count: 32 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 32 - Type: Process Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS RHEL Server 7 Amazon Linux 2 30 60 90 120 150 SE +/- 0.06, N = 3 SE +/- 0.36, N = 3 SE +/- 0.25, N = 3 SE +/- 0.35, N = 3 SE +/- 1.56, N = 3 81.55 94.10 101.87 102.14 129.30 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -lpthread
Schbench Message Threads: 8 - Workers Per Message Thread: 8 OpenBenchmarking.org usec, 99.9th Latency Percentile, Fewer Is Better Schbench Message Threads: 8 - Workers Per Message Thread: 8 Amazon Linux 2 Ubuntu 16.04 LTS Clear Linux RHEL Server 7 SUSE SLES 12 SP3 20K 40K 60K 80K 100K SE +/- 887.89, N = 6 SE +/- 719.35, N = 3 SE +/- 1125.82, N = 5 SE +/- 950.23, N = 3 SE +/- 1115.88, N = 3 55936 64256 75853 79147 83584 1. (CC) gcc options: -O2 -lpthread
Schbench Message Threads: 8 - Workers Per Message Thread: 16 OpenBenchmarking.org usec, 99.9th Latency Percentile, Fewer Is Better Schbench Message Threads: 8 - Workers Per Message Thread: 16 Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 Clear Linux 40K 80K 120K 160K 200K SE +/- 1209.81, N = 3 SE +/- 391.05, N = 3 SE +/- 903.08, N = 3 SE +/- 3361.74, N = 3 SE +/- 2577.01, N = 3 117888 121216 168533 175019 183040 1. (CC) gcc options: -O2 -lpthread
Schbench Message Threads: 16 - Workers Per Message Thread: 8 OpenBenchmarking.org usec, 99.9th Latency Percentile, Fewer Is Better Schbench Message Threads: 16 - Workers Per Message Thread: 8 Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 Clear Linux 40K 80K 120K 160K 200K SE +/- 840.44, N = 3 SE +/- 1291.33, N = 3 SE +/- 1024.00, N = 3 SE +/- 1065.81, N = 3 SE +/- 2649.46, N = 3 112427 117717 160000 169728 178773 1. (CC) gcc options: -O2 -lpthread
Schbench Message Threads: 16 - Workers Per Message Thread: 16 OpenBenchmarking.org usec, 99.9th Latency Percentile, Fewer Is Better Schbench Message Threads: 16 - Workers Per Message Thread: 16 Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 Clear Linux 80K 160K 240K 320K 400K SE +/- 1536.00, N = 3 SE +/- 1923.32, N = 3 SE +/- 1365.33, N = 3 SE +/- 5639.75, N = 3 SE +/- 3256.11, N = 3 179968 195669 326827 346624 383829 1. (CC) gcc options: -O2 -lpthread
Schbench Message Threads: 32 - Workers Per Message Thread: 8 OpenBenchmarking.org usec, 99.9th Latency Percentile, Fewer Is Better Schbench Message Threads: 32 - Workers Per Message Thread: 8 Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 Clear Linux 80K 160K 240K 320K 400K SE +/- 170.67, N = 3 SE +/- 1194.67, N = 3 SE +/- 5536.15, N = 4 SE +/- 4705.57, N = 6 SE +/- 7486.02, N = 3 187989 195499 324864 348160 394069 1. (CC) gcc options: -O2 -lpthread
Schbench Message Threads: 32 - Workers Per Message Thread: 16 OpenBenchmarking.org usec, 99.9th Latency Percentile, Fewer Is Better Schbench Message Threads: 32 - Workers Per Message Thread: 16 Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 Clear Linux 160K 320K 480K 640K 800K SE +/- 3563.62, N = 3 SE +/- 5832.71, N = 3 SE +/- 9184.34, N = 3 SE +/- 11361.84, N = 3 294741 333312 675499 715093 753323 1. (CC) gcc options: -O2 -lpthread
Crafty Elapsed Time OpenBenchmarking.org Nodes Per Second, More Is Better Crafty 25.2 Elapsed Time Clear Linux Amazon Linux 2 RHEL Server 7 SUSE SLES 12 SP3 Ubuntu 16.04 LTS 1.2M 2.4M 3.6M 4.8M 6M SE +/- 9623.03, N = 3 SE +/- 12533.44, N = 3 SE +/- 3984.40, N = 3 SE +/- 5844.86, N = 3 SE +/- 8324.74, N = 3 5399095 5397216 5315611 5286783 5268520 1. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm
Botan Test: AES-256 - Encrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: AES-256 - Encrypt Clear Linux Ubuntu 16.04 LTS RHEL Server 7 Amazon Linux 2 300 600 900 1200 1500 SE +/- 0.15, N = 3 SE +/- 1.58, N = 3 SE +/- 10.79, N = 3 SE +/- 0.48, N = 3 1387.93 1314.41 1260.87 1251.49 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: AES-256 - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: AES-256 - Decrypt Feb 18: Amazon Linux 2 300 600 900 1200 1500 SE +/- 0.58, N = 3 1250.09 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: Blowfish - Encrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: Blowfish - Encrypt RHEL Server 7 Ubuntu 16.04 LTS Clear Linux Amazon Linux 2 40 80 120 160 200 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 176.47 168.75 166.22 163.83 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: Blowfish - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: Blowfish - Decrypt Feb 18: Amazon Linux 2 40 80 120 160 200 SE +/- 0.01, N = 3 163.18 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: CAST-256 - Encrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: CAST-256 - Encrypt Clear Linux Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.23, N = 3 SE +/- 0.05, N = 3 86.53 85.91 83.12 82.56 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: CAST-256 - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: CAST-256 - Decrypt Feb 18: Amazon Linux 2 20 40 60 80 100 SE +/- 0.02, N = 3 85.91 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: KASUMI - Encrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: KASUMI - Encrypt Clear Linux Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 13 26 39 52 65 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 58.72 58.02 57.98 53.26 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: KASUMI - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: KASUMI - Decrypt Feb 18: Amazon Linux 2 13 26 39 52 65 SE +/- 0.04, N = 3 56.29 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: Twofish - Encrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: Twofish - Encrypt Clear Linux Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 50 100 150 200 250 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 219.25 212.55 209.51 202.27 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: Twofish - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: Twofish - Decrypt Feb 18: Amazon Linux 2 50 100 150 200 250 SE +/- 0.20, N = 3 210.60 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
BLAKE2 OpenBenchmarking.org Cycles Per Byte, Fewer Is Better BLAKE2 20170307 Ubuntu 16.04 LTS RHEL Server 7 SUSE SLES 12 SP3 Amazon Linux 2 Clear Linux 1.2083 2.4166 3.6249 4.8332 6.0415 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4.84 4.85 4.85 5.37 5.37 1. (CC) gcc options: -O3 -march=native -lcrypto -lz
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment SUSE SLES 12 SP3 Clear Linux Amazon Linux 2 Ubuntu 16.04 LTS 1.0935 2.187 3.2805 4.374 5.4675 SE +/- 0.07, N = 4 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 6 4.32 4.62 4.76 4.86 1. (CC) gcc options: -O3 -lm -lpthread
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving Ubuntu 16.04 LTS Amazon Linux 2 6K 12K 18K 24K 30K SE +/- 171.78, N = 3 SE +/- 253.88, N = 3 26900.46 23256.82 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
POV-Ray Trace Time OpenBenchmarking.org Seconds, Fewer Is Better POV-Ray 3.7.0.7 Trace Time Amazon Linux 2 Ubuntu 16.04 LTS RHEL Server 7 20 40 60 80 100 SE +/- 0.06, N = 3 SE +/- 0.29, N = 3 SE +/- 0.36, N = 3 81.42 84.71 88.16 1. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance Amazon Linux 2 Clear Linux SUSE SLES 12 SP3 Ubuntu 16.04 LTS RHEL Server 7 200 400 600 800 1000 SE +/- 0.20, N = 3 SE +/- 0.30, N = 3 SE +/- 0.20, N = 3 SE +/- 0.03, N = 3 SE +/- 0.35, N = 3 1020.80 1020.13 1019.80 1019.57 1002.80 1. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl
Botan Test: AES-256 - Encrypt - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: AES-256 - Encrypt - Decrypt Clear Linux Ubuntu 16.04 LTS RHEL Server 7 300 600 900 1200 1500 SE +/- 0.32, N = 3 SE +/- 2.22, N = 3 SE +/- 10.59, N = 3 1394.28 1317.49 1266.70 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: Blowfish - Encrypt - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: Blowfish - Encrypt - Decrypt RHEL Server 7 Ubuntu 16.04 LTS Clear Linux 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.32, N = 3 SE +/- 0.05, N = 3 175.97 166.92 165.76 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: CAST-256 - Encrypt - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: CAST-256 - Encrypt - Decrypt Clear Linux Ubuntu 16.04 LTS RHEL Server 7 20 40 60 80 100 SE +/- 0.20, N = 3 SE +/- 0.23, N = 3 SE +/- 0.04, N = 3 86.34 83.11 82.58 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: KASUMI - Encrypt - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: KASUMI - Encrypt - Decrypt Clear Linux Ubuntu 16.04 LTS RHEL Server 7 13 26 39 52 65 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 56.97 56.30 50.40 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Botan Test: Twofish - Encrypt - Decrypt OpenBenchmarking.org MiB/s, More Is Better Botan 2.4.0 Test: Twofish - Encrypt - Decrypt Clear Linux Ubuntu 16.04 LTS RHEL Server 7 50 100 150 200 250 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.23, N = 3 216.99 205.82 204.74 1. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt
Phoronix Test Suite v10.8.4