Amazon EC2 Cloud Linux OS Benchmarks Testing for a future article on Phoronix.com. Amazon m3.xlarge EC2 Cloud benchmarks comparing various enterprise Linux operating systems in Amazon's Compute Cloud like Red Hat Enterprise Linux, SUSE Enterprise Server, Ubuntu Linux, and Amazon Linux AMI. Cloud benchmarks by Michael Larabel of Phoronix.
HTML result view exported from: https://openbenchmarking.org/result/1311083-SO-AMAZONCLO17&sor&grs .
Amazon EC2 Cloud Linux OS Benchmarks Processor Memory Disk OS Kernel Compiler File-System System Layer Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 Intel Xeon E5-2670 0 @ 2.59GHz (4 Cores) 15360MB 6GB RedHatEnterpriseServer 6.4 2.6.32-358.14.1.el6.x86_64 (x86_64) GCC 4.4.7 20120313 ext4 Xen 3.4.3.amazon Hypervisor 8GB Amazon Linux AMI 2013.09 3.4.62-53.42.amzn1.x86_64 (x86_64) GCC 4.6.3 20120306 Ubuntu 12.04 3.2.0-54-virtual (x86_64) GCC 4.6 Intel Xeon E5-2670 0 @ 2.60GHz (4 Cores) Ubuntu 13.10 3.11.0-12-generic (x86_64) GCC 4.8 16384MB 10GB SUSE Linux Enterprise Server 11 3.0.82-0.7-ec2 (x86_64) GCC 4.3 ext3 OpenBenchmarking.org Compiler Details - Red Hat Enterprise Linux 6.4: --build=x86_64-redhat-linux --disable-dssi --disable-libjava-multilib --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-java-awt=gtk --enable-java-maintainer-mode --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-libgcj-multifile --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-cloog --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --with-ppl --with-tune=generic - Amazon Linux AMI 2013.09: --build=x86_64-amazon-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-languages=c,c++,objc,obj-c++,,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-tune=generic - Ubuntu 12.04.3 LTS: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v - Ubuntu 13.10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - SUSE Linux Enterprise 11: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --mandir=/usr/share/man --with-cpu=generic --with-slibdir=/lib64 --without-system-libunwind System Details - Red Hat Enterprise Linux 6.4: SELinux: Enabled. Disk Mount Options Details - Red Hat Enterprise Linux 6.4: barrier=1,data=ordered,relatime,rw,seclabel - Amazon Linux AMI 2013.09: data=ordered,noatime,rw - Ubuntu 12.04.3 LTS: acl,barrier=1,data=ordered,relatime,rw,user_xattr - Ubuntu 13.10: data=ordered,relatime,rw - SUSE Linux Enterprise 11: acl,barrier=1,data=ordered,errors=continue,relatime,rw,user_xattr
Amazon EC2 Cloud Linux OS Benchmarks postmark: Disk Transaction Performance john-the-ripper: Traditional DES c-ray: Total Time john-the-ripper: MD5 build-linux-kernel: Time To Compile rodinia: OpenMP Leukocyte hmmer: Pfam Database Search dolfyn: Computational Fluid Dynamics rodinia: OpenMP CFD Solver ffte: N=64, 1D Complex FFT Routine compress-pbzip2: 256MB File Compression mafft: Multiple Sequence Alignment polybench-c: Correlation Computation john-the-ripper: Blowfish polybench-c: Covariance Computation rodinia: OpenMP Streamcluster polybench-c: 3 Matrix Multiplications himeno: Poisson Pressure Solver Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 1685 7279333 131.61 24392 238.34 103.46 27.60 36.66 224.44 4355.77 19.93 13.10 6.72 1907 6.71 56.85 25.66 1214.54 2055 7940333 129.56 26860 210.61 100.77 29.24 33.50 247.46 3986.60 19.14 12.43 6.72 1975 6.68 55.74 25.68 1199.42 2011 7946000 129.02 26684 240.40 101.53 26.03 33.30 228.41 4054.00 18.90 12.29 6.71 2003 6.70 56.21 25.70 1172.08 1963 3363667 77.16 28584 259.85 103.01 25.87 33.17 225.91 4220.04 18.57 12.48 6.64 1996 6.61 55.59 25.76 1205.22 779 7951333 118.54 18533 88.75 25.46 227.31 4043.54 18.55 12.28 6.39 1972 6.39 54.14 24.71 1189.83 OpenBenchmarking.org
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 Red Hat Enterprise Linux 6.4 SUSE Linux Enterprise 11 400 800 1200 1600 2000 SE +/- 5.67, N = 3 SE +/- 5.33, N = 3 SE +/- 5.00, N = 3 SE +/- 4.00, N = 3 SE +/- 15.11, N = 6 2055 2011 1963 1685 779 1. (CC) gcc options: -O3
John The Ripper Test: Traditional DES OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.9-jumbo-7 Test: Traditional DES SUSE Linux Enterprise 11 Ubuntu 12.04.3 LTS Amazon Linux AMI 2013.09 Red Hat Enterprise Linux 6.4 Ubuntu 13.10 2M 4M 6M 8M 10M SE +/- 35964.49, N = 3 SE +/- 0.00, N = 3 SE +/- 21666.67, N = 3 SE +/- 63024.69, N = 3 SE +/- 11333.33, N = 3 7951333 7946000 7940333 7279333 3363667 1. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time Ubuntu 13.10 SUSE Linux Enterprise 11 Ubuntu 12.04.3 LTS Amazon Linux AMI 2013.09 Red Hat Enterprise Linux 6.4 30 60 90 120 150 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 77.16 118.54 129.02 129.56 131.61 1. (CC) gcc options: -lm -lpthread -O3
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.9-jumbo-7 Test: MD5 Ubuntu 13.10 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Red Hat Enterprise Linux 6.4 SUSE Linux Enterprise 11 6K 12K 18K 24K 30K SE +/- 60.40, N = 3 SE +/- 140.68, N = 3 SE +/- 8.00, N = 3 SE +/- 60.53, N = 3 SE +/- 24.69, N = 3 28584 26860 26684 24392 18533 1. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 3.1 Time To Compile Amazon Linux AMI 2013.09 Red Hat Enterprise Linux 6.4 Ubuntu 12.04.3 LTS Ubuntu 13.10 60 120 180 240 300 SE +/- 0.96, N = 3 SE +/- 0.83, N = 3 SE +/- 2.50, N = 3 SE +/- 2.61, N = 3 210.61 238.34 240.40 259.85
Rodinia Test: OpenMP Leukocyte OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP Leukocyte SUSE Linux Enterprise 11 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 Red Hat Enterprise Linux 6.4 20 40 60 80 100 SE +/- 1.27, N = 3 SE +/- 1.32, N = 3 SE +/- 1.43, N = 3 SE +/- 1.56, N = 3 SE +/- 1.02, N = 3 88.75 100.77 101.53 103.01 103.46 -O3 -fopenmp -O3 -fopenmp -O2 -lOpenCL -O2 -lOpenCL -O3 -fopenmp 1. (CXX) g++ options:
Timed HMMer Search Pfam Database Search OpenBenchmarking.org Seconds, Fewer Is Better Timed HMMer Search 2.3.2 Pfam Database Search SUSE Linux Enterprise 11 Ubuntu 13.10 Ubuntu 12.04.3 LTS Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 7 14 21 28 35 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 25.46 25.87 26.03 27.60 29.24 1. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm
Dolfyn Computational Fluid Dynamics OpenBenchmarking.org Seconds, Fewer Is Better Dolfyn 0.527 Computational Fluid Dynamics Ubuntu 13.10 Ubuntu 12.04.3 LTS Amazon Linux AMI 2013.09 Red Hat Enterprise Linux 6.4 8 16 24 32 40 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 33.17 33.30 33.50 36.66
Rodinia Test: OpenMP CFD Solver OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP CFD Solver Red Hat Enterprise Linux 6.4 Ubuntu 13.10 SUSE Linux Enterprise 11 Ubuntu 12.04.3 LTS Amazon Linux AMI 2013.09 50 100 150 200 250 SE +/- 0.24, N = 3 SE +/- 0.08, N = 3 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 SE +/- 0.93, N = 3 224.44 225.91 227.31 228.41 247.46 -O3 -fopenmp -O2 -lOpenCL -O3 -fopenmp -O2 -lOpenCL -O3 -fopenmp 1. (CXX) g++ options:
FFTE Test: N=64, 1D Complex FFT Routine OpenBenchmarking.org MFLOPS, More Is Better FFTE 5.0 Test: N=64, 1D Complex FFT Routine Red Hat Enterprise Linux 6.4 Ubuntu 13.10 Ubuntu 12.04.3 LTS SUSE Linux Enterprise 11 Amazon Linux AMI 2013.09 900 1800 2700 3600 4500 SE +/- 14.72, N = 3 SE +/- 2.47, N = 3 SE +/- 3.59, N = 3 SE +/- 71.29, N = 6 SE +/- 51.13, N = 3 4355.77 4220.04 4054.00 4043.54 3986.60 -m64 -O2 -fPIC -lmpichf90 -lmpich -lopa -lpthread -lrt -lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread -lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread 1. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp
Parallel BZIP2 Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.6 256MB File Compression SUSE Linux Enterprise 11 Ubuntu 13.10 Ubuntu 12.04.3 LTS Amazon Linux AMI 2013.09 Red Hat Enterprise Linux 6.4 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.34, N = 3 18.55 18.57 18.90 19.14 19.93 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment SUSE Linux Enterprise 11 Ubuntu 12.04.3 LTS Amazon Linux AMI 2013.09 Ubuntu 13.10 Red Hat Enterprise Linux 6.4 3 6 9 12 15 SE +/- 0.20, N = 6 SE +/- 0.21, N = 6 SE +/- 0.22, N = 6 SE +/- 0.30, N = 6 SE +/- 0.01, N = 3 12.28 12.29 12.43 12.48 13.10 1. (CC) gcc options: -O3 -lm -lpthread
PolyBench-C Test: Correlation Computation OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: Correlation Computation SUSE Linux Enterprise 11 Ubuntu 13.10 Ubuntu 12.04.3 LTS Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 6.39 6.64 6.71 6.72 6.72 1. (CC) gcc options: -O3
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.9-jumbo-7 Test: Blowfish Ubuntu 12.04.3 LTS Ubuntu 13.10 Amazon Linux AMI 2013.09 SUSE Linux Enterprise 11 Red Hat Enterprise Linux 6.4 400 800 1200 1600 2000 SE +/- 6.67, N = 3 SE +/- 0.00, N = 3 SE +/- 33.08, N = 6 SE +/- 0.00, N = 3 SE +/- 6.67, N = 3 2003 1996 1975 1972 1907 1. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl
PolyBench-C Test: Covariance Computation OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: Covariance Computation SUSE Linux Enterprise 11 Ubuntu 13.10 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Red Hat Enterprise Linux 6.4 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 6.39 6.61 6.68 6.70 6.71 1. (CC) gcc options: -O3
Rodinia Test: OpenMP Streamcluster OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP Streamcluster SUSE Linux Enterprise 11 Ubuntu 13.10 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Red Hat Enterprise Linux 6.4 13 26 39 52 65 SE +/- 0.11, N = 3 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 54.14 55.59 55.74 56.21 56.85 -O3 -fopenmp -O2 -lOpenCL -O3 -fopenmp -O2 -lOpenCL -O3 -fopenmp 1. (CXX) g++ options:
PolyBench-C Test: 3 Matrix Multiplications OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: 3 Matrix Multiplications SUSE Linux Enterprise 11 Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 24.71 25.66 25.68 25.70 25.76 1. (CC) gcc options: -O3
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Red Hat Enterprise Linux 6.4 Ubuntu 13.10 Amazon Linux AMI 2013.09 SUSE Linux Enterprise 11 Ubuntu 12.04.3 LTS 300 600 900 1200 1500 SE +/- 1.14, N = 3 SE +/- 4.15, N = 3 SE +/- 1.47, N = 3 SE +/- 0.95, N = 3 SE +/- 2.31, N = 3 1214.54 1205.22 1199.42 1189.83 1172.08 1. (CC) gcc options: -O3
Phoronix Test Suite v10.8.4