Amazon EC2 Cloud Linux OS Benchmarks Testing for a future article on Phoronix.com. Amazon m3.xlarge EC2 Cloud benchmarks comparing various enterprise Linux operating systems in Amazon's Compute Cloud like Red Hat Enterprise Linux, SUSE Enterprise Server, Ubuntu Linux, and Amazon Linux AMI. Cloud benchmarks by Michael Larabel of Phoronix.
HTML result view exported from: https://openbenchmarking.org/result/1311083-SO-AMAZONCLO17&grr .
Amazon EC2 Cloud Linux OS Benchmarks Processor Memory Disk OS Kernel Compiler File-System System Layer Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 Intel Xeon E5-2670 0 @ 2.59GHz (4 Cores) 15360MB 6GB RedHatEnterpriseServer 6.4 2.6.32-358.14.1.el6.x86_64 (x86_64) GCC 4.4.7 20120313 ext4 Xen 3.4.3.amazon Hypervisor 8GB Amazon Linux AMI 2013.09 3.4.62-53.42.amzn1.x86_64 (x86_64) GCC 4.6.3 20120306 Ubuntu 12.04 3.2.0-54-virtual (x86_64) GCC 4.6 Intel Xeon E5-2670 0 @ 2.60GHz (4 Cores) Ubuntu 13.10 3.11.0-12-generic (x86_64) GCC 4.8 16384MB 10GB SUSE Linux Enterprise Server 11 3.0.82-0.7-ec2 (x86_64) GCC 4.3 ext3 OpenBenchmarking.org Compiler Details - Red Hat Enterprise Linux 6.4: --build=x86_64-redhat-linux --disable-dssi --disable-libjava-multilib --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-java-awt=gtk --enable-java-maintainer-mode --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-libgcj-multifile --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-cloog --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --with-ppl --with-tune=generic - Amazon Linux AMI 2013.09: --build=x86_64-amazon-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-languages=c,c++,objc,obj-c++,,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-tune=generic - Ubuntu 12.04.3 LTS: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v - Ubuntu 13.10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - SUSE Linux Enterprise 11: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --mandir=/usr/share/man --with-cpu=generic --with-slibdir=/lib64 --without-system-libunwind System Details - Red Hat Enterprise Linux 6.4: SELinux: Enabled. Disk Mount Options Details - Red Hat Enterprise Linux 6.4: barrier=1,data=ordered,relatime,rw,seclabel - Amazon Linux AMI 2013.09: data=ordered,noatime,rw - Ubuntu 12.04.3 LTS: acl,barrier=1,data=ordered,relatime,rw,user_xattr - Ubuntu 13.10: data=ordered,relatime,rw - SUSE Linux Enterprise 11: acl,barrier=1,data=ordered,errors=continue,relatime,rw,user_xattr
Amazon EC2 Cloud Linux OS Benchmarks compress-pbzip2: 256MB File Compression c-ray: Total Time build-linux-kernel: Time To Compile himeno: Poisson Pressure Solver john-the-ripper: MD5 john-the-ripper: Traditional DES john-the-ripper: Blowfish mafft: Multiple Sequence Alignment hmmer: Pfam Database Search ffte: N=64, 1D Complex FFT Routine polybench-c: 3 Matrix Multiplications polybench-c: Correlation Computation polybench-c: Covariance Computation dolfyn: Computational Fluid Dynamics rodinia: OpenMP Streamcluster rodinia: OpenMP CFD Solver rodinia: OpenMP Leukocyte postmark: Disk Transaction Performance Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 19.93 131.61 238.34 1214.54 24392 7279333 1907 13.10 27.60 4355.77 25.66 6.72 6.71 36.66 56.85 224.44 103.46 1685 19.14 129.56 210.61 1199.42 26860 7940333 1975 12.43 29.24 3986.60 25.68 6.72 6.68 33.50 55.74 247.46 100.77 2055 18.90 129.02 240.40 1172.08 26684 7946000 2003 12.29 26.03 4054.00 25.70 6.71 6.70 33.30 56.21 228.41 101.53 2011 18.57 77.16 259.85 1205.22 28584 3363667 1996 12.48 25.87 4220.04 25.76 6.64 6.61 33.17 55.59 225.91 103.01 1963 18.55 118.54 1189.83 18533 7951333 1972 12.28 25.46 4043.54 24.71 6.39 6.39 54.14 227.31 88.75 779 OpenBenchmarking.org
Parallel BZIP2 Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.6 256MB File Compression Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 5 10 15 20 25 SE +/- 0.34, N = 3 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 19.93 19.14 18.90 18.57 18.55 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 131.61 129.56 129.02 77.16 118.54 1. (CC) gcc options: -lm -lpthread -O3
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 3.1 Time To Compile Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 60 120 180 240 300 SE +/- 0.83, N = 3 SE +/- 0.96, N = 3 SE +/- 2.50, N = 3 SE +/- 2.61, N = 3 238.34 210.61 240.40 259.85
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 300 600 900 1200 1500 SE +/- 1.14, N = 3 SE +/- 1.47, N = 3 SE +/- 2.31, N = 3 SE +/- 4.15, N = 3 SE +/- 0.95, N = 3 1214.54 1199.42 1172.08 1205.22 1189.83 1. (CC) gcc options: -O3
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.9-jumbo-7 Test: MD5 Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 6K 12K 18K 24K 30K SE +/- 60.53, N = 3 SE +/- 140.68, N = 3 SE +/- 8.00, N = 3 SE +/- 60.40, N = 3 SE +/- 24.69, N = 3 24392 26860 26684 28584 18533 1. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl
John The Ripper Test: Traditional DES OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.9-jumbo-7 Test: Traditional DES Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 2M 4M 6M 8M 10M SE +/- 63024.69, N = 3 SE +/- 21666.67, N = 3 SE +/- 0.00, N = 3 SE +/- 11333.33, N = 3 SE +/- 35964.49, N = 3 7279333 7940333 7946000 3363667 7951333 1. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.9-jumbo-7 Test: Blowfish Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 400 800 1200 1600 2000 SE +/- 6.67, N = 3 SE +/- 33.08, N = 6 SE +/- 6.67, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1907 1975 2003 1996 1972 1. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.22, N = 6 SE +/- 0.21, N = 6 SE +/- 0.30, N = 6 SE +/- 0.20, N = 6 13.10 12.43 12.29 12.48 12.28 1. (CC) gcc options: -O3 -lm -lpthread
Timed HMMer Search Pfam Database Search OpenBenchmarking.org Seconds, Fewer Is Better Timed HMMer Search 2.3.2 Pfam Database Search Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 7 14 21 28 35 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 27.60 29.24 26.03 25.87 25.46 1. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm
FFTE Test: N=64, 1D Complex FFT Routine OpenBenchmarking.org MFLOPS, More Is Better FFTE 5.0 Test: N=64, 1D Complex FFT Routine Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 900 1800 2700 3600 4500 SE +/- 14.72, N = 3 SE +/- 51.13, N = 3 SE +/- 3.59, N = 3 SE +/- 2.47, N = 3 SE +/- 71.29, N = 6 4355.77 3986.60 4054.00 4220.04 4043.54 -m64 -O2 -fPIC -lmpichf90 -lmpich -lopa -lpthread -lrt -lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread -lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread 1. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp
PolyBench-C Test: 3 Matrix Multiplications OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: 3 Matrix Multiplications Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 25.66 25.68 25.70 25.76 24.71 1. (CC) gcc options: -O3
PolyBench-C Test: Correlation Computation OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: Correlation Computation Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 6.72 6.72 6.71 6.64 6.39 1. (CC) gcc options: -O3
PolyBench-C Test: Covariance Computation OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: Covariance Computation Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 6.71 6.68 6.70 6.61 6.39 1. (CC) gcc options: -O3
Dolfyn Computational Fluid Dynamics OpenBenchmarking.org Seconds, Fewer Is Better Dolfyn 0.527 Computational Fluid Dynamics Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 8 16 24 32 40 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 36.66 33.50 33.30 33.17
Rodinia Test: OpenMP Streamcluster OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP Streamcluster Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 13 26 39 52 65 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.17, N = 3 SE +/- 0.11, N = 3 56.85 55.74 56.21 55.59 54.14 -O3 -fopenmp -O3 -fopenmp -O2 -lOpenCL -O2 -lOpenCL -O3 -fopenmp 1. (CXX) g++ options:
Rodinia Test: OpenMP CFD Solver OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP CFD Solver Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 50 100 150 200 250 SE +/- 0.24, N = 3 SE +/- 0.93, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.16, N = 3 224.44 247.46 228.41 225.91 227.31 -O3 -fopenmp -O3 -fopenmp -O2 -lOpenCL -O2 -lOpenCL -O3 -fopenmp 1. (CXX) g++ options:
Rodinia Test: OpenMP Leukocyte OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP Leukocyte Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 20 40 60 80 100 SE +/- 1.02, N = 3 SE +/- 1.32, N = 3 SE +/- 1.43, N = 3 SE +/- 1.56, N = 3 SE +/- 1.27, N = 3 103.46 100.77 101.53 103.01 88.75 -O3 -fopenmp -O3 -fopenmp -O2 -lOpenCL -O2 -lOpenCL -O3 -fopenmp 1. (CXX) g++ options:
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance Red Hat Enterprise Linux 6.4 Amazon Linux AMI 2013.09 Ubuntu 12.04.3 LTS Ubuntu 13.10 SUSE Linux Enterprise 11 400 800 1200 1600 2000 SE +/- 4.00, N = 3 SE +/- 5.67, N = 3 SE +/- 5.33, N = 3 SE +/- 5.00, N = 3 SE +/- 15.11, N = 6 1685 2055 2011 1963 779 1. (CC) gcc options: -O3
Phoronix Test Suite v10.8.4