Amazon EC2 Cloud Linux OS Benchmarks

Testing for a future article on Phoronix.com. Amazon m3.xlarge EC2 Cloud benchmarks comparing various enterprise Linux operating systems in Amazon's Compute Cloud like Red Hat Enterprise Linux, SUSE Enterprise Server, Ubuntu Linux, and Amazon Linux AMI. Cloud benchmarks by Michael Larabel of Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1311083-SO-AMAZONCLO17&rdt&grs.

Amazon EC2 Cloud Linux OS BenchmarksProcessorMemoryDiskOSKernelCompilerFile-SystemSystem LayerRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10Intel Xeon E5-2670 0 @ 2.59GHz (4 Cores)15360MB6GBRedHatEnterpriseServer 6.42.6.32-358.14.1.el6.x86_64 (x86_64)GCC 4.4.7 20120313ext4Xen 3.4.3.amazon Hypervisor8GBAmazon Linux AMI 2013.093.4.62-53.42.amzn1.x86_64 (x86_64)GCC 4.6.3 20120306Intel Xeon E5-2670 0 @ 2.60GHz (4 Cores)16384MB10GBSUSE Linux Enterprise Server 113.0.82-0.7-ec2 (x86_64)GCC 4.3ext3Intel Xeon E5-2670 0 @ 2.59GHz (4 Cores)15360MB8GBUbuntu 12.043.2.0-54-virtual (x86_64)GCC 4.6ext4Intel Xeon E5-2670 0 @ 2.60GHz (4 Cores)Ubuntu 13.103.11.0-12-generic (x86_64)GCC 4.8OpenBenchmarking.orgCompiler Details- Red Hat Enterprise Linux 6.4: --build=x86_64-redhat-linux --disable-dssi --disable-libjava-multilib --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-java-awt=gtk --enable-java-maintainer-mode --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-libgcj-multifile --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-cloog --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --with-ppl --with-tune=generic - Amazon Linux AMI 2013.09: --build=x86_64-amazon-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-languages=c,c++,objc,obj-c++,,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-tune=generic - SUSE Linux Enterprise 11: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --mandir=/usr/share/man --with-cpu=generic --with-slibdir=/lib64 --without-system-libunwind - Ubuntu 12.04.3 LTS: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v - Ubuntu 13.10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v System Details- Red Hat Enterprise Linux 6.4: SELinux: Enabled.Disk Mount Options Details- Red Hat Enterprise Linux 6.4: barrier=1,data=ordered,relatime,rw,seclabel- Amazon Linux AMI 2013.09: data=ordered,noatime,rw- SUSE Linux Enterprise 11: acl,barrier=1,data=ordered,errors=continue,relatime,rw,user_xattr- Ubuntu 12.04.3 LTS: acl,barrier=1,data=ordered,relatime,rw,user_xattr- Ubuntu 13.10: data=ordered,relatime,rw

Amazon EC2 Cloud Linux OS Benchmarkspostmark: Disk Transaction Performancejohn-the-ripper: Traditional DESc-ray: Total Timejohn-the-ripper: MD5build-linux-kernel: Time To Compilerodinia: OpenMP Leukocytehmmer: Pfam Database Searchdolfyn: Computational Fluid Dynamicsrodinia: OpenMP CFD Solverffte: N=64, 1D Complex FFT Routinecompress-pbzip2: 256MB File Compressionmafft: Multiple Sequence Alignmentpolybench-c: Correlation Computationjohn-the-ripper: Blowfishpolybench-c: Covariance Computationrodinia: OpenMP Streamclusterpolybench-c: 3 Matrix Multiplicationshimeno: Poisson Pressure SolverRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.1016857279333131.6124392238.34103.4627.6036.66224.444355.7719.9313.106.7219076.7156.8525.661214.5420557940333129.5626860210.61100.7729.2433.50247.463986.6019.1412.436.7219756.6855.7425.681199.427797951333118.541853388.7525.46227.314043.5418.5512.286.3919726.3954.1424.711189.8320117946000129.0226684240.40101.5326.0333.30228.414054.0018.9012.296.7120036.7056.2125.701172.081963336366777.1628584259.85103.0125.8733.17225.914220.0418.5712.486.6419966.6155.5925.761205.22OpenBenchmarking.org

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10400800120016002000SE +/- 4.00, N = 3SE +/- 5.67, N = 3SE +/- 15.11, N = 6SE +/- 5.33, N = 3SE +/- 5.00, N = 316852055779201119631. (CC) gcc options: -O3

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Test: Traditional DESRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.102M4M6M8M10MSE +/- 63024.69, N = 3SE +/- 21666.67, N = 3SE +/- 35964.49, N = 3SE +/- 0.00, N = 3SE +/- 11333.33, N = 3727933379403337951333794600033636671. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10306090120150SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3131.61129.56118.54129.0277.161. (CC) gcc options: -lm -lpthread -O3

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Test: MD5Red Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.106K12K18K24K30KSE +/- 60.53, N = 3SE +/- 140.68, N = 3SE +/- 24.69, N = 3SE +/- 8.00, N = 3SE +/- 60.40, N = 324392268601853326684285841. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 3.1Time To CompileRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSUbuntu 13.1060120180240300SE +/- 0.83, N = 3SE +/- 0.96, N = 3SE +/- 2.50, N = 3SE +/- 2.61, N = 3238.34210.61240.40259.85

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP LeukocyteRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.1020406080100SE +/- 1.02, N = 3SE +/- 1.32, N = 3SE +/- 1.27, N = 3SE +/- 1.43, N = 3SE +/- 1.56, N = 3103.46100.7788.75101.53103.01-O3 -fopenmp-O3 -fopenmp-O3 -fopenmp-O2 -lOpenCL-O2 -lOpenCL1. (CXX) g++ options:

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10714212835SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 327.6029.2425.4626.0325.871. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

Dolfyn

Computational Fluid Dynamics

OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid DynamicsRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSUbuntu 13.10816243240SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 336.6633.5033.3033.17

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP CFD SolverRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.1050100150200250SE +/- 0.24, N = 3SE +/- 0.93, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3224.44247.46227.31228.41225.91-O3 -fopenmp-O3 -fopenmp-O3 -fopenmp-O2 -lOpenCL-O2 -lOpenCL1. (CXX) g++ options:

FFTE

Test: N=64, 1D Complex FFT Routine

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 5.0Test: N=64, 1D Complex FFT RoutineRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.109001800270036004500SE +/- 14.72, N = 3SE +/- 51.13, N = 3SE +/- 71.29, N = 6SE +/- 3.59, N = 3SE +/- 2.47, N = 34355.773986.604043.544054.004220.04-m64 -O2 -fPIC -lmpichf90 -lmpich -lopa -lpthread -lrt-lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread-lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread1. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.6256MB File CompressionRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10510152025SE +/- 0.34, N = 3SE +/- 0.18, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 319.9319.1418.5518.9018.571. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

Timed MAFFT Alignment

Multiple Sequence Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.864Multiple Sequence AlignmentRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.103691215SE +/- 0.01, N = 3SE +/- 0.22, N = 6SE +/- 0.20, N = 6SE +/- 0.21, N = 6SE +/- 0.30, N = 613.1012.4312.2812.2912.481. (CC) gcc options: -O3 -lm -lpthread

PolyBench-C

Test: Correlation Computation

OpenBenchmarking.orgSeconds, Fewer Is BetterPolyBench-C 3.2Test: Correlation ComputationRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.726.726.396.716.641. (CC) gcc options: -O3

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Test: BlowfishRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10400800120016002000SE +/- 6.67, N = 3SE +/- 33.08, N = 6SE +/- 0.00, N = 3SE +/- 6.67, N = 3SE +/- 0.00, N = 3190719751972200319961. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

PolyBench-C

Test: Covariance Computation

OpenBenchmarking.orgSeconds, Fewer Is BetterPolyBench-C 3.2Test: Covariance ComputationRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 36.716.686.396.706.611. (CC) gcc options: -O3

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP StreamclusterRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.101326395265SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.17, N = 356.8555.7454.1456.2155.59-O3 -fopenmp-O3 -fopenmp-O3 -fopenmp-O2 -lOpenCL-O2 -lOpenCL1. (CXX) g++ options:

PolyBench-C

Test: 3 Matrix Multiplications

OpenBenchmarking.orgSeconds, Fewer Is BetterPolyBench-C 3.2Test: 3 Matrix MultiplicationsRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.10612182430SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 325.6625.6824.7125.7025.761. (CC) gcc options: -O3

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSUbuntu 13.1030060090012001500SE +/- 1.14, N = 3SE +/- 1.47, N = 3SE +/- 0.95, N = 3SE +/- 2.31, N = 3SE +/- 4.15, N = 31214.541199.421189.831172.081205.221. (CC) gcc options: -O3

Phoronix Test Suite v10.8.4