Amazon EC2 Cloud Linux OS Benchmarks

Testing for a future article on Phoronix.com. Amazon m3.xlarge EC2 Cloud benchmarks comparing various enterprise Linux operating systems in Amazon's Compute Cloud like Red Hat Enterprise Linux, SUSE Enterprise Server, Ubuntu Linux, and Amazon Linux AMI. Cloud benchmarks by Michael Larabel of Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1311083-SO-AMAZONCLO17&sor.

Amazon EC2 Cloud Linux OS BenchmarksProcessorMemoryDiskOSKernelCompilerFile-SystemSystem LayerRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSUbuntu 13.10SUSE Linux Enterprise 11Intel Xeon E5-2670 0 @ 2.59GHz (4 Cores)15360MB6GBRedHatEnterpriseServer 6.42.6.32-358.14.1.el6.x86_64 (x86_64)GCC 4.4.7 20120313ext4Xen 3.4.3.amazon Hypervisor8GBAmazon Linux AMI 2013.093.4.62-53.42.amzn1.x86_64 (x86_64)GCC 4.6.3 20120306Ubuntu 12.043.2.0-54-virtual (x86_64)GCC 4.6Intel Xeon E5-2670 0 @ 2.60GHz (4 Cores)Ubuntu 13.103.11.0-12-generic (x86_64)GCC 4.816384MB10GBSUSE Linux Enterprise Server 113.0.82-0.7-ec2 (x86_64)GCC 4.3ext3OpenBenchmarking.orgCompiler Details- Red Hat Enterprise Linux 6.4: --build=x86_64-redhat-linux --disable-dssi --disable-libjava-multilib --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-java-awt=gtk --enable-java-maintainer-mode --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-libgcj-multifile --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-cloog --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --with-ppl --with-tune=generic - Amazon Linux AMI 2013.09: --build=x86_64-amazon-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-unique-object --enable-languages=c,c++,objc,obj-c++,,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-tune=generic - Ubuntu 12.04.3 LTS: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v - Ubuntu 13.10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - SUSE Linux Enterprise 11: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --mandir=/usr/share/man --with-cpu=generic --with-slibdir=/lib64 --without-system-libunwind System Details- Red Hat Enterprise Linux 6.4: SELinux: Enabled.Disk Mount Options Details- Red Hat Enterprise Linux 6.4: barrier=1,data=ordered,relatime,rw,seclabel- Amazon Linux AMI 2013.09: data=ordered,noatime,rw- Ubuntu 12.04.3 LTS: acl,barrier=1,data=ordered,relatime,rw,user_xattr- Ubuntu 13.10: data=ordered,relatime,rw- SUSE Linux Enterprise 11: acl,barrier=1,data=ordered,errors=continue,relatime,rw,user_xattr

Amazon EC2 Cloud Linux OS Benchmarkspostmark: Disk Transaction Performancerodinia: OpenMP Leukocyterodinia: OpenMP CFD Solverrodinia: OpenMP Streamclusterdolfyn: Computational Fluid Dynamicspolybench-c: Covariance Computationpolybench-c: Correlation Computationpolybench-c: 3 Matrix Multiplicationsffte: N=64, 1D Complex FFT Routinehmmer: Pfam Database Searchmafft: Multiple Sequence Alignmentjohn-the-ripper: Blowfishjohn-the-ripper: Traditional DESjohn-the-ripper: MD5himeno: Poisson Pressure Solverbuild-linux-kernel: Time To Compilec-ray: Total Timecompress-pbzip2: 256MB File CompressionRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSUbuntu 13.10SUSE Linux Enterprise 111685103.46224.4456.8536.666.716.7225.664355.7727.6013.1019077279333243921214.54238.34131.6119.932055100.77247.4655.7433.506.686.7225.683986.6029.2412.4319757940333268601199.42210.61129.5619.142011101.53228.4156.2133.306.706.7125.704054.0026.0312.2920037946000266841172.08240.40129.0218.901963103.01225.9155.5933.176.616.6425.764220.0425.8712.4819963363667285841205.22259.8577.1618.5777988.75227.3154.146.396.3924.714043.5425.4612.2819727951333185331189.83118.5418.55OpenBenchmarking.org

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceAmazon Linux AMI 2013.09Ubuntu 12.04.3 LTSUbuntu 13.10Red Hat Enterprise Linux 6.4SUSE Linux Enterprise 11400800120016002000SE +/- 5.67, N = 3SE +/- 5.33, N = 3SE +/- 5.00, N = 3SE +/- 4.00, N = 3SE +/- 15.11, N = 620552011196316857791. (CC) gcc options: -O3

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP LeukocyteSUSE Linux Enterprise 11Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSUbuntu 13.10Red Hat Enterprise Linux 6.420406080100SE +/- 1.27, N = 3SE +/- 1.32, N = 3SE +/- 1.43, N = 3SE +/- 1.56, N = 3SE +/- 1.02, N = 388.75100.77101.53103.01103.46-O3 -fopenmp-O3 -fopenmp-O2 -lOpenCL-O2 -lOpenCL-O3 -fopenmp1. (CXX) g++ options:

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP CFD SolverRed Hat Enterprise Linux 6.4Ubuntu 13.10SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSAmazon Linux AMI 2013.0950100150200250SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.93, N = 3224.44225.91227.31228.41247.46-O3 -fopenmp-O2 -lOpenCL-O3 -fopenmp-O2 -lOpenCL-O3 -fopenmp1. (CXX) g++ options:

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP StreamclusterSUSE Linux Enterprise 11Ubuntu 13.10Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSRed Hat Enterprise Linux 6.41326395265SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 354.1455.5955.7456.2156.85-O3 -fopenmp-O2 -lOpenCL-O3 -fopenmp-O2 -lOpenCL-O3 -fopenmp1. (CXX) g++ options:

Dolfyn

Computational Fluid Dynamics

OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid DynamicsUbuntu 13.10Ubuntu 12.04.3 LTSAmazon Linux AMI 2013.09Red Hat Enterprise Linux 6.4816243240SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 333.1733.3033.5036.66

PolyBench-C

Test: Covariance Computation

OpenBenchmarking.orgSeconds, Fewer Is BetterPolyBench-C 3.2Test: Covariance ComputationSUSE Linux Enterprise 11Ubuntu 13.10Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSRed Hat Enterprise Linux 6.4246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.396.616.686.706.711. (CC) gcc options: -O3

PolyBench-C

Test: Correlation Computation

OpenBenchmarking.orgSeconds, Fewer Is BetterPolyBench-C 3.2Test: Correlation ComputationSUSE Linux Enterprise 11Ubuntu 13.10Ubuntu 12.04.3 LTSRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 36.396.646.716.726.721. (CC) gcc options: -O3

PolyBench-C

Test: 3 Matrix Multiplications

OpenBenchmarking.orgSeconds, Fewer Is BetterPolyBench-C 3.2Test: 3 Matrix MultiplicationsSUSE Linux Enterprise 11Red Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSUbuntu 13.10612182430SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 324.7125.6625.6825.7025.761. (CC) gcc options: -O3

FFTE

Test: N=64, 1D Complex FFT Routine

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 5.0Test: N=64, 1D Complex FFT RoutineRed Hat Enterprise Linux 6.4Ubuntu 13.10Ubuntu 12.04.3 LTSSUSE Linux Enterprise 11Amazon Linux AMI 2013.099001800270036004500SE +/- 14.72, N = 3SE +/- 2.47, N = 3SE +/- 3.59, N = 3SE +/- 71.29, N = 6SE +/- 51.13, N = 34355.774220.044054.004043.543986.60-m64 -O2 -fPIC -lmpichf90 -lmpich -lopa -lpthread -lrt-lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread-lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread1. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchSUSE Linux Enterprise 11Ubuntu 13.10Ubuntu 12.04.3 LTSRed Hat Enterprise Linux 6.4Amazon Linux AMI 2013.09714212835SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 325.4625.8726.0327.6029.241. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

Timed MAFFT Alignment

Multiple Sequence Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.864Multiple Sequence AlignmentSUSE Linux Enterprise 11Ubuntu 12.04.3 LTSAmazon Linux AMI 2013.09Ubuntu 13.10Red Hat Enterprise Linux 6.43691215SE +/- 0.20, N = 6SE +/- 0.21, N = 6SE +/- 0.22, N = 6SE +/- 0.30, N = 6SE +/- 0.01, N = 312.2812.2912.4312.4813.101. (CC) gcc options: -O3 -lm -lpthread

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Test: BlowfishUbuntu 12.04.3 LTSUbuntu 13.10Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Red Hat Enterprise Linux 6.4400800120016002000SE +/- 6.67, N = 3SE +/- 0.00, N = 3SE +/- 33.08, N = 6SE +/- 0.00, N = 3SE +/- 6.67, N = 3200319961975197219071. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Test: Traditional DESSUSE Linux Enterprise 11Ubuntu 12.04.3 LTSAmazon Linux AMI 2013.09Red Hat Enterprise Linux 6.4Ubuntu 13.102M4M6M8M10MSE +/- 35964.49, N = 3SE +/- 0.00, N = 3SE +/- 21666.67, N = 3SE +/- 63024.69, N = 3SE +/- 11333.33, N = 3795133379460007940333727933333636671. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Test: MD5Ubuntu 13.10Amazon Linux AMI 2013.09Ubuntu 12.04.3 LTSRed Hat Enterprise Linux 6.4SUSE Linux Enterprise 116K12K18K24K30KSE +/- 60.40, N = 3SE +/- 140.68, N = 3SE +/- 8.00, N = 3SE +/- 60.53, N = 3SE +/- 24.69, N = 328584268602668424392185331. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverRed Hat Enterprise Linux 6.4Ubuntu 13.10Amazon Linux AMI 2013.09SUSE Linux Enterprise 11Ubuntu 12.04.3 LTS30060090012001500SE +/- 1.14, N = 3SE +/- 4.15, N = 3SE +/- 1.47, N = 3SE +/- 0.95, N = 3SE +/- 2.31, N = 31214.541205.221199.421189.831172.081. (CC) gcc options: -O3

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 3.1Time To CompileAmazon Linux AMI 2013.09Red Hat Enterprise Linux 6.4Ubuntu 12.04.3 LTSUbuntu 13.1060120180240300SE +/- 0.96, N = 3SE +/- 0.83, N = 3SE +/- 2.50, N = 3SE +/- 2.61, N = 3210.61238.34240.40259.85

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeUbuntu 13.10SUSE Linux Enterprise 11Ubuntu 12.04.3 LTSAmazon Linux AMI 2013.09Red Hat Enterprise Linux 6.4306090120150SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 377.16118.54129.02129.56131.611. (CC) gcc options: -lm -lpthread -O3

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.6256MB File CompressionSUSE Linux Enterprise 11Ubuntu 13.10Ubuntu 12.04.3 LTSAmazon Linux AMI 2013.09Red Hat Enterprise Linux 6.4510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.34, N = 318.5518.5718.9019.1419.931. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

Phoronix Test Suite v10.8.4