Amazon Linux Cloud Benchmarks May 2015

AWS vs OpenStack

HTML result view exported from: https://openbenchmarking.org/result/1509224-BE-1505053BE14&grw&export=pdf&rdt&rro.

Amazon Linux Cloud Benchmarks May 2015ProcessorMotherboardMemoryDiskChipsetGraphicsNetworkOSKernelCompilerFile-SystemSystem LayerScreen ResolutionRed Hat Enterprise Linux 7.1Amazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.1Intel Xeon E5-2666 v3 @ 2.90GHz (16 Cores)Xen HVM domU30720MB10GBRed Hat Enterprise Linux Server 7.13.10.0-229.el7.x86_64 (x86_64)GCC 4.8.3 20140911xfsXen HVM domU 4.2.amazonIntel Xeon E5-2666 v3 @ 2.89GHz (16 Cores)Intel 440FX- 82441FX PMC8GBCirrus Logic GD 5446Intel 82599 Virtual FunctionAmazon Linux AMI 2015.033.14.35-28.38.amzn1.x86_64 (x86_64)GCC 4.8.2 20140120ext4Intel Xeon E5-2666 v3 @ 2.90GHz (16 Cores)16384 MB + 14336 MB RAM10GBSUSE Linux Enterprise Server 123.12.28-4-default (x86_64)GCC 4.8.31024x768Intel Xeon E5-2666 v3 @ 2.89GHz (16 Cores)30720MB8GBIntel 82599 Virtual FunctionUbuntu 14.043.13.0-48-generic (x86_64)GCC 4.8.216384 MB + 14336 MB RAMDebian 8.03.16.0-4-amd64 (x86_64)GCC 4.9.2800x60016 x Intel Core i7 9xx (Nehalem Class Core i7) @ 2.60GHz (16 Cores)OpenStack Foundation Nova v2015.1.12 x 16384 MB RAM QEMU99GBDebian 8.2ext3KVMOpenBenchmarking.orgCompiler Details- Red Hat Enterprise Linux 7.1: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - Amazon Linux AMI 2015.03: --build=x86_64-amazon-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,ada,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic --without-cloog --without-isl - SUSE Linux Enterprise Server 12: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --disable-plugin --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --host=x86_64-suse-linux --mandir=/usr/share/man --with-arch-32=i586 --with-slibdir=/lib64 --with-tune=generic --without-system-libunwind - Ubuntu 14.04.2 LTS: --build=x86_64-linux-gnu --disable-browser-plugin --disable-libmudflap --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Debian 8.0 Jessie: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Debian Wheezy OpenStack-2015.1.1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Red Hat Enterprise Linux 7.1: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel- Amazon Linux AMI 2015.03: NOOP / data=ordered,noatime,rw- SUSE Linux Enterprise Server 12: CFQ / data=ordered,relatime,rw- Ubuntu 14.04.2 LTS: DEADLINE / data=ordered,discard,relatime,rw- Debian 8.0 Jessie: CFQ / data=ordered,relatime,rwSystem Details- Red Hat Enterprise Linux 7.1: Disk Scheduler: DEADLINE. SELinux: Enabled.- Amazon Linux AMI 2015.03: Disk Scheduler: NOOP.- SUSE Linux Enterprise Server 12: Disk Scheduler: CFQ.- Ubuntu 14.04.2 LTS: Disk Scheduler: DEADLINE.- Debian 8.0 Jessie: Disk Scheduler: CFQ.Disk Mount Options Details- Debian Wheezy OpenStack-2015.1.1: data=ordered,errors=remount-ro,relatime,rw

Amazon Linux Cloud Benchmarks May 2015encode-flac: WAV To FLACencode-mp3: WAV To MP3gcrypt: CAMELLIA256-ECB Cipherhmmer: Pfam Database Searchhimeno: Poisson Pressure Solverpostmark: Disk Transaction Performanceprimesieve: 1e12 Prime Number Generationstockfish: Total Timejohn-the-ripper: Blowfishjohn-the-ripper: Traditional DESjohn-the-ripper: MD5build-linux-kernel: Time To Compilex264: H.264 Video Encodingc-ray: Total Timeffmpeg: H.264 HD To NTSC DVapache: Static Web Page Servingopenssl: RSA 4096-bit PerformanceRed Hat Enterprise Linux 7.1Amazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.18.5215.768.02446446.11112701751066714360460.0213.451056.538.4814.9022507.861546.44438545.853936113701772000014461257.22297.7613.3112.2329575.161053.738.4514.8422577.811553.41465845.633795114281780466714552658.73296.8313.2512.3222832.391070.408.4714.9022977.851555.68460146.033803114431773366714470862.97291.5913.3012.2331409.231053.407.2613.7919737.721731.48503445.923887111861774266714432465.39294.4713.2612.1535129.311053.507.8912.8419509.931742.46240833.33408285101428100012505255.47196.849.8227.6621876.541493.77OpenBenchmarking.org

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.1WAV To FLACDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1246810SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 57.897.268.478.458.488.521. (CXX) g++ options: -O2 -fvisibility=hidden -lm

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.99.3WAV To MP3Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.148121620SE +/- 0.05, N = 5SE +/- 0.05, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.05, N = 512.8413.7914.9014.8414.9015.761. (CC) gcc options: -O3 -fomit-frame-pointer -ffast-math -pipe -lm

Gcrypt Library

CAMELLIA256-ECB Cipher

OpenBenchmarking.orgMicroseconds, Fewer Is BetterGcrypt Library 1.4.4CAMELLIA256-ECB CipherDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.035001000150020002500SE +/- 30.55, N = 3SE +/- 12.02, N = 3SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 0.00, N = 3195019732297225722501. (CC) gcc options: -O2 -fvisibility=hidden

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.13691215SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 39.937.727.857.817.868.021. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03400800120016002000SE +/- 5.38, N = 3SE +/- 0.35, N = 3SE +/- 0.50, N = 3SE +/- 1.19, N = 3SE +/- 0.36, N = 31742.461731.481555.681553.411546.441. (CC) gcc options: -O3

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.111002200330044005500SE +/- 64.03, N = 6SE +/- 34.00, N = 3SE +/- 28.00, N = 3SE +/- 29.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32408503446014658438544641. (CC) gcc options: -O3

Primesieve

1e12 Prime Number Generation

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 5.4.21e12 Prime Number GenerationDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.11020304050SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 333.3345.9246.0345.6345.8546.111. (CXX) g++ options: -O2 -fopenmp

Stockfish

Total Time

OpenBenchmarking.orgms, Fewer Is BetterStockfish 2014-11-26Total TimeDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.039001800270036004500SE +/- 57.57, N = 3SE +/- 19.43, N = 3SE +/- 3.33, N = 3SE +/- 4.84, N = 3SE +/- 25.98, N = 3408238873803379539361. (CXX) g++ options: -lpthread -fno-exceptions -fno-rtti -ansi -pedantic -O3 -msse -msse3 -mpopcnt -flto

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: BlowfishDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.12K4K6K8K10KSE +/- 132.15, N = 5SE +/- 7.33, N = 3SE +/- 10.97, N = 3SE +/- 7.67, N = 3SE +/- 7.67, N = 3SE +/- 0.00, N = 3851011186114431142811370112701. (CC) gcc options: -fopenmp -lcrypt

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: Traditional DESDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.14M8M12M16M20MSE +/- 208309.87, N = 3SE +/- 4333.33, N = 3SE +/- 13333.33, N = 3SE +/- 20333.33, N = 3SE +/- 0.00, N = 3SE +/- 39333.33, N = 31428100017742667177336671780466717720000175106671. (CC) gcc options: -fopenmp -lcrypt

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: MD5Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.130K60K90K120K150KSE +/- 1992.32, N = 6SE +/- 95.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 96.00, N = 3SE +/- 0.00, N = 31250521443241447081455261446121436041. (CC) gcc options: -fopenmp -lcrypt

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 3.18-rc6Time To CompileDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.11530456075SE +/- 0.87, N = 5SE +/- 1.49, N = 6SE +/- 0.63, N = 3SE +/- 2.21, N = 6SE +/- 0.70, N = 3SE +/- 1.81, N = 655.4765.3962.9758.7357.2260.02

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2014-08-30H.264 Video EncodingDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.0360120180240300SE +/- 2.46, N = 5SE +/- 0.90, N = 5SE +/- 0.75, N = 5SE +/- 0.74, N = 5SE +/- 0.56, N = 5196.84294.47291.59296.83297.761. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fomit-frame-pointer -fno-tree-vectorize

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.13691215SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.8213.2613.3013.2513.3113.451. (CC) gcc options: -lm -lpthread -O3

FFmpeg

H.264 HD To NTSC DV

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 2.6.2H.264 HD To NTSC DVDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03714212835SE +/- 0.27, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 327.6612.1512.2312.3212.231. (CC) gcc options: -lavdevice -lavfilter -lavformat -lavcodec -lswresample -lswscale -lavutil -lm -pthread -std=c99 -fomit-frame-pointer -O3 -fno-math-errno -fno-signed-zeros -fno-tree-vectorize -MMD -MF -MT

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.038K16K24K32K40KSE +/- 132.57, N = 3SE +/- 165.52, N = 3SE +/- 391.77, N = 3SE +/- 383.86, N = 4SE +/- 80.38, N = 321876.5435129.3131409.2322832.3929575.161. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1gRSA 4096-bit PerformanceDebian Wheezy OpenStack-2015.1.1Debian 8.0 JessieUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.130060090012001500SE +/- 10.36, N = 3SE +/- 0.21, N = 3SE +/- 0.25, N = 3SE +/- 0.30, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 31493.771053.501053.401070.401053.731056.531. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

Phoronix Test Suite v10.8.5