Amazon Linux Cloud Benchmarks May 2015

AWS vs OpenStack

HTML result view exported from: https://openbenchmarking.org/result/1509224-BE-1505053BE14&grw&export=pdf&sro&rro.

Amazon Linux Cloud Benchmarks May 2015ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemSystem LayerScreen ResolutionAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.1Intel Xeon E5-2666 v3 @ 2.89GHz (16 Cores)Xen HVM domUIntel 440FX- 82441FX PMC30720MB8GBCirrus Logic GD 5446Intel 82599 Virtual FunctionAmazon Linux AMI 2015.033.14.35-28.38.amzn1.x86_64 (x86_64)GCC 4.8.2 20140120ext4Xen HVM domU 4.2.amazonIntel Xeon E5-2666 v3 @ 2.90GHz (16 Cores)10GBRed Hat Enterprise Linux Server 7.13.10.0-229.el7.x86_64 (x86_64)GCC 4.8.3 20140911xfsIntel 440FX- 82441FX PMC16384 MB + 14336 MB RAMCirrus Logic GD 5446SUSE Linux Enterprise Server 123.12.28-4-default (x86_64)GCC 4.8.3ext41024x768Intel Xeon E5-2666 v3 @ 2.89GHz (16 Cores)30720MB8GBIntel 82599 Virtual FunctionUbuntu 14.043.13.0-48-generic (x86_64)GCC 4.8.216384 MB + 14336 MB RAMDebian 8.03.16.0-4-amd64 (x86_64)GCC 4.9.2800x60016 x Intel Core i7 9xx (Nehalem Class Core i7) @ 2.60GHz (16 Cores)OpenStack Foundation Nova v2015.1.12 x 16384 MB RAM QEMU99GBDebian 8.2ext3KVMOpenBenchmarking.orgCompiler Details- Amazon Linux AMI 2015.03: --build=x86_64-amazon-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,ada,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic --without-cloog --without-isl - Red Hat Enterprise Linux 7.1: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - SUSE Linux Enterprise Server 12: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --disable-plugin --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --host=x86_64-suse-linux --mandir=/usr/share/man --with-arch-32=i586 --with-slibdir=/lib64 --with-tune=generic --without-system-libunwind - Ubuntu 14.04.2 LTS: --build=x86_64-linux-gnu --disable-browser-plugin --disable-libmudflap --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Debian 8.0 Jessie: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Debian Wheezy OpenStack-2015.1.1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Amazon Linux AMI 2015.03: NOOP / data=ordered,noatime,rw- Red Hat Enterprise Linux 7.1: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel- SUSE Linux Enterprise Server 12: CFQ / data=ordered,relatime,rw- Ubuntu 14.04.2 LTS: DEADLINE / data=ordered,discard,relatime,rw- Debian 8.0 Jessie: CFQ / data=ordered,relatime,rwSystem Details- Amazon Linux AMI 2015.03: Disk Scheduler: NOOP.- Red Hat Enterprise Linux 7.1: Disk Scheduler: DEADLINE. SELinux: Enabled.- SUSE Linux Enterprise Server 12: Disk Scheduler: CFQ.- Ubuntu 14.04.2 LTS: Disk Scheduler: DEADLINE.- Debian 8.0 Jessie: Disk Scheduler: CFQ.Disk Mount Options Details- Debian Wheezy OpenStack-2015.1.1: data=ordered,errors=remount-ro,relatime,rw

Amazon Linux Cloud Benchmarks May 2015encode-flac: WAV To FLACencode-mp3: WAV To MP3gcrypt: CAMELLIA256-ECB Cipherhmmer: Pfam Database Searchhimeno: Poisson Pressure Solverpostmark: Disk Transaction Performanceprimesieve: 1e12 Prime Number Generationstockfish: Total Timejohn-the-ripper: Blowfishjohn-the-ripper: Traditional DESjohn-the-ripper: MD5build-linux-kernel: Time To Compilex264: H.264 Video Encodingc-ray: Total Timeffmpeg: H.264 HD To NTSC DVapache: Static Web Page Servingopenssl: RSA 4096-bit PerformanceAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.18.4814.9022507.861546.44438545.853936113701772000014461257.22297.7613.3112.2329575.161053.738.5215.768.02446446.11112701751066714360460.0213.451056.538.4514.8422577.811553.41465845.633795114281780466714552658.73296.8313.2512.3222832.391070.408.4714.9022977.851555.68460146.033803114431773366714470862.97291.5913.3012.2331409.231053.407.2613.7919737.721731.48503445.923887111861774266714432465.39294.4713.2612.1535129.311053.507.8912.8419509.931742.46240833.33408285101428100012505255.47196.849.8227.6621876.541493.77OpenBenchmarking.org

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.1WAV To FLACUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.03246810SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 58.478.458.527.897.268.481. (CXX) g++ options: -O2 -fvisibility=hidden -lm

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.99.3WAV To MP3Ubuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.0348121620SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.05, N = 5SE +/- 0.05, N = 5SE +/- 0.05, N = 5SE +/- 0.00, N = 514.9014.8415.7612.8413.7914.901. (CC) gcc options: -O3 -fomit-frame-pointer -ffast-math -pipe -lm

Gcrypt Library

CAMELLIA256-ECB Cipher

OpenBenchmarking.orgMicroseconds, Fewer Is BetterGcrypt Library 1.4.4CAMELLIA256-ECB CipherUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.035001000150020002500SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 30.55, N = 3SE +/- 12.02, N = 3SE +/- 0.00, N = 3229722571950197322501. (CC) gcc options: -O2 -fvisibility=hidden

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.033691215SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 37.857.818.029.937.727.861. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.03400800120016002000SE +/- 0.50, N = 3SE +/- 1.19, N = 3SE +/- 5.38, N = 3SE +/- 0.35, N = 3SE +/- 0.36, N = 31555.681553.411742.461731.481546.441. (CC) gcc options: -O3

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.0311002200330044005500SE +/- 28.00, N = 3SE +/- 29.00, N = 3SE +/- 0.00, N = 3SE +/- 64.03, N = 6SE +/- 34.00, N = 3SE +/- 0.00, N = 34601465844642408503443851. (CC) gcc options: -O3

Primesieve

1e12 Prime Number Generation

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 5.4.21e12 Prime Number GenerationUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.031020304050SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 346.0345.6346.1133.3345.9245.851. (CXX) g++ options: -O2 -fopenmp

Stockfish

Total Time

OpenBenchmarking.orgms, Fewer Is BetterStockfish 2014-11-26Total TimeUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.039001800270036004500SE +/- 3.33, N = 3SE +/- 4.84, N = 3SE +/- 57.57, N = 3SE +/- 19.43, N = 3SE +/- 25.98, N = 3380337954082388739361. (CXX) g++ options: -lpthread -fno-exceptions -fno-rtti -ansi -pedantic -O3 -msse -msse3 -mpopcnt -flto

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: BlowfishUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.032K4K6K8K10KSE +/- 10.97, N = 3SE +/- 7.67, N = 3SE +/- 0.00, N = 3SE +/- 132.15, N = 5SE +/- 7.33, N = 3SE +/- 7.67, N = 3114431142811270851011186113701. (CC) gcc options: -fopenmp -lcrypt

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: Traditional DESUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.034M8M12M16M20MSE +/- 13333.33, N = 3SE +/- 20333.33, N = 3SE +/- 39333.33, N = 3SE +/- 208309.87, N = 3SE +/- 4333.33, N = 3SE +/- 0.00, N = 31773366717804667175106671428100017742667177200001. (CC) gcc options: -fopenmp -lcrypt

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: MD5Ubuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.0330K60K90K120K150KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1992.32, N = 6SE +/- 95.67, N = 3SE +/- 96.00, N = 31447081455261436041250521443241446121. (CC) gcc options: -fopenmp -lcrypt

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 3.18-rc6Time To CompileUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.031530456075SE +/- 0.63, N = 3SE +/- 2.21, N = 6SE +/- 1.81, N = 6SE +/- 0.87, N = 5SE +/- 1.49, N = 6SE +/- 0.70, N = 362.9758.7360.0255.4765.3957.22

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2014-08-30H.264 Video EncodingUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.0360120180240300SE +/- 0.75, N = 5SE +/- 0.74, N = 5SE +/- 2.46, N = 5SE +/- 0.90, N = 5SE +/- 0.56, N = 5291.59296.83196.84294.47297.761. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fomit-frame-pointer -fno-tree-vectorize

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.033691215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 313.3013.2513.459.8213.2613.311. (CC) gcc options: -lm -lpthread -O3

FFmpeg

H.264 HD To NTSC DV

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 2.6.2H.264 HD To NTSC DVUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.03714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 312.2312.3227.6612.1512.231. (CC) gcc options: -lavdevice -lavfilter -lavformat -lavcodec -lswresample -lswscale -lavutil -lm -pthread -std=c99 -fomit-frame-pointer -O3 -fno-math-errno -fno-signed-zeros -fno-tree-vectorize -MMD -MF -MT

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.038K16K24K32K40KSE +/- 391.77, N = 3SE +/- 383.86, N = 4SE +/- 132.57, N = 3SE +/- 165.52, N = 3SE +/- 80.38, N = 331409.2322832.3921876.5435129.3129575.161. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1gRSA 4096-bit PerformanceUbuntu 14.04.2 LTSSUSE Linux Enterprise Server 12Red Hat Enterprise Linux 7.1Debian Wheezy OpenStack-2015.1.1Debian 8.0 JessieAmazon Linux AMI 2015.0330060090012001500SE +/- 0.25, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 10.36, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 31053.401070.401056.531493.771053.501053.731. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

Phoronix Test Suite v10.8.5