Amazon Linux Cloud Benchmarks May 2015

AWS vs OpenStack

HTML result view exported from: https://openbenchmarking.org/result/1509224-BE-1505053BE14.

Amazon Linux Cloud Benchmarks May 2015ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemSystem LayerScreen ResolutionAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.1Intel Xeon E5-2666 v3 @ 2.89GHz (16 Cores)Xen HVM domUIntel 440FX- 82441FX PMC30720MB8GBCirrus Logic GD 5446Intel 82599 Virtual FunctionAmazon Linux AMI 2015.033.14.35-28.38.amzn1.x86_64 (x86_64)GCC 4.8.2 20140120ext4Xen HVM domU 4.2.amazonIntel Xeon E5-2666 v3 @ 2.90GHz (16 Cores)10GBRed Hat Enterprise Linux Server 7.13.10.0-229.el7.x86_64 (x86_64)GCC 4.8.3 20140911xfsIntel 440FX- 82441FX PMC16384 MB + 14336 MB RAMCirrus Logic GD 5446SUSE Linux Enterprise Server 123.12.28-4-default (x86_64)GCC 4.8.3ext41024x768Intel Xeon E5-2666 v3 @ 2.89GHz (16 Cores)30720MB8GBIntel 82599 Virtual FunctionUbuntu 14.043.13.0-48-generic (x86_64)GCC 4.8.216384 MB + 14336 MB RAMDebian 8.03.16.0-4-amd64 (x86_64)GCC 4.9.2800x60016 x Intel Core i7 9xx (Nehalem Class Core i7) @ 2.60GHz (16 Cores)OpenStack Foundation Nova v2015.1.12 x 16384 MB RAM QEMU99GBDebian 8.2ext3KVMOpenBenchmarking.orgCompiler Details- Amazon Linux AMI 2015.03: --build=x86_64-amazon-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,ada,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic --without-cloog --without-isl - Red Hat Enterprise Linux 7.1: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - SUSE Linux Enterprise Server 12: --build=x86_64-suse-linux --disable-libgcj --disable-libmudflap --disable-libssp --disable-libstdcxx-pch --disable-plugin --enable-__cxa_atexit --enable-checking=release --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-libstdcxx-allocator=new --enable-linux-futex --enable-ssp --enable-version-specific-runtime-libs --host=x86_64-suse-linux --mandir=/usr/share/man --with-arch-32=i586 --with-slibdir=/lib64 --with-tune=generic --without-system-libunwind - Ubuntu 14.04.2 LTS: --build=x86_64-linux-gnu --disable-browser-plugin --disable-libmudflap --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Debian 8.0 Jessie: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Debian Wheezy OpenStack-2015.1.1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Amazon Linux AMI 2015.03: NOOP / data=ordered,noatime,rw- Red Hat Enterprise Linux 7.1: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel- SUSE Linux Enterprise Server 12: CFQ / data=ordered,relatime,rw- Ubuntu 14.04.2 LTS: DEADLINE / data=ordered,discard,relatime,rw- Debian 8.0 Jessie: CFQ / data=ordered,relatime,rwSystem Details- Amazon Linux AMI 2015.03: Disk Scheduler: NOOP.- Red Hat Enterprise Linux 7.1: Disk Scheduler: DEADLINE. SELinux: Enabled.- SUSE Linux Enterprise Server 12: Disk Scheduler: CFQ.- Ubuntu 14.04.2 LTS: Disk Scheduler: DEADLINE.- Debian 8.0 Jessie: Disk Scheduler: CFQ.Disk Mount Options Details- Debian Wheezy OpenStack-2015.1.1: data=ordered,errors=remount-ro,relatime,rw

Amazon Linux Cloud Benchmarks May 2015postmark: Disk Transaction Performancehmmer: Pfam Database Searchgcrypt: CAMELLIA256-ECB Cipherjohn-the-ripper: Blowfishjohn-the-ripper: Traditional DESjohn-the-ripper: MD5x264: H.264 Video Encodinghimeno: Poisson Pressure Solverbuild-linux-kernel: Time To Compilec-ray: Total Timeprimesieve: 1e12 Prime Number Generationstockfish: Total Timeencode-flac: WAV To FLACencode-mp3: WAV To MP3ffmpeg: H.264 HD To NTSC DVopenssl: RSA 4096-bit Performanceapache: Static Web Page ServingAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.143857.8622501137017720000144612297.761546.4457.2213.3145.8539368.4814.9012.231053.7329575.1644648.02112701751066714360460.0213.4546.118.5215.761056.5346587.8122571142817804667145526296.831553.4158.7313.2545.6337958.4514.8412.321070.4022832.3946017.8522971144317733667144708291.591555.6862.9713.3046.0338038.4714.9012.231053.4031409.2350347.7219731118617742667144324294.471731.4865.3913.2645.9238877.2613.7912.151053.5035129.3124089.931950851014281000125052196.841742.4655.479.8233.3340827.8912.8427.661493.7721876.54OpenBenchmarking.org

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.111002200330044005500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 29.00, N = 3SE +/- 28.00, N = 3SE +/- 34.00, N = 3SE +/- 64.03, N = 64385446446584601503424081. (CC) gcc options: -O3

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.13691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 37.868.027.817.857.729.931. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

Gcrypt Library

CAMELLIA256-ECB Cipher

OpenBenchmarking.orgMicroseconds, Fewer Is BetterGcrypt Library 1.4.4CAMELLIA256-ECB CipherAmazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.15001000150020002500SE +/- 0.00, N = 3SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 12.02, N = 3SE +/- 30.55, N = 3225022572297197319501. (CC) gcc options: -O2 -fvisibility=hidden

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: BlowfishAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.12K4K6K8K10KSE +/- 7.67, N = 3SE +/- 0.00, N = 3SE +/- 7.67, N = 3SE +/- 10.97, N = 3SE +/- 7.33, N = 3SE +/- 132.15, N = 5113701127011428114431118685101. (CC) gcc options: -fopenmp -lcrypt

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: Traditional DESAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.14M8M12M16M20MSE +/- 0.00, N = 3SE +/- 39333.33, N = 3SE +/- 20333.33, N = 3SE +/- 13333.33, N = 3SE +/- 4333.33, N = 3SE +/- 208309.87, N = 31772000017510667178046671773366717742667142810001. (CC) gcc options: -fopenmp -lcrypt

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: MD5Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.130K60K90K120K150KSE +/- 96.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 95.67, N = 3SE +/- 1992.32, N = 61446121436041455261447081443241250521. (CC) gcc options: -fopenmp -lcrypt

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2014-08-30H.264 Video EncodingAmazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.160120180240300SE +/- 0.56, N = 5SE +/- 0.74, N = 5SE +/- 0.75, N = 5SE +/- 0.90, N = 5SE +/- 2.46, N = 5297.76296.83291.59294.47196.841. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fomit-frame-pointer -fno-tree-vectorize

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverAmazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.1400800120016002000SE +/- 0.36, N = 3SE +/- 1.19, N = 3SE +/- 0.50, N = 3SE +/- 0.35, N = 3SE +/- 5.38, N = 31546.441553.411555.681731.481742.461. (CC) gcc options: -O3

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 3.18-rc6Time To CompileAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.11530456075SE +/- 0.70, N = 3SE +/- 1.81, N = 6SE +/- 2.21, N = 6SE +/- 0.63, N = 3SE +/- 1.49, N = 6SE +/- 0.87, N = 557.2260.0258.7362.9765.3955.47

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.13691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 313.3113.4513.2513.3013.269.821. (CC) gcc options: -lm -lpthread -O3

Primesieve

1e12 Prime Number Generation

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 5.4.21e12 Prime Number GenerationAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.11020304050SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 345.8546.1145.6346.0345.9233.331. (CXX) g++ options: -O2 -fopenmp

Stockfish

Total Time

OpenBenchmarking.orgms, Fewer Is BetterStockfish 2014-11-26Total TimeAmazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.19001800270036004500SE +/- 25.98, N = 3SE +/- 4.84, N = 3SE +/- 3.33, N = 3SE +/- 19.43, N = 3SE +/- 57.57, N = 3393637953803388740821. (CXX) g++ options: -lpthread -fno-exceptions -fno-rtti -ansi -pedantic -O3 -msse -msse3 -mpopcnt -flto

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.1WAV To FLACAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.1246810SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 58.488.528.458.477.267.891. (CXX) g++ options: -O2 -fvisibility=hidden -lm

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.99.3WAV To MP3Amazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.148121620SE +/- 0.00, N = 5SE +/- 0.05, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.05, N = 5SE +/- 0.05, N = 514.9015.7614.8414.9013.7912.841. (CC) gcc options: -O3 -fomit-frame-pointer -ffast-math -pipe -lm

FFmpeg

H.264 HD To NTSC DV

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 2.6.2H.264 HD To NTSC DVAmazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.1714212835SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.27, N = 312.2312.3212.2312.1527.661. (CC) gcc options: -lavdevice -lavfilter -lavformat -lavcodec -lswresample -lswscale -lavutil -lm -pthread -std=c99 -fomit-frame-pointer -O3 -fno-math-errno -fno-signed-zeros -fno-tree-vectorize -MMD -MF -MT

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1gRSA 4096-bit PerformanceAmazon Linux AMI 2015.03Red Hat Enterprise Linux 7.1SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.130060090012001500SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3SE +/- 0.25, N = 3SE +/- 0.21, N = 3SE +/- 10.36, N = 31053.731056.531070.401053.401053.501493.771. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingAmazon Linux AMI 2015.03SUSE Linux Enterprise Server 12Ubuntu 14.04.2 LTSDebian 8.0 JessieDebian Wheezy OpenStack-2015.1.18K16K24K32K40KSE +/- 80.38, N = 3SE +/- 383.86, N = 4SE +/- 391.77, N = 3SE +/- 165.52, N = 3SE +/- 132.57, N = 329575.1622832.3931409.2335129.3121876.541. (CC) gcc options: -shared -fPIC -O2 -pthread

Phoronix Test Suite v10.8.4