VM Comparison

Virtualization Comparison

HTML result view exported from: https://openbenchmarking.org/result/1302208-RA-VMCOMPARI93&grt&rdt.

VM ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)2 x Intel Xeon E5440 @ 2.83GHz (8 Cores)Dell 0TT740Intel 5000X MCH16384MB1000GB PERC 6/iAMD ATI ES1000 128MBBroadcom NetXtreme II BCM5708 GigabitUbuntu 12.043.2.0-37-generic (x86_64)GCC 4.6ext41024x768128MBQEMU Virtual 1.0 @ 2.83GHz (8 Cores)BochsRed Hat Virtio14336MB45GBCirrus Logic GD 5446Red Hat Virtio device3.5.0-23-generic (x86_64)800x600QEMU 1.0Intel Core 2 Duo T7700 @ 2.83GHz (8 Cores)3.2.0-37-generic (x86_64)Intel Xeon E5440 @ 2.83GHz (8 Cores)60GBXen 4.1.2 HypervisorOpenBenchmarking.orgDisk Details- Baremetal (ondemand), Baremetal (Performance): CFQ / barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattrProcessor Details- Baremetal (ondemand): Scaling Governor: ondemand- Baremetal (Performance): Scaling Governor: performance- LXC (on Ubuntu 12.04 LTS): Scaling Governor: ondemandSystem Details- Baremetal (ondemand): Disk Scheduler: CFQ. Python 2.7.3.- Baremetal (Performance): Disk Scheduler: CFQ. Python 2.7.3.- LXC (on Ubuntu 12.04 LTS): Python 2.7.3.- KVM PV (on Ubuntu 12.04 LTS): Python 2.7.3.- KVM PV, cache=none (on Ubuntu 12.04 LTS): Python 2.7.3.- Xen PV (on Ubuntu 12.04 LTS): Python 2.7.3.Compiler Details- LXC (on Ubuntu 12.04 LTS), KVM PV (on Ubuntu 12.04 LTS), KVM PV, cache=none (on Ubuntu 12.04 LTS), Xen PV (on Ubuntu 12.04 LTS): --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v Disk Mount Options Details- LXC (on Ubuntu 12.04 LTS): barrier=1,data=ordered,relatime,rw,user_xattr- KVM PV (on Ubuntu 12.04 LTS): data=ordered,errors=remount-ro,relatime,rw- KVM PV, cache=none (on Ubuntu 12.04 LTS): barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr- Xen PV (on Ubuntu 12.04 LTS): barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr

VM Comparisonapache: Static Web Page Servingblogbench: Readc-ray: Raytracing, 1600x1200, 16 Threads, 8xAAcachebench: Read / Modify / Writecompilebench: Compilecyclictest: POSIX Timer, Interval 500 ms, 100000 Loopscyclictest: POSIX Timer, Interval 10000 ms, 10000 Loopscyclictest: clock_nanosleep TIME_ABSTIME, Interval 500 ms, 100000 Loopscyclictest: clock_nanosleep TIME_ABSTIME, Interval 10000 ms, 10000 Loopsffte: N=64, 1D Complex FFT Routineencode-flac: WAV To FLACfio: Intel IOMeter File Server Access Patternfs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncgnupg: 1GB File Encryptioncompress-gzip: 2GB File Compressionhdparm-read: /dev/sdaiozone: 1MB - 32GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 64kB - 32GB - Read Performanceiozone: 64kB - 8GB - Write Performancejohn-the-ripper: Blowfishencode-mp3: WAV To MP3mencoder: AVI To LAVCnginx: Static Web Page Servingopenssl: RSA 4096-bit Performancecompress-pbzip2: 256MB File Compressionphpbench: PHP Benchmark Suitepgbench: PostgreSQL TPC-B Transactions Per Secondpostmark: NetApp Disk Transaction Performancepybench: Python Benchmark Suiteramspeed: Triad - Integerramspeed: Triad - Floating Pointsqlite: Default Test Directorytiobench: Seq Read - 1.024 MB - 32 - 64 k Block Size - Total 32 GBtiobench: Rand Read - 128 MB - 32 - 4 k Block Size - Total 4 GBtiobench: Rand Write - 2 MB - 32 - 4 k Block Size - Total 64 MBtiobench: Rand Write - 64 MB - 16 - 4 k Block Size - Total 1 GBtiobench: Seq Write - 128 MB - 32 - 4 k Block Size - Total 4 GBbuild-linux-kernel: Time To Compilemrbayes: Primate Phylogeny Analysis (Bayes)Baremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)14486.2634494037.3314219.27353.40710683614.7810.302571.17134.38945.6712.2015.90128.83139.47128.03139.23128.53621923.3737.3114187.4861.706.69604262541.71239529565157.285317.7510.6591.704248.86853.297.27126.8386.4323.6712787.7034502537.2614225.03353.8768573603.4810.292592.09135.63928.2312.2115.77128.85137.92128.30138.92128.70624023.3537.3714174.4461.506.71603692596.37240329385156.485321.3011.5291.894222.69827.647.33125.9085.2519.8311201.4833207237.3114218.59338.463576.8810.252567.4862.43930.8712.1916.07133.17137.26126.75137.37124.87624023.3837.4111181.3461.706.71594603634.92224529605149.905312.11600.4390.973560.32915.807.13124.1187.2824.8611346.7832296737.5814147.34133.26615853593593.4910.35698.74128.63962.0012.4617.90378.6692.43111.6065.67120.00614423.6037.8215282.5061.137.68588611359.17194230385033.525185.2524.8064.023628.25138.296.78120.50185.7935.5510814.3032180237.5914159.84288.82606153593568.1310.362540.83124.75953.9312.3017.64116.53132.24121.94133.86122.25592623.5937.8514508.9761.377.34595521389.03198429764566.425185.5232.5885.583436.15498.157.00121.12182.9138.479219.4032671038.2814098.96298.77717368713573.9610.362618.00121.13744.1012.5618.25121.76120.79117.75120.86118.08606423.9937.8310100.5961.107.19587291379.47172429733594.223811.9115.7075.461628.56647.356.96116.49103.9830.21OpenBenchmarking.org

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.3Static Web Page ServingBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3K6K9K12K15KSE +/- 15.49, N = 3SE +/- 15.69, N = 3SE +/- 4.95, N = 3SE +/- 31.26, N = 3SE +/- 123.01, N = 3SE +/- 19.79, N = 314486.2612787.7011201.4811346.7810814.309219.401. (CC) gcc options: -shared -fPIC -O2 -pthread

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)70K140K210K280K350KSE +/- 3281.65, N = 3SE +/- 1213.95, N = 3SE +/- 3394.91, N = 3SE +/- 3642.91, N = 3SE +/- 3140.35, N = 3SE +/- 569.96, N = 33449403450253320723229673218023267101. (CC) gcc options: -O2 -pthread

C-Ray

Raytracing, 1600x1200, 16 Threads, 8xAA

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Raytracing, 1600x1200, 16 Threads, 8xAABaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)918273645SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 337.3337.2637.3137.5837.5938.281. (CC) gcc options: -lm -lpthread -O3

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3K6K9K12K15KSE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 5.37, N = 3SE +/- 0.88, N = 3SE +/- 18.04, N = 314219.2714225.0314218.5914147.3414159.8414098.961. (CC) gcc options: -lrt

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)80160240320400SE +/- 5.14, N = 3SE +/- 5.08, N = 3SE +/- 5.52, N = 3SE +/- 30.07, N = 6SE +/- 4.03, N = 6SE +/- 1.89, N = 3353.40353.87338.46133.26288.82298.77

Cyclictest

Kernel Latency: POSIX Timer, Interval 500 ms, 100000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: POSIX Timer, Interval 500 ms, 100000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1632486480SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3766160711. (CC) gcc options: -O2 -lrt -lpthread -lrttest

Cyclictest

Kernel Latency: POSIX Timer, Interval 10000 ms, 10000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: POSIX Timer, Interval 10000 ms, 10000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1632486480SE +/- 0.17, N = 6SE +/- 0.00, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 31085861731. (CC) gcc options: -O2 -lrt -lpthread -lrttest

Cyclictest

Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 500 ms, 100000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 500 ms, 100000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1530456075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3655353681. (CC) gcc options: -O2 -lrt -lpthread -lrttest

Cyclictest

Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 10000 ms, 10000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 10000 ms, 10000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1632486480SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.00, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3875959711. (CC) gcc options: -O2 -lrt -lpthread -lrttest

FFTE

Test: N=64, 1D Complex FFT Routine

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 5.0Test: N=64, 1D Complex FFT RoutineBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)8001600240032004000SE +/- 11.57, N = 3SE +/- 13.91, N = 3SE +/- 49.70, N = 3SE +/- 1.69, N = 3SE +/- 19.82, N = 3SE +/- 17.08, N = 33614.783603.483576.883593.493568.133573.961. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp -lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.2.1WAV To FLACBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3691215SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.03, N = 5SE +/- 0.03, N = 510.3010.2910.2510.3510.3610.36-logg-logg1. (CXX) g++ options: -O2 -lm

Flexible IO Tester

Test: Intel IOMeter File Server Access Pattern

OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.57Test: Intel IOMeter File Server Access PatternBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)6001200180024003000SE +/- 15.68, N = 3SE +/- 94.86, N = 3SE +/- 10.86, N = 3SE +/- 28.61, N = 6SE +/- 10.65, N = 3SE +/- 26.50, N = 32571.172592.092567.48698.742540.832618.00

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 2.34, N = 4SE +/- 2.18, N = 3SE +/- 0.03, N = 3SE +/- 1.39, N = 3SE +/- 2.62, N = 6SE +/- 0.86, N = 3134.38135.6362.43128.63124.75121.131. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)2004006008001000SE +/- 1.23, N = 3SE +/- 0.09, N = 3SE +/- 0.34, N = 3SE +/- 0.26, N = 3SE +/- 0.55, N = 3SE +/- 4.34, N = 3945.67928.23930.87962.00953.93744.101. (CC) gcc options: -static

GnuPG

1GB File Encryption

OpenBenchmarking.orgSeconds, Fewer Is BetterGnuPG 1.4.101GB File EncryptionBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3691215SE +/- 0.04, N = 4SE +/- 0.04, N = 4SE +/- 0.02, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 412.2012.2112.1912.4612.3012.56

Gzip Compression

2GB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip Compression2GB File CompressionBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)48121620SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 3SE +/- 0.26, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 315.9015.7716.0717.9017.6418.25

hdparm Timed Disk Reads

Disk To Read: /dev/sda

OpenBenchmarking.orgMB/s, More Is Betterhdparm Timed Disk ReadsDisk To Read: /dev/sdaBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)80160240320400SE +/- 9.24, N = 10SE +/- 7.78, N = 10SE +/- 0.77, N = 5SE +/- 56.81, N = 10SE +/- 7.77, N = 10SE +/- 1.42, N = 5128.83128.85133.17378.66116.53121.76

IOzone

Record Size: 1MB - File Size: 32GB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 1MB - File Size: 32GB - Disk Test: Read PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.25, N = 3SE +/- 0.18, N = 3SE +/- 0.65, N = 3SE +/- 18.52, N = 3SE +/- 0.71, N = 3SE +/- 0.23, N = 3139.47137.92137.2692.43132.24120.791. (CC) gcc options: -O3

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.65, N = 3SE +/- 0.79, N = 3SE +/- 1.36, N = 3SE +/- 7.78, N = 6SE +/- 0.58, N = 3SE +/- 0.80, N = 3128.03128.30126.75111.60121.94117.751. (CC) gcc options: -O3

IOzone

Record Size: 64kB - File Size: 32GB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 64kB - File Size: 32GB - Disk Test: Read PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.45, N = 3SE +/- 0.19, N = 3SE +/- 0.80, N = 3SE +/- 24.89, N = 3SE +/- 0.20, N = 3SE +/- 0.53, N = 3139.23138.92137.3765.67133.86120.861. (CC) gcc options: -O3

IOzone

Record Size: 64kB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 64kB - File Size: 8GB - Disk Test: Write PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.49, N = 3SE +/- 0.18, N = 3SE +/- 0.56, N = 3SE +/- 1.40, N = 3SE +/- 0.29, N = 3SE +/- 0.53, N = 3128.53128.70124.87120.00122.25118.081. (CC) gcc options: -O3

John The Ripper

Password Hasing: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Password Hasing: BlowfishBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)13002600390052006500SE +/- 20.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 225.30, N = 6SE +/- 16.00, N = 36219624062406144592660641. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.99.3WAV To MP3Baremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)612182430SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.33, N = 523.3723.3523.3823.6023.5923.99

Mencoder

AVI To LAVC

OpenBenchmarking.orgSeconds, Fewer Is BetterMencoder 1.1AVI To LAVCBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)918273645SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 337.3137.3737.4137.8237.8537.83-lXext -lX11 -lGL-lXext -lX11 -lGL1. (CC) gcc options: -lm -ffast-math -lz -lpthread -ldl -rdynamic

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.0.11Static Web Page ServingBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3K6K9K12K15KSE +/- 10.15, N = 3SE +/- 25.73, N = 3SE +/- 15.03, N = 3SE +/- 70.65, N = 3SE +/- 156.09, N = 3SE +/- 5.37, N = 314187.4814174.4411181.3415282.5014508.9710100.591. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1cRSA 4096-bit PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1428425670SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 361.7061.5061.7061.1361.3761.101. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.6256MB File CompressionBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)246810SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 6SE +/- 0.00, N = 3SE +/- 0.10, N = 36.696.716.717.687.347.191. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)13K26K39K52K65KSE +/- 458.19, N = 3SE +/- 366.94, N = 3SE +/- 898.92, N = 5SE +/- 553.47, N = 3SE +/- 207.62, N = 3SE +/- 198.40, N = 3604266036959460588615955258729

PostgreSQL pgbench

PostgreSQL TPC-B Transactions Per Second

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 8.4.11PostgreSQL TPC-B Transactions Per SecondBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)8001600240032004000SE +/- 22.76, N = 3SE +/- 35.61, N = 3SE +/- 32.90, N = 3SE +/- 3.60, N = 3SE +/- 21.38, N = 6SE +/- 6.75, N = 32541.712596.373634.921359.171389.031379.471. (CC) gcc options: -O2 -fno-strict-aliasing -fwrapv -lpgport -lpq -lcrypt -ldl -lm

PostMark

NetApp Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51NetApp Disk Transaction PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)5001000150020002500SE +/- 7.67, N = 3SE +/- 0.00, N = 3SE +/- 6.67, N = 3SE +/- 5.33, N = 3SE +/- 15.67, N = 3SE +/- 0.00, N = 32395240322451942198417241. (CC) gcc options: -O3

PyBench

Python Benchmark Suite

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2008-08-14Python Benchmark SuiteBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)7001400210028003500SE +/- 3.46, N = 3SE +/- 3.79, N = 3SE +/- 12.17, N = 3SE +/- 11.93, N = 3SE +/- 13.93, N = 3SE +/- 2.19, N = 3295629382960303829762973

RAMspeed SMP

Type: Triad - Benchmark: Integer

OpenBenchmarking.orgMB/s, More Is BetterRAMspeed SMP 3.5.0Type: Triad - Benchmark: IntegerBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)110022003300440055005157.285156.485149.905033.524566.423594.22

RAMspeed SMP

Type: Triad - Benchmark: Floating Point

OpenBenchmarking.orgMB/s, More Is BetterRAMspeed SMP 3.5.0Type: Triad - Benchmark: Floating PointBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)110022003300440055005317.755321.305312.115185.255185.523811.91

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)130260390520650SE +/- 0.19, N = 6SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.35, N = 6SE +/- 0.63, N = 3SE +/- 0.06, N = 310.6511.52600.4324.8032.5815.701. (CC) gcc options: -O2 -ldl -lpthread

Threaded I/O Tester

Test: Sequential Read - Size Per Thread: 1.024 MB - Thread Count: 32 - 64 k Block Size - Total 32 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Sequential Read - Size Per Thread: 1.024 MB - Thread Count: 32 - 64 k Block Size - Total 32 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)20406080100SE +/- 0.45, N = 4SE +/- 0.53, N = 4SE +/- 0.65, N = 4SE +/- 1.66, N = 8SE +/- 0.30, N = 4SE +/- 0.31, N = 491.7091.8990.9764.0285.5875.46

Threaded I/O Tester

Test: Random Read - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Random Read - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)9001800270036004500SE +/- 29.07, N = 4SE +/- 17.25, N = 4SE +/- 22.63, N = 4SE +/- 213.84, N = 8SE +/- 2.92, N = 4SE +/- 4.99, N = 44248.864222.693560.323628.253436.151628.56

Threaded I/O Tester

Test: Random Write - Size Per Thread: 2 MB - Thread Count: 32 - 4 k Block Size - Total 64 MB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Random Write - Size Per Thread: 2 MB - Thread Count: 32 - 4 k Block Size - Total 64 MBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)2004006008001000SE +/- 41.68, N = 8SE +/- 36.48, N = 8SE +/- 34.73, N = 8SE +/- 22.00, N = 8SE +/- 44.52, N = 8SE +/- 8.02, N = 8853.29827.64915.80138.29498.15647.35

Threaded I/O Tester

Test: Random Write - Size Per Thread: 64 MB - Thread Count: 16 - 4 k Block Size - Total 1 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Random Write - Size Per Thread: 64 MB - Thread Count: 16 - 4 k Block Size - Total 1 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)246810SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.11, N = 8SE +/- 0.08, N = 4SE +/- 0.05, N = 47.277.337.136.787.006.96

Threaded I/O Tester

Test: Sequential Write - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Sequential Write - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 1.68, N = 4SE +/- 0.71, N = 4SE +/- 0.65, N = 4SE +/- 0.63, N = 4SE +/- 0.65, N = 4SE +/- 0.72, N = 4126.83125.90124.11120.50121.12116.49

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 3.1Time To CompileBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)4080120160200SE +/- 1.04, N = 3SE +/- 0.93, N = 3SE +/- 0.83, N = 3SE +/- 1.00, N = 3SE +/- 1.24, N = 3SE +/- 1.24, N = 386.4385.2587.28185.79182.91103.98

Timed MrBayes Analysis

Primate Phylogeny Analysis (Bayes)

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MrBayes Analysis 3.1.2Primate Phylogeny Analysis (Bayes)Baremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM PV (on Ubuntu 12.04 LTS)KVM PV, cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)918273645SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 323.6719.8324.8635.5538.4730.21

Phoronix Test Suite v10.8.5