VM Comparison

Virtualization Comparison

HTML result view exported from: https://openbenchmarking.org/result/1302198-RA-VMCOMPARI66.

VM ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)2 x Intel Xeon E5440 @ 2.83GHz (8 Cores)Dell 0TT740Intel 5000X MCH16384MB1000GB PERC 6/iAMD ATI ES1000 128MBBroadcom NetXtreme II BCM5708 GigabitUbuntu 12.043.2.0-37-generic (x86_64)GCC 4.6ext41024x768128MBQEMU Virtual 1.0 @ 2.83GHz (8 Cores)BochsRed Hat Virtio14336MB45GBCirrus Logic GD 5446Red Hat Virtio device3.5.0-23-generic (x86_64)800x600QEMU 1.013312MB3.2.0-37-generic (x86_64)Intel Core 2 Duo T7700 @ 2.83GHz (8 Cores)14336MBIntel Xeon E5440 @ 2.83GHz (8 Cores)60GBXen 4.1.2 HypervisorOpenBenchmarking.orgDisk Details- Baremetal (ondemand), Baremetal (Performance): CFQ / barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattrProcessor Details- Baremetal (ondemand): Scaling Governor: ondemand- Baremetal (Performance): Scaling Governor: performance- LXC (on Ubuntu 12.04 LTS): Scaling Governor: ondemandSystem Details- Baremetal (ondemand): Disk Scheduler: CFQ. Python 2.7.3.- Baremetal (Performance): Disk Scheduler: CFQ. Python 2.7.3.- LXC (on Ubuntu 12.04 LTS): Python 2.7.3.- KVM (on Ubuntu 12.04 LTS): Python 2.7.3.- KVM 13.5GB (on Ubuntu 12.04 LTS): Python 2.7.3.- KVM cache=none (on Ubuntu 12.04 LTS): Python 2.7.3.- Xen PV (on Ubuntu 12.04 LTS): Python 2.7.3.Compiler Details- LXC (on Ubuntu 12.04 LTS), KVM (on Ubuntu 12.04 LTS), KVM 13.5GB (on Ubuntu 12.04 LTS), KVM cache=none (on Ubuntu 12.04 LTS), Xen PV (on Ubuntu 12.04 LTS): --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v Disk Mount Options Details- LXC (on Ubuntu 12.04 LTS): barrier=1,data=ordered,relatime,rw,user_xattr- KVM (on Ubuntu 12.04 LTS): data=ordered,errors=remount-ro,relatime,rw- KVM 13.5GB (on Ubuntu 12.04 LTS): barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr- KVM cache=none (on Ubuntu 12.04 LTS): barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr- Xen PV (on Ubuntu 12.04 LTS): barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr

VM Comparisonfio: Intel IOMeter File Server Access Patternsqlite: Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncblogbench: Readhdparm-read: /dev/sdaiozone: 1MB - 32GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 64kB - 32GB - Read Performanceiozone: 64kB - 8GB - Write Performancetiobench: Seq Read - 1.024 MB - 32 - 64 k Block Size - Total 32 GBtiobench: Rand Read - 128 MB - 32 - 4 k Block Size - Total 4 GBtiobench: Rand Write - 2 MB - 32 - 4 k Block Size - Total 64 MBtiobench: Rand Write - 64 MB - 16 - 4 k Block Size - Total 1 GBtiobench: Seq Write - 128 MB - 32 - 4 k Block Size - Total 4 GBcompilebench: Compilepostmark: NetApp Disk Transaction Performanceramspeed: Triad - Integerramspeed: Triad - Floating Pointffte: N=64, 1D Complex FFT Routinemrbayes: Primate Phylogeny Analysis (Bayes)cachebench: Read / Modify / Writejohn-the-ripper: Blowfishbuild-linux-kernel: Time To Compilec-ray: Raytracing, 1600x1200, 16 Threads, 8xAAcompress-pbzip2: 256MB File Compressioncompress-gzip: 2GB File Compressionencode-flac: WAV To FLACencode-mp3: WAV To MP3gnupg: 1GB File Encryptionmencoder: AVI To LAVCpybench: Python Benchmark Suitephpbench: PHP Benchmark Suitecyclictest: POSIX Timer, Interval 500 ms, 100000 Loopscyclictest: POSIX Timer, Interval 10000 ms, 10000 Loopscyclictest: clock_nanosleep TIME_ABSTIME, Interval 500 ms, 100000 Loopscyclictest: clock_nanosleep TIME_ABSTIME, Interval 10000 ms, 10000 Loopsopenssl: RSA 4096-bit Performancepgbench: PostgreSQL TPC-B Transactions Per Secondnginx: Static Web Page Servingapache: Static Web Page ServingBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)2571.1710.65134.38945.67344940128.83139.47128.03139.23128.5391.704248.86853.297.27126.83353.4023955157.285317.753614.7823.6714219.27621986.4337.336.6915.9010.3023.3712.2037.312956604267106861.702541.7114187.4814486.262592.0911.52135.63928.23345025128.85137.92128.30138.92128.7091.894222.69827.647.33125.90353.8724035156.485321.303603.4819.8314225.03624085.2537.266.7115.7710.2923.3512.2137.37293860369685761.502596.3714174.4412787.702567.48600.4362.43930.87332072133.17137.26126.75137.37124.8790.973560.32915.807.13124.11338.4622455149.905312.113576.8824.8614218.59624087.2837.316.7116.0710.2523.3812.1937.4129605946061.703634.9211181.3411201.48698.7424.80128.63962.00322967378.6692.43111.6065.67120.0064.023628.25138.296.78120.50133.2619425033.525185.253593.4935.5514147.346144185.7937.587.6817.9010.3523.6012.4637.823038588616158535961.131359.1715282.5011346.78648.2424.40127.37954.37317652354.91114.11111.1462.0287.9661.012804.77357.205.74115.0361.2619184712.713683.143573.8738.9214150.526155180.6037.567.6117.7010.3623.5812.4737.773037570836057535561.301391.5414155.0410707.662540.8332.58124.75953.93321802116.53132.24121.94133.86122.2585.583436.15498.157.00121.12288.8219844566.425185.523568.1338.4714159.845926182.9137.597.3417.6410.3623.5912.3037.852976595526061535961.371389.0314508.9710814.302618.0015.70121.13744.10326710121.76120.79117.75120.86118.0875.461628.56647.356.96116.49298.7717243594.223811.913573.9630.2114098.966064103.9838.287.1918.2510.3623.9912.5637.832973587297173687161.101379.4710100.599219.40OpenBenchmarking.org

Flexible IO Tester

Test: Intel IOMeter File Server Access Pattern

OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.57Test: Intel IOMeter File Server Access PatternBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)6001200180024003000SE +/- 15.68, N = 3SE +/- 94.86, N = 3SE +/- 10.86, N = 3SE +/- 28.61, N = 6SE +/- 32.56, N = 6SE +/- 10.65, N = 3SE +/- 26.50, N = 32571.172592.092567.48698.74648.242540.832618.00

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)130260390520650SE +/- 0.19, N = 6SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.35, N = 6SE +/- 0.41, N = 3SE +/- 0.63, N = 3SE +/- 0.06, N = 310.6511.52600.4324.8024.4032.5815.701. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 2.34, N = 4SE +/- 2.18, N = 3SE +/- 0.03, N = 3SE +/- 1.39, N = 3SE +/- 0.64, N = 3SE +/- 2.62, N = 6SE +/- 0.86, N = 3134.38135.6362.43128.63127.37124.75121.131. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)2004006008001000SE +/- 1.23, N = 3SE +/- 0.09, N = 3SE +/- 0.34, N = 3SE +/- 0.26, N = 3SE +/- 1.05, N = 3SE +/- 0.55, N = 3SE +/- 4.34, N = 3945.67928.23930.87962.00954.37953.93744.101. (CC) gcc options: -static

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)70K140K210K280K350KSE +/- 3281.65, N = 3SE +/- 1213.95, N = 3SE +/- 3394.91, N = 3SE +/- 3642.91, N = 3SE +/- 4746.53, N = 3SE +/- 3140.35, N = 3SE +/- 569.96, N = 33449403450253320723229673176523218023267101. (CC) gcc options: -O2 -pthread

hdparm Timed Disk Reads

Disk To Read: /dev/sda

OpenBenchmarking.orgMB/s, More Is Betterhdparm Timed Disk ReadsDisk To Read: /dev/sdaBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)80160240320400SE +/- 9.24, N = 10SE +/- 7.78, N = 10SE +/- 0.77, N = 5SE +/- 56.81, N = 10SE +/- 54.86, N = 10SE +/- 7.77, N = 10SE +/- 1.42, N = 5128.83128.85133.17378.66354.91116.53121.76

IOzone

Record Size: 1MB - File Size: 32GB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 1MB - File Size: 32GB - Disk Test: Read PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.25, N = 3SE +/- 0.18, N = 3SE +/- 0.65, N = 3SE +/- 18.52, N = 3SE +/- 13.64, N = 3SE +/- 0.71, N = 3SE +/- 0.23, N = 3139.47137.92137.2692.43114.11132.24120.791. (CC) gcc options: -O3

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.65, N = 3SE +/- 0.79, N = 3SE +/- 1.36, N = 3SE +/- 7.78, N = 6SE +/- 10.27, N = 6SE +/- 0.58, N = 3SE +/- 0.80, N = 3128.03128.30126.75111.60111.14121.94117.751. (CC) gcc options: -O3

IOzone

Record Size: 64kB - File Size: 32GB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 64kB - File Size: 32GB - Disk Test: Read PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.45, N = 3SE +/- 0.19, N = 3SE +/- 0.80, N = 3SE +/- 24.89, N = 3SE +/- 24.94, N = 3SE +/- 0.20, N = 3SE +/- 0.53, N = 3139.23138.92137.3765.6762.02133.86120.861. (CC) gcc options: -O3

IOzone

Record Size: 64kB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 64kB - File Size: 8GB - Disk Test: Write PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 0.49, N = 3SE +/- 0.18, N = 3SE +/- 0.56, N = 3SE +/- 1.40, N = 3SE +/- 14.11, N = 6SE +/- 0.29, N = 3SE +/- 0.53, N = 3128.53128.70124.87120.0087.96122.25118.081. (CC) gcc options: -O3

Threaded I/O Tester

Test: Sequential Read - Size Per Thread: 1.024 MB - Thread Count: 32 - 64 k Block Size - Total 32 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Sequential Read - Size Per Thread: 1.024 MB - Thread Count: 32 - 64 k Block Size - Total 32 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)20406080100SE +/- 0.45, N = 4SE +/- 0.53, N = 4SE +/- 0.65, N = 4SE +/- 1.66, N = 8SE +/- 3.19, N = 8SE +/- 0.30, N = 4SE +/- 0.31, N = 491.7091.8990.9764.0261.0185.5875.46

Threaded I/O Tester

Test: Random Read - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Random Read - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)9001800270036004500SE +/- 29.07, N = 4SE +/- 17.25, N = 4SE +/- 22.63, N = 4SE +/- 213.84, N = 8SE +/- 326.83, N = 8SE +/- 2.92, N = 4SE +/- 4.99, N = 44248.864222.693560.323628.252804.773436.151628.56

Threaded I/O Tester

Test: Random Write - Size Per Thread: 2 MB - Thread Count: 32 - 4 k Block Size - Total 64 MB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Random Write - Size Per Thread: 2 MB - Thread Count: 32 - 4 k Block Size - Total 64 MBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)2004006008001000SE +/- 41.68, N = 8SE +/- 36.48, N = 8SE +/- 34.73, N = 8SE +/- 22.00, N = 8SE +/- 56.74, N = 8SE +/- 44.52, N = 8SE +/- 8.02, N = 8853.29827.64915.80138.29357.20498.15647.35

Threaded I/O Tester

Test: Random Write - Size Per Thread: 64 MB - Thread Count: 16 - 4 k Block Size - Total 1 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Random Write - Size Per Thread: 64 MB - Thread Count: 16 - 4 k Block Size - Total 1 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)246810SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.11, N = 8SE +/- 0.27, N = 8SE +/- 0.08, N = 4SE +/- 0.05, N = 47.277.337.136.785.747.006.96

Threaded I/O Tester

Test: Sequential Write - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GB

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.3Test: Sequential Write - Size Per Thread: 128 MB - Thread Count: 32 - 4 k Block Size - Total 4 GBBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)306090120150SE +/- 1.68, N = 4SE +/- 0.71, N = 4SE +/- 0.65, N = 4SE +/- 0.63, N = 4SE +/- 2.81, N = 8SE +/- 0.65, N = 4SE +/- 0.72, N = 4126.83125.90124.11120.50115.03121.12116.49

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)80160240320400SE +/- 5.14, N = 3SE +/- 5.08, N = 3SE +/- 5.52, N = 3SE +/- 30.07, N = 6SE +/- 10.64, N = 6SE +/- 4.03, N = 6SE +/- 1.89, N = 3353.40353.87338.46133.2661.26288.82298.77

PostMark

NetApp Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51NetApp Disk Transaction PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)5001000150020002500SE +/- 7.67, N = 3SE +/- 0.00, N = 3SE +/- 6.67, N = 3SE +/- 5.33, N = 3SE +/- 12.98, N = 3SE +/- 15.67, N = 3SE +/- 0.00, N = 323952403224519421918198417241. (CC) gcc options: -O3

RAMspeed SMP

Type: Triad - Benchmark: Integer

OpenBenchmarking.orgMB/s, More Is BetterRAMspeed SMP 3.5.0Type: Triad - Benchmark: IntegerBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)110022003300440055005157.285156.485149.905033.524712.714566.423594.22

RAMspeed SMP

Type: Triad - Benchmark: Floating Point

OpenBenchmarking.orgMB/s, More Is BetterRAMspeed SMP 3.5.0Type: Triad - Benchmark: Floating PointBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)110022003300440055005317.755321.305312.115185.253683.145185.523811.91

FFTE

Test: N=64, 1D Complex FFT Routine

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 5.0Test: N=64, 1D Complex FFT RoutineBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)8001600240032004000SE +/- 11.57, N = 3SE +/- 13.91, N = 3SE +/- 49.70, N = 3SE +/- 1.69, N = 3SE +/- 21.78, N = 3SE +/- 19.82, N = 3SE +/- 17.08, N = 33614.783603.483576.883593.493573.873568.133573.961. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp -lmpichf90 -lmpich -lopa -lmpl -lrt -lcr -lpthread

Timed MrBayes Analysis

Primate Phylogeny Analysis (Bayes)

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MrBayes Analysis 3.1.2Primate Phylogeny Analysis (Bayes)Baremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)918273645SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.27, N = 3SE +/- 0.68, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 323.6719.8324.8635.5538.9238.4730.21

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3K6K9K12K15KSE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 5.37, N = 3SE +/- 9.29, N = 3SE +/- 0.88, N = 3SE +/- 18.04, N = 314219.2714225.0314218.5914147.3414150.5214159.8414098.961. (CC) gcc options: -lrt

John The Ripper

Password Hasing: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.9-jumbo-7Password Hasing: BlowfishBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)13002600390052006500SE +/- 20.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 18.77, N = 3SE +/- 225.30, N = 6SE +/- 16.00, N = 362196240624061446155592660641. (CC) gcc options: -lssl -lcrypto -lm -lz -fopenmp -lcrypt -ldl

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 3.1Time To CompileBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)4080120160200SE +/- 1.04, N = 3SE +/- 0.93, N = 3SE +/- 0.83, N = 3SE +/- 1.00, N = 3SE +/- 1.15, N = 3SE +/- 1.24, N = 3SE +/- 1.24, N = 386.4385.2587.28185.79180.60182.91103.98

C-Ray

Raytracing, 1600x1200, 16 Threads, 8xAA

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Raytracing, 1600x1200, 16 Threads, 8xAABaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)918273645SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 337.3337.2637.3137.5837.5637.5938.281. (CC) gcc options: -lm -lpthread -O3

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.6256MB File CompressionBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)246810SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 6SE +/- 0.27, N = 6SE +/- 0.00, N = 3SE +/- 0.10, N = 36.696.716.717.687.617.347.191. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

Gzip Compression

2GB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip Compression2GB File CompressionBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)48121620SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 3SE +/- 0.26, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 315.9015.7716.0717.9017.7017.6418.25

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.2.1WAV To FLACBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3691215SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.04, N = 5SE +/- 0.03, N = 5SE +/- 0.03, N = 510.3010.2910.2510.3510.3610.3610.36-logg-logg1. (CXX) g++ options: -O2 -lm

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.99.3WAV To MP3Baremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)612182430SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.33, N = 523.3723.3523.3823.6023.5823.5923.99

GnuPG

1GB File Encryption

OpenBenchmarking.orgSeconds, Fewer Is BetterGnuPG 1.4.101GB File EncryptionBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3691215SE +/- 0.04, N = 4SE +/- 0.04, N = 4SE +/- 0.02, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 412.2012.2112.1912.4612.4712.3012.56

Mencoder

AVI To LAVC

OpenBenchmarking.orgSeconds, Fewer Is BetterMencoder 1.1AVI To LAVCBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)918273645SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 337.3137.3737.4137.8237.7737.8537.83-lXext -lX11 -lGL-lXext -lX11 -lGL1. (CC) gcc options: -lm -ffast-math -lz -lpthread -ldl -rdynamic

PyBench

Python Benchmark Suite

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2008-08-14Python Benchmark SuiteBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)7001400210028003500SE +/- 3.46, N = 3SE +/- 3.79, N = 3SE +/- 12.17, N = 3SE +/- 11.93, N = 3SE +/- 7.23, N = 3SE +/- 13.93, N = 3SE +/- 2.19, N = 32956293829603038303729762973

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)13K26K39K52K65KSE +/- 458.19, N = 3SE +/- 366.94, N = 3SE +/- 898.92, N = 5SE +/- 553.47, N = 3SE +/- 438.30, N = 3SE +/- 207.62, N = 3SE +/- 198.40, N = 360426603695946058861570835955258729

Cyclictest

Kernel Latency: POSIX Timer, Interval 500 ms, 100000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: POSIX Timer, Interval 500 ms, 100000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1632486480SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.88, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 376616060711. (CC) gcc options: -O2 -lrt -lpthread -lrttest

Cyclictest

Kernel Latency: POSIX Timer, Interval 10000 ms, 10000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: POSIX Timer, Interval 10000 ms, 10000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1632486480SE +/- 0.17, N = 6SE +/- 0.00, N = 3SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3108585761731. (CC) gcc options: -O2 -lrt -lpthread -lrttest

Cyclictest

Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 500 ms, 100000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 500 ms, 100000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1530456075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 365535353681. (CC) gcc options: -O2 -lrt -lpthread -lrttest

Cyclictest

Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 10000 ms, 10000 Loops

OpenBenchmarking.orgms Average, Fewer Is BetterCyclictest 0.84Kernel Latency: clock_nanosleep TIME_ABSTIME, Interval 10000 ms, 10000 LoopsBaremetal (ondemand)Baremetal (Performance)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1632486480SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.00, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 387595559711. (CC) gcc options: -O2 -lrt -lpthread -lrttest

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1cRSA 4096-bit PerformanceBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)1428425670SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 361.7061.5061.7061.1361.3061.3761.101. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

PostgreSQL pgbench

PostgreSQL TPC-B Transactions Per Second

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 8.4.11PostgreSQL TPC-B Transactions Per SecondBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)8001600240032004000SE +/- 22.76, N = 3SE +/- 35.61, N = 3SE +/- 32.90, N = 3SE +/- 3.60, N = 3SE +/- 20.26, N = 4SE +/- 21.38, N = 6SE +/- 6.75, N = 32541.712596.373634.921359.171391.541389.031379.471. (CC) gcc options: -O2 -fno-strict-aliasing -fwrapv -lpgport -lpq -lcrypt -ldl -lm

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.0.11Static Web Page ServingBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3K6K9K12K15KSE +/- 10.15, N = 3SE +/- 25.73, N = 3SE +/- 15.03, N = 3SE +/- 70.65, N = 3SE +/- 93.93, N = 3SE +/- 156.09, N = 3SE +/- 5.37, N = 314187.4814174.4411181.3415282.5014155.0414508.9710100.591. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.3Static Web Page ServingBaremetal (ondemand)Baremetal (Performance)LXC (on Ubuntu 12.04 LTS)KVM (on Ubuntu 12.04 LTS)KVM 13.5GB (on Ubuntu 12.04 LTS)KVM cache=none (on Ubuntu 12.04 LTS)Xen PV (on Ubuntu 12.04 LTS)3K6K9K12K15KSE +/- 15.49, N = 3SE +/- 15.69, N = 3SE +/- 4.95, N = 3SE +/- 31.26, N = 3SE +/- 30.45, N = 3SE +/- 123.01, N = 3SE +/- 19.79, N = 314486.2612787.7011201.4811346.7810707.6610814.309219.401. (CC) gcc options: -shared -fPIC -O2 -pthread

Phoronix Test Suite v10.8.4