Xen HVM domU vs. KVM vs. VirtualBox - Ubuntu

Xen benchmarking from Ubuntu 11.10 on host and guest against KVM-QEMU on Ubuntu 11.10 and VirtualBox. Testing by Phoronix.com Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1110164-AR-1110169AR92
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

C/C++ Compiler Tests 7 Tests
CPU Massive 9 Tests
Creator Workloads 3 Tests
Cryptography 2 Tests
Disk Test Suite 2 Tests
HPC - High Performance Computing 2 Tests
Common Kernel Benchmarks 3 Tests
Multi-Core 6 Tests
Raytracing 2 Tests
Renderers 3 Tests
Server 3 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Bare Metal
October 16 2011
 
VirtualBox
October 16 2011
 
Xen HVM DomU
October 15 2011
 
KVM-QEMU
October 16 2011
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Xen HVM domU vs. KVM vs. VirtualBox - UbuntuProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionSystem LayerBare MetalVirtualBoxXen HVM DomUKVM-QEMUIntel Core i7-2630QM @ 2.00GHz (8 Cores)Compal PBL21Intel 2nd Generation Core Family8192MB128GB Super Talent STT_FTM28G225HNVIDIA GeForce GT 555M (672/900MHz)Realtek ALC259Realtek RTL8111/8168B + Atheros AR9285 WirelessUbuntu 11.103.0.0-12-generic (x86_64)Unity 4.22.0X Server 1.10.4nouveau 0.0.162.1 Mesa 7.11GCC 4.6.1ext41920x1080Intel Core i7-2630QM @ 1.99GHz (8 Cores)innotek VirtualBox v1.2Intel 440FX - 82441FX PMC6144MB42GB VBOX HDDInnoTek VirtualBoxIntel 82801AA AC 97 AudioVBOX monitorIntel 82540EM Gigabitvboxvideo 1.0.11920x1034VirtualBox 4.1.2_Ubuntur38459Intel Core i7-2630QM @ 2.00GHz (8 Cores)Xen HVM domU v4.1.132GBCirrus Logic GD 5446Ensoniq ES1370cirrus 1.3.21024x768Xen HVM domU 4.1.1QEMU Virtual 0.14.1 @ 2.00GHz (8 Cores)BochsRed Hat VirtioGeneric 1af4 ID 20Red Hat Virtio device2.1 Mesa 7.11QEMUOpenBenchmarking.orgSystem Details- VirtualBox: Disk Scheduler: CFQ.

Bare MetalVirtualBoxXen HVM DomUKVM-QEMULogarithmic Result OverviewPhoronix Test SuiteSQLiteApache BenchmarkPostMarkPOV-RayC-RayTimed MAFFT AlignmentJohn The RipperOpenSSLNAS Parallel Benchmarks7-Zip CompressionSmallptCLOMP

Xen HVM domU vs. KVM vs. VirtualBox - Ubuntuc-ray: Total Timepovray: Total Timesmallpt: Global Illumination Renderer; 100 Samplesjohn-the-ripper: Traditional DESjohn-the-ripper: MD5john-the-ripper: Blowfishopenssl: RSA 4096-bit Performancecompress-7zip: Compress Speed Testnpb: BT.Anpb: CG.Bnpb: EP.Bnpb: FT.Bnpb: IS.Cnpb: LU.Anpb: MG.Bnpb: SP.Anpb: UA.Amafft: Multiple Sequence Alignmentclomp: Static OMP Speedupapache: Static Web Page Servingpostmark: Disk Transaction Performancesqlite: Default Test DirectoryBare MetalVirtualBoxXen HVM DomUKVM-QEMU73.2590014434750001112471467.75133319483.242259.97157.694936.29141.828803.395262.674604.6932.0425.014.9015642.744166319.9286.1596215732576671056268363.93112958050.001944.04145.034308.0778.247893.534575.894093.8527.7126.954.014315.633090147.70107.6513281882397333762849146.7397717034.051671.94116.593777.3097.686254.723843.843405.6521.2236.434.2411231.482409608.9280.5290514633830001106371067.15117579134.722130.41154.364716.1287.878525.194980.324190.1528.6325.594.7011247.063393416.75OpenBenchmarking.org

C-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeXen HVM DomUVirtualBoxKVM-QEMUBare Metal20406080100SE +/- 0.01, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 0.47, N = 3107.6586.1580.5273.25
OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeXen HVM DomUVirtualBoxKVM-QEMUBare Metal20406080100Min: 107.64 / Avg: 107.65 / Max: 107.67Min: 85.69 / Avg: 86.15 / Max: 86.38Min: 80.32 / Avg: 80.52 / Max: 80.89Min: 72.73 / Avg: 73.25 / Max: 74.19

POV-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.6.1Total TimeXen HVM DomUVirtualBoxKVM-QEMUBare Metal300600900120015001328962905900

Smallpt

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesXen HVM DomUVirtualBoxKVM-QEMUBare Metal4080120160200SE +/- 0.00, N = 3SE +/- 1.15, N = 3SE +/- 1.33, N = 3SE +/- 1.20, N = 3188157146144
OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesXen HVM DomUVirtualBoxKVM-QEMUBare Metal306090120150Min: 188 / Avg: 188 / Max: 188Min: 155 / Avg: 157 / Max: 159Min: 143 / Avg: 145.67 / Max: 147Min: 142 / Avg: 144.33 / Max: 146

John The Ripper

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESXen HVM DomUVirtualBoxKVM-QEMUBare Metal700K1400K2100K2800K3500KSE +/- 6641.62, N = 3SE +/- 7264.83, N = 3SE +/- 29365.51, N = 3SE +/- 50302.42, N = 32397333325766733830003475000
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESXen HVM DomUVirtualBoxKVM-QEMUBare Metal600K1200K1800K2400K3000KMin: 2386000 / Avg: 2397333.33 / Max: 2409000Min: 3246000 / Avg: 3257666.67 / Max: 3271000Min: 3346000 / Avg: 3383000 / Max: 3441000Min: 3376000 / Avg: 3475000 / Max: 3540000

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Xen HVM DomUVirtualBoxKVM-QEMUBare Metal2K4K6K8K10KSE +/- 2.85, N = 3SE +/- 25.54, N = 3SE +/- 8.35, N = 3SE +/- 16.68, N = 37628105621106311124
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Xen HVM DomUVirtualBoxKVM-QEMUBare Metal2K4K6K8K10KMin: 7622 / Avg: 7627.67 / Max: 7631Min: 10525 / Avg: 10562 / Max: 10611Min: 11046 / Avg: 11062.67 / Max: 11072Min: 11106 / Avg: 11123.67 / Max: 11157

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishXen HVM DomUVirtualBoxKVM-QEMUBare Metal150300450600750SE +/- 0.88, N = 3SE +/- 2.60, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3491683710714
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishXen HVM DomUVirtualBoxKVM-QEMUBare Metal130260390520650Min: 489 / Avg: 490.67 / Max: 492Min: 679 / Avg: 683.33 / Max: 688Min: 709 / Avg: 710.33 / Max: 712Min: 713 / Avg: 714.33 / Max: 716

OpenSSL

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceXen HVM DomUVirtualBoxKVM-QEMUBare Metal1530456075SE +/- 0.02, N = 4SE +/- 0.37, N = 4SE +/- 0.21, N = 4SE +/- 0.27, N = 446.7363.9367.1567.75
OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceXen HVM DomUVirtualBoxKVM-QEMUBare Metal1326395265Min: 46.7 / Avg: 46.73 / Max: 46.8Min: 63.3 / Avg: 63.93 / Max: 64.7Min: 66.7 / Avg: 67.15 / Max: 67.6Min: 67.3 / Avg: 67.75 / Max: 68.4

7-Zip Compression

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestXen HVM DomUVirtualBoxKVM-QEMUBare Metal3K6K9K12K15KSE +/- 81.83, N = 3SE +/- 48.81, N = 3SE +/- 70.24, N = 3SE +/- 219.83, N = 39771112951175713331
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestXen HVM DomUVirtualBoxKVM-QEMUBare Metal2K4K6K8K10KMin: 9610 / Avg: 9770.67 / Max: 9878Min: 11198 / Avg: 11295 / Max: 11353Min: 11629 / Avg: 11757.33 / Max: 11871Min: 12891 / Avg: 13330.67 / Max: 13551

NAS Parallel Benchmarks

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal2K4K6K8K10KSE +/- 11.02, N = 3SE +/- 38.28, N = 3SE +/- 30.12, N = 3SE +/- 32.43, N = 37034.058050.009134.729483.24
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal16003200480064008000Min: 7012.07 / Avg: 7034.05 / Max: 7046.41Min: 8011.06 / Avg: 8050 / Max: 8126.55Min: 9082.01 / Avg: 9134.72 / Max: 9186.32Min: 9421.24 / Avg: 9483.24 / Max: 9530.73

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal5001000150020002500SE +/- 1.06, N = 3SE +/- 0.99, N = 3SE +/- 16.10, N = 3SE +/- 1.12, N = 31671.941944.042130.412259.97
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal400800120016002000Min: 1670.56 / Avg: 1671.94 / Max: 1674.03Min: 1942.49 / Avg: 1944.04 / Max: 1945.89Min: 2098.4 / Avg: 2130.41 / Max: 2149.4Min: 2257.95 / Avg: 2259.97 / Max: 2261.8

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal306090120150SE +/- 0.07, N = 3SE +/- 0.40, N = 3SE +/- 0.64, N = 3SE +/- 1.01, N = 3116.59145.03154.36157.69
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal306090120150Min: 116.45 / Avg: 116.59 / Max: 116.68Min: 144.38 / Avg: 145.03 / Max: 145.76Min: 153.52 / Avg: 154.36 / Max: 155.62Min: 155.67 / Avg: 157.69 / Max: 158.79

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal11002200330044005500SE +/- 2.06, N = 3SE +/- 39.72, N = 3SE +/- 30.36, N = 3SE +/- 27.27, N = 33777.304308.074716.124936.29
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal9001800270036004500Min: 3774.9 / Avg: 3777.3 / Max: 3781.39Min: 4234.29 / Avg: 4308.07 / Max: 4370.48Min: 4656.66 / Avg: 4716.12 / Max: 4756.51Min: 4884.45 / Avg: 4936.29 / Max: 4976.88

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CVirtualBoxKVM-QEMUXen HVM DomUBare Metal306090120150SE +/- 2.55, N = 6SE +/- 2.73, N = 6SE +/- 0.06, N = 3SE +/- 0.32, N = 378.2487.8797.68141.82
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CVirtualBoxKVM-QEMUXen HVM DomUBare Metal306090120150Min: 73.08 / Avg: 78.24 / Max: 87Min: 74.65 / Avg: 87.87 / Max: 92.63Min: 97.57 / Avg: 97.68 / Max: 97.75Min: 141.48 / Avg: 141.82 / Max: 142.45

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal2K4K6K8K10KSE +/- 7.03, N = 3SE +/- 76.11, N = 3SE +/- 118.14, N = 6SE +/- 435.53, N = 66254.727893.538525.198803.39
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal15003000450060007500Min: 6240.89 / Avg: 6254.72 / Max: 6263.81Min: 7746.38 / Avg: 7893.53 / Max: 8000.84Min: 7959.83 / Avg: 8525.19 / Max: 8711.29Min: 6646.6 / Avg: 8803.39 / Max: 9362.73

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal11002200330044005500SE +/- 222.22, N = 6SE +/- 28.77, N = 3SE +/- 18.27, N = 3SE +/- 4.12, N = 33843.844575.894980.325262.67
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BXen HVM DomUVirtualBoxKVM-QEMUBare Metal9001800270036004500Min: 2735.36 / Avg: 3843.84 / Max: 4128.66Min: 4535.45 / Avg: 4575.89 / Max: 4631.56Min: 4961.46 / Avg: 4980.32 / Max: 5016.86Min: 5255.86 / Avg: 5262.67 / Max: 5270.09

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal10002000300040005000SE +/- 41.04, N = 3SE +/- 16.78, N = 3SE +/- 72.35, N = 6SE +/- 11.34, N = 33405.654093.854190.154604.69
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal8001600240032004000Min: 3324.6 / Avg: 3405.65 / Max: 3457.34Min: 4060.93 / Avg: 4093.85 / Max: 4115.96Min: 3938.36 / Avg: 4190.15 / Max: 4376.34Min: 4590.75 / Avg: 4604.69 / Max: 4627.16

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal714212835SE +/- 0.67, N = 6SE +/- 0.07, N = 3SE +/- 0.50, N = 3SE +/- 0.05, N = 321.2227.7128.6332.04
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.AXen HVM DomUVirtualBoxKVM-QEMUBare Metal714212835Min: 17.99 / Avg: 21.22 / Max: 22.47Min: 27.61 / Avg: 27.71 / Max: 27.84Min: 27.83 / Avg: 28.63 / Max: 29.54Min: 31.96 / Avg: 32.04 / Max: 32.13

Timed MAFFT Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentXen HVM DomUVirtualBoxKVM-QEMUBare Metal816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 336.4326.9525.5925.01
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentXen HVM DomUVirtualBoxKVM-QEMUBare Metal816243240Min: 36.42 / Avg: 36.43 / Max: 36.45Min: 26.94 / Avg: 26.95 / Max: 26.98Min: 25.58 / Avg: 25.59 / Max: 25.6Min: 24.95 / Avg: 25.01 / Max: 25.08

CLOMP

CLOMP is the C version of the Livermore OpenMP benchmark developed to measure OpenMP overheads and other performance impacts due to threading in order to influence future system designs. This particular test profile configuration is currently set to look at the OpenMP static schedule speed-up across all available CPU cores using the recommended test configuration. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupVirtualBoxXen HVM DomUKVM-QEMUBare Metal1.10252.2053.30754.415.5125SE +/- 0.13, N = 10SE +/- 0.03, N = 5SE +/- 0.09, N = 10SE +/- 0.04, N = 54.014.244.704.90
OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupVirtualBoxXen HVM DomUKVM-QEMUBare Metal246810Min: 3.22 / Avg: 4.01 / Max: 4.47Min: 4.16 / Avg: 4.24 / Max: 4.3Min: 3.95 / Avg: 4.7 / Max: 4.92Min: 4.79 / Avg: 4.9 / Max: 5.03

Apache Benchmark

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingVirtualBoxXen HVM DomUKVM-QEMUBare Metal3K6K9K12K15KSE +/- 22.06, N = 3SE +/- 44.78, N = 3SE +/- 167.10, N = 3SE +/- 123.21, N = 34315.6311231.4811247.0615642.74
OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingVirtualBoxXen HVM DomUKVM-QEMUBare Metal3K6K9K12K15KMin: 4292.16 / Avg: 4315.63 / Max: 4359.72Min: 11184.04 / Avg: 11231.48 / Max: 11320.99Min: 11010.8 / Avg: 11247.06 / Max: 11569.9Min: 15495.51 / Avg: 15642.74 / Max: 15887.49

PostMark

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceXen HVM DomUVirtualBoxKVM-QEMUBare Metal9001800270036004500SE +/- 37.23, N = 10SE +/- 34.80, N = 10SE +/- 72.83, N = 10SE +/- 0.00, N = 52409309033934166
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceXen HVM DomUVirtualBoxKVM-QEMUBare Metal7001400210028003500Min: 2272 / Avg: 2408.8 / Max: 2500Min: 2777 / Avg: 3090.2 / Max: 3125Min: 3125 / Avg: 3392.6 / Max: 3571Min: 4166 / Avg: 4166 / Max: 4166

SQLite

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryXen HVM DomUKVM-QEMUBare MetalVirtualBox130260390520650SE +/- 2.30, N = 3SE +/- 0.89, N = 3SE +/- 0.66, N = 3SE +/- 0.75, N = 3608.92416.75319.92147.70
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryXen HVM DomUKVM-QEMUBare MetalVirtualBox110220330440550Min: 604.47 / Avg: 608.92 / Max: 612.16Min: 415 / Avg: 416.75 / Max: 417.85Min: 319.15 / Avg: 319.92 / Max: 321.24Min: 146.67 / Avg: 147.7 / Max: 149.17