Xen HVM domU vs. KVM vs. VirtualBox - Ubuntu

Xen benchmarking from Ubuntu 11.10 on host and guest against KVM-QEMU on Ubuntu 11.10 and VirtualBox. Testing by Phoronix.com Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1110164-AR-1110169AR92
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

C/C++ Compiler Tests 7 Tests
CPU Massive 9 Tests
Creator Workloads 3 Tests
Cryptography 2 Tests
Disk Test Suite 2 Tests
HPC - High Performance Computing 2 Tests
Common Kernel Benchmarks 3 Tests
Multi-Core 6 Tests
Raytracing 2 Tests
Renderers 3 Tests
Server 3 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Bare Metal
October 16 2011
 
VirtualBox
October 16 2011
 
Xen HVM DomU
October 15 2011
 
KVM-QEMU
October 16 2011
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Xen HVM domU vs. KVM vs. VirtualBox - UbuntuProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionSystem LayerBare MetalVirtualBoxXen HVM DomUKVM-QEMUIntel Core i7-2630QM @ 2.00GHz (8 Cores)Compal PBL21Intel 2nd Generation Core Family8192MB128GB Super Talent STT_FTM28G225HNVIDIA GeForce GT 555M (672/900MHz)Realtek ALC259Realtek RTL8111/8168B + Atheros AR9285 WirelessUbuntu 11.103.0.0-12-generic (x86_64)Unity 4.22.0X Server 1.10.4nouveau 0.0.162.1 Mesa 7.11GCC 4.6.1ext41920x1080Intel Core i7-2630QM @ 1.99GHz (8 Cores)innotek VirtualBox v1.2Intel 440FX - 82441FX PMC6144MB42GB VBOX HDDInnoTek VirtualBoxIntel 82801AA AC 97 AudioVBOX monitorIntel 82540EM Gigabitvboxvideo 1.0.11920x1034VirtualBox 4.1.2_Ubuntur38459Intel Core i7-2630QM @ 2.00GHz (8 Cores)Xen HVM domU v4.1.132GBCirrus Logic GD 5446Ensoniq ES1370cirrus 1.3.21024x768Xen HVM domU 4.1.1QEMU Virtual 0.14.1 @ 2.00GHz (8 Cores)BochsRed Hat VirtioGeneric 1af4 ID 20Red Hat Virtio device2.1 Mesa 7.11QEMUOpenBenchmarking.orgSystem Details- VirtualBox: Disk Scheduler: CFQ.

Bare MetalVirtualBoxXen HVM DomUKVM-QEMULogarithmic Result OverviewPhoronix Test SuiteSQLiteApache BenchmarkPostMarkPOV-RayC-RayTimed MAFFT AlignmentJohn The RipperOpenSSLNAS Parallel Benchmarks7-Zip CompressionSmallptCLOMP

Xen HVM domU vs. KVM vs. VirtualBox - Ubuntuc-ray: Total Timepovray: Total Timesmallpt: Global Illumination Renderer; 100 Samplesjohn-the-ripper: Traditional DESjohn-the-ripper: MD5john-the-ripper: Blowfishopenssl: RSA 4096-bit Performancecompress-7zip: Compress Speed Testnpb: BT.Anpb: CG.Bnpb: EP.Bnpb: FT.Bnpb: IS.Cnpb: LU.Anpb: MG.Bnpb: SP.Anpb: UA.Amafft: Multiple Sequence Alignmentclomp: Static OMP Speedupapache: Static Web Page Servingpostmark: Disk Transaction Performancesqlite: Default Test DirectoryBare MetalVirtualBoxXen HVM DomUKVM-QEMU73.2590014434750001112471467.75133319483.242259.97157.694936.29141.828803.395262.674604.6932.0425.014.9015642.744166319.9286.1596215732576671056268363.93112958050.001944.04145.034308.0778.247893.534575.894093.8527.7126.954.014315.633090147.70107.6513281882397333762849146.7397717034.051671.94116.593777.3097.686254.723843.843405.6521.2236.434.2411231.482409608.9280.5290514633830001106371067.15117579134.722130.41154.364716.1287.878525.194980.324190.1528.6325.594.7011247.063393416.75OpenBenchmarking.org

C-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeBare MetalKVM-QEMUVirtualBoxXen HVM DomU20406080100SE +/- 0.47, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 3SE +/- 0.01, N = 373.2580.5286.15107.65
OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeBare MetalKVM-QEMUVirtualBoxXen HVM DomU20406080100Min: 72.73 / Avg: 73.25 / Max: 74.19Min: 80.32 / Avg: 80.52 / Max: 80.89Min: 85.69 / Avg: 86.15 / Max: 86.38Min: 107.64 / Avg: 107.65 / Max: 107.67

POV-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.6.1Total TimeBare MetalKVM-QEMUVirtualBoxXen HVM DomU300600900120015009009059621328

Smallpt

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesBare MetalKVM-QEMUVirtualBoxXen HVM DomU4080120160200SE +/- 1.20, N = 3SE +/- 1.33, N = 3SE +/- 1.15, N = 3SE +/- 0.00, N = 3144146157188
OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesBare MetalKVM-QEMUVirtualBoxXen HVM DomU306090120150Min: 142 / Avg: 144.33 / Max: 146Min: 143 / Avg: 145.67 / Max: 147Min: 155 / Avg: 157 / Max: 159Min: 188 / Avg: 188 / Max: 188

John The Ripper

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESBare MetalKVM-QEMUVirtualBoxXen HVM DomU700K1400K2100K2800K3500KSE +/- 50302.42, N = 3SE +/- 29365.51, N = 3SE +/- 7264.83, N = 3SE +/- 6641.62, N = 33475000338300032576672397333
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESBare MetalKVM-QEMUVirtualBoxXen HVM DomU600K1200K1800K2400K3000KMin: 3376000 / Avg: 3475000 / Max: 3540000Min: 3346000 / Avg: 3383000 / Max: 3441000Min: 3246000 / Avg: 3257666.67 / Max: 3271000Min: 2386000 / Avg: 2397333.33 / Max: 2409000

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Bare MetalKVM-QEMUVirtualBoxXen HVM DomU2K4K6K8K10KSE +/- 16.68, N = 3SE +/- 8.35, N = 3SE +/- 25.54, N = 3SE +/- 2.85, N = 31112411063105627628
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Bare MetalKVM-QEMUVirtualBoxXen HVM DomU2K4K6K8K10KMin: 11106 / Avg: 11123.67 / Max: 11157Min: 11046 / Avg: 11062.67 / Max: 11072Min: 10525 / Avg: 10562 / Max: 10611Min: 7622 / Avg: 7627.67 / Max: 7631

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishBare MetalKVM-QEMUVirtualBoxXen HVM DomU150300450600750SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 2.60, N = 3SE +/- 0.88, N = 3714710683491
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishBare MetalKVM-QEMUVirtualBoxXen HVM DomU130260390520650Min: 713 / Avg: 714.33 / Max: 716Min: 709 / Avg: 710.33 / Max: 712Min: 679 / Avg: 683.33 / Max: 688Min: 489 / Avg: 490.67 / Max: 492

OpenSSL

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceBare MetalKVM-QEMUVirtualBoxXen HVM DomU1530456075SE +/- 0.27, N = 4SE +/- 0.21, N = 4SE +/- 0.37, N = 4SE +/- 0.02, N = 467.7567.1563.9346.73
OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceBare MetalKVM-QEMUVirtualBoxXen HVM DomU1326395265Min: 67.3 / Avg: 67.75 / Max: 68.4Min: 66.7 / Avg: 67.15 / Max: 67.6Min: 63.3 / Avg: 63.93 / Max: 64.7Min: 46.7 / Avg: 46.73 / Max: 46.8

7-Zip Compression

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestBare MetalKVM-QEMUVirtualBoxXen HVM DomU3K6K9K12K15KSE +/- 219.83, N = 3SE +/- 70.24, N = 3SE +/- 48.81, N = 3SE +/- 81.83, N = 31333111757112959771
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestBare MetalKVM-QEMUVirtualBoxXen HVM DomU2K4K6K8K10KMin: 12891 / Avg: 13330.67 / Max: 13551Min: 11629 / Avg: 11757.33 / Max: 11871Min: 11198 / Avg: 11295 / Max: 11353Min: 9610 / Avg: 9770.67 / Max: 9878

NAS Parallel Benchmarks

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU2K4K6K8K10KSE +/- 32.43, N = 3SE +/- 30.12, N = 3SE +/- 38.28, N = 3SE +/- 11.02, N = 39483.249134.728050.007034.05
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU16003200480064008000Min: 9421.24 / Avg: 9483.24 / Max: 9530.73Min: 9082.01 / Avg: 9134.72 / Max: 9186.32Min: 8011.06 / Avg: 8050 / Max: 8126.55Min: 7012.07 / Avg: 7034.05 / Max: 7046.41

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU5001000150020002500SE +/- 1.12, N = 3SE +/- 16.10, N = 3SE +/- 0.99, N = 3SE +/- 1.06, N = 32259.972130.411944.041671.94
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU400800120016002000Min: 2257.95 / Avg: 2259.97 / Max: 2261.8Min: 2098.4 / Avg: 2130.41 / Max: 2149.4Min: 1942.49 / Avg: 1944.04 / Max: 1945.89Min: 1670.56 / Avg: 1671.94 / Max: 1674.03

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU306090120150SE +/- 1.01, N = 3SE +/- 0.64, N = 3SE +/- 0.40, N = 3SE +/- 0.07, N = 3157.69154.36145.03116.59
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU306090120150Min: 155.67 / Avg: 157.69 / Max: 158.79Min: 153.52 / Avg: 154.36 / Max: 155.62Min: 144.38 / Avg: 145.03 / Max: 145.76Min: 116.45 / Avg: 116.59 / Max: 116.68

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU11002200330044005500SE +/- 27.27, N = 3SE +/- 30.36, N = 3SE +/- 39.72, N = 3SE +/- 2.06, N = 34936.294716.124308.073777.30
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU9001800270036004500Min: 4884.45 / Avg: 4936.29 / Max: 4976.88Min: 4656.66 / Avg: 4716.12 / Max: 4756.51Min: 4234.29 / Avg: 4308.07 / Max: 4370.48Min: 3774.9 / Avg: 3777.3 / Max: 3781.39

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CBare MetalKVM-QEMUVirtualBoxXen HVM DomU306090120150SE +/- 0.32, N = 3SE +/- 2.73, N = 6SE +/- 2.55, N = 6SE +/- 0.06, N = 3141.8287.8778.2497.68
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CBare MetalKVM-QEMUVirtualBoxXen HVM DomU306090120150Min: 141.48 / Avg: 141.82 / Max: 142.45Min: 74.65 / Avg: 87.87 / Max: 92.63Min: 73.08 / Avg: 78.24 / Max: 87Min: 97.57 / Avg: 97.68 / Max: 97.75

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU2K4K6K8K10KSE +/- 435.53, N = 6SE +/- 118.14, N = 6SE +/- 76.11, N = 3SE +/- 7.03, N = 38803.398525.197893.536254.72
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU15003000450060007500Min: 6646.6 / Avg: 8803.39 / Max: 9362.73Min: 7959.83 / Avg: 8525.19 / Max: 8711.29Min: 7746.38 / Avg: 7893.53 / Max: 8000.84Min: 6240.89 / Avg: 6254.72 / Max: 6263.81

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU11002200330044005500SE +/- 4.12, N = 3SE +/- 18.27, N = 3SE +/- 28.77, N = 3SE +/- 222.22, N = 65262.674980.324575.893843.84
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BBare MetalKVM-QEMUVirtualBoxXen HVM DomU9001800270036004500Min: 5255.86 / Avg: 5262.67 / Max: 5270.09Min: 4961.46 / Avg: 4980.32 / Max: 5016.86Min: 4535.45 / Avg: 4575.89 / Max: 4631.56Min: 2735.36 / Avg: 3843.84 / Max: 4128.66

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU10002000300040005000SE +/- 11.34, N = 3SE +/- 72.35, N = 6SE +/- 16.78, N = 3SE +/- 41.04, N = 34604.694190.154093.853405.65
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU8001600240032004000Min: 4590.75 / Avg: 4604.69 / Max: 4627.16Min: 3938.36 / Avg: 4190.15 / Max: 4376.34Min: 4060.93 / Avg: 4093.85 / Max: 4115.96Min: 3324.6 / Avg: 3405.65 / Max: 3457.34

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU714212835SE +/- 0.05, N = 3SE +/- 0.50, N = 3SE +/- 0.07, N = 3SE +/- 0.67, N = 632.0428.6327.7121.22
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.ABare MetalKVM-QEMUVirtualBoxXen HVM DomU714212835Min: 31.96 / Avg: 32.04 / Max: 32.13Min: 27.83 / Avg: 28.63 / Max: 29.54Min: 27.61 / Avg: 27.71 / Max: 27.84Min: 17.99 / Avg: 21.22 / Max: 22.47

Timed MAFFT Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentBare MetalKVM-QEMUVirtualBoxXen HVM DomU816243240SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 325.0125.5926.9536.43
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentBare MetalKVM-QEMUVirtualBoxXen HVM DomU816243240Min: 24.95 / Avg: 25.01 / Max: 25.08Min: 25.58 / Avg: 25.59 / Max: 25.6Min: 26.94 / Avg: 26.95 / Max: 26.98Min: 36.42 / Avg: 36.43 / Max: 36.45

CLOMP

CLOMP is the C version of the Livermore OpenMP benchmark developed to measure OpenMP overheads and other performance impacts due to threading in order to influence future system designs. This particular test profile configuration is currently set to look at the OpenMP static schedule speed-up across all available CPU cores using the recommended test configuration. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupBare MetalKVM-QEMUVirtualBoxXen HVM DomU1.10252.2053.30754.415.5125SE +/- 0.04, N = 5SE +/- 0.09, N = 10SE +/- 0.13, N = 10SE +/- 0.03, N = 54.904.704.014.24
OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupBare MetalKVM-QEMUVirtualBoxXen HVM DomU246810Min: 4.79 / Avg: 4.9 / Max: 5.03Min: 3.95 / Avg: 4.7 / Max: 4.92Min: 3.22 / Avg: 4.01 / Max: 4.47Min: 4.16 / Avg: 4.24 / Max: 4.3

Apache Benchmark

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingBare MetalKVM-QEMUVirtualBoxXen HVM DomU3K6K9K12K15KSE +/- 123.21, N = 3SE +/- 167.10, N = 3SE +/- 22.06, N = 3SE +/- 44.78, N = 315642.7411247.064315.6311231.48
OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingBare MetalKVM-QEMUVirtualBoxXen HVM DomU3K6K9K12K15KMin: 15495.51 / Avg: 15642.74 / Max: 15887.49Min: 11010.8 / Avg: 11247.06 / Max: 11569.9Min: 4292.16 / Avg: 4315.63 / Max: 4359.72Min: 11184.04 / Avg: 11231.48 / Max: 11320.99

PostMark

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceBare MetalKVM-QEMUVirtualBoxXen HVM DomU9001800270036004500SE +/- 0.00, N = 5SE +/- 72.83, N = 10SE +/- 34.80, N = 10SE +/- 37.23, N = 104166339330902409
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceBare MetalKVM-QEMUVirtualBoxXen HVM DomU7001400210028003500Min: 4166 / Avg: 4166 / Max: 4166Min: 3125 / Avg: 3392.6 / Max: 3571Min: 2777 / Avg: 3090.2 / Max: 3125Min: 2272 / Avg: 2408.8 / Max: 2500

SQLite

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryBare MetalKVM-QEMUVirtualBoxXen HVM DomU130260390520650SE +/- 0.66, N = 3SE +/- 0.89, N = 3SE +/- 0.75, N = 3SE +/- 2.30, N = 3319.92416.75147.70608.92
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryBare MetalKVM-QEMUVirtualBoxXen HVM DomU110220330440550Min: 319.15 / Avg: 319.92 / Max: 321.24Min: 415 / Avg: 416.75 / Max: 417.85Min: 146.67 / Avg: 147.7 / Max: 149.17Min: 604.47 / Avg: 608.92 / Max: 612.16