Xen HVM domU vs. KVM vs. VirtualBox - Ubuntu

Xen benchmarking from Ubuntu 11.10 on host and guest against KVM-QEMU on Ubuntu 11.10 and VirtualBox. Testing by Phoronix.com Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1110164-AR-1110169AR92
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

C/C++ Compiler Tests 7 Tests
CPU Massive 9 Tests
Creator Workloads 3 Tests
Cryptography 2 Tests
Disk Test Suite 2 Tests
HPC - High Performance Computing 2 Tests
Common Kernel Benchmarks 3 Tests
Multi-Core 6 Tests
Raytracing 2 Tests
Renderers 3 Tests
Server 3 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Bare Metal
October 16 2011
 
VirtualBox
October 16 2011
 
Xen HVM DomU
October 15 2011
 
KVM-QEMU
October 16 2011
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Xen HVM domU vs. KVM vs. VirtualBox - UbuntuProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionSystem LayerBare MetalVirtualBoxXen HVM DomUKVM-QEMUIntel Core i7-2630QM @ 2.00GHz (8 Cores)Compal PBL21Intel 2nd Generation Core Family8192MB128GB Super Talent STT_FTM28G225HNVIDIA GeForce GT 555M (672/900MHz)Realtek ALC259Realtek RTL8111/8168B + Atheros AR9285 WirelessUbuntu 11.103.0.0-12-generic (x86_64)Unity 4.22.0X Server 1.10.4nouveau 0.0.162.1 Mesa 7.11GCC 4.6.1ext41920x1080Intel Core i7-2630QM @ 1.99GHz (8 Cores)innotek VirtualBox v1.2Intel 440FX - 82441FX PMC6144MB42GB VBOX HDDInnoTek VirtualBoxIntel 82801AA AC 97 AudioVBOX monitorIntel 82540EM Gigabitvboxvideo 1.0.11920x1034VirtualBox 4.1.2_Ubuntur38459Intel Core i7-2630QM @ 2.00GHz (8 Cores)Xen HVM domU v4.1.132GBCirrus Logic GD 5446Ensoniq ES1370cirrus 1.3.21024x768Xen HVM domU 4.1.1QEMU Virtual 0.14.1 @ 2.00GHz (8 Cores)BochsRed Hat VirtioGeneric 1af4 ID 20Red Hat Virtio device2.1 Mesa 7.11QEMUOpenBenchmarking.orgSystem Details- VirtualBox: Disk Scheduler: CFQ.

Bare MetalVirtualBoxXen HVM DomUKVM-QEMULogarithmic Result OverviewPhoronix Test SuiteSQLiteApache BenchmarkPostMarkPOV-RayC-RayTimed MAFFT AlignmentJohn The RipperOpenSSLNAS Parallel Benchmarks7-Zip CompressionSmallptCLOMP

Xen HVM domU vs. KVM vs. VirtualBox - Ubuntuc-ray: Total Timepovray: Total Timesmallpt: Global Illumination Renderer; 100 Samplesjohn-the-ripper: Traditional DESjohn-the-ripper: MD5john-the-ripper: Blowfishopenssl: RSA 4096-bit Performancecompress-7zip: Compress Speed Testnpb: BT.Anpb: CG.Bnpb: EP.Bnpb: FT.Bnpb: IS.Cnpb: LU.Anpb: MG.Bnpb: SP.Anpb: UA.Amafft: Multiple Sequence Alignmentclomp: Static OMP Speedupapache: Static Web Page Servingpostmark: Disk Transaction Performancesqlite: Default Test DirectoryBare MetalVirtualBoxXen HVM DomUKVM-QEMU73.2590014434750001112471467.75133319483.242259.97157.694936.29141.828803.395262.674604.6932.0425.014.9015642.744166319.9286.1596215732576671056268363.93112958050.001944.04145.034308.0778.247893.534575.894093.8527.7126.954.014315.633090147.70107.6513281882397333762849146.7397717034.051671.94116.593777.3097.686254.723843.843405.6521.2236.434.2411231.482409608.9280.5290514633830001106371067.15117579134.722130.41154.364716.1287.878525.194980.324190.1528.6325.594.7011247.063393416.75OpenBenchmarking.org

C-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeBare MetalVirtualBoxXen HVM DomUKVM-QEMU20406080100SE +/- 0.47, N = 3SE +/- 0.23, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 373.2586.15107.6580.52
OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeBare MetalVirtualBoxXen HVM DomUKVM-QEMU20406080100Min: 72.73 / Avg: 73.25 / Max: 74.19Min: 85.69 / Avg: 86.15 / Max: 86.38Min: 107.64 / Avg: 107.65 / Max: 107.67Min: 80.32 / Avg: 80.52 / Max: 80.89

POV-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.6.1Total TimeBare MetalVirtualBoxXen HVM DomUKVM-QEMU300600900120015009009621328905

Smallpt

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesBare MetalVirtualBoxXen HVM DomUKVM-QEMU4080120160200SE +/- 1.20, N = 3SE +/- 1.15, N = 3SE +/- 0.00, N = 3SE +/- 1.33, N = 3144157188146
OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesBare MetalVirtualBoxXen HVM DomUKVM-QEMU306090120150Min: 142 / Avg: 144.33 / Max: 146Min: 155 / Avg: 157 / Max: 159Min: 188 / Avg: 188 / Max: 188Min: 143 / Avg: 145.67 / Max: 147

John The Ripper

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESBare MetalVirtualBoxXen HVM DomUKVM-QEMU700K1400K2100K2800K3500KSE +/- 50302.42, N = 3SE +/- 7264.83, N = 3SE +/- 6641.62, N = 3SE +/- 29365.51, N = 33475000325766723973333383000
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESBare MetalVirtualBoxXen HVM DomUKVM-QEMU600K1200K1800K2400K3000KMin: 3376000 / Avg: 3475000 / Max: 3540000Min: 3246000 / Avg: 3257666.67 / Max: 3271000Min: 2386000 / Avg: 2397333.33 / Max: 2409000Min: 3346000 / Avg: 3383000 / Max: 3441000

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Bare MetalVirtualBoxXen HVM DomUKVM-QEMU2K4K6K8K10KSE +/- 16.68, N = 3SE +/- 25.54, N = 3SE +/- 2.85, N = 3SE +/- 8.35, N = 31112410562762811063
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Bare MetalVirtualBoxXen HVM DomUKVM-QEMU2K4K6K8K10KMin: 11106 / Avg: 11123.67 / Max: 11157Min: 10525 / Avg: 10562 / Max: 10611Min: 7622 / Avg: 7627.67 / Max: 7631Min: 11046 / Avg: 11062.67 / Max: 11072

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishBare MetalVirtualBoxXen HVM DomUKVM-QEMU150300450600750SE +/- 0.88, N = 3SE +/- 2.60, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3714683491710
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishBare MetalVirtualBoxXen HVM DomUKVM-QEMU130260390520650Min: 713 / Avg: 714.33 / Max: 716Min: 679 / Avg: 683.33 / Max: 688Min: 489 / Avg: 490.67 / Max: 492Min: 709 / Avg: 710.33 / Max: 712

OpenSSL

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceBare MetalVirtualBoxXen HVM DomUKVM-QEMU1530456075SE +/- 0.27, N = 4SE +/- 0.37, N = 4SE +/- 0.02, N = 4SE +/- 0.21, N = 467.7563.9346.7367.15
OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceBare MetalVirtualBoxXen HVM DomUKVM-QEMU1326395265Min: 67.3 / Avg: 67.75 / Max: 68.4Min: 63.3 / Avg: 63.93 / Max: 64.7Min: 46.7 / Avg: 46.73 / Max: 46.8Min: 66.7 / Avg: 67.15 / Max: 67.6

7-Zip Compression

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestBare MetalVirtualBoxXen HVM DomUKVM-QEMU3K6K9K12K15KSE +/- 219.83, N = 3SE +/- 48.81, N = 3SE +/- 81.83, N = 3SE +/- 70.24, N = 31333111295977111757
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestBare MetalVirtualBoxXen HVM DomUKVM-QEMU2K4K6K8K10KMin: 12891 / Avg: 13330.67 / Max: 13551Min: 11198 / Avg: 11295 / Max: 11353Min: 9610 / Avg: 9770.67 / Max: 9878Min: 11629 / Avg: 11757.33 / Max: 11871

NAS Parallel Benchmarks

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU2K4K6K8K10KSE +/- 32.43, N = 3SE +/- 38.28, N = 3SE +/- 11.02, N = 3SE +/- 30.12, N = 39483.248050.007034.059134.72
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU16003200480064008000Min: 9421.24 / Avg: 9483.24 / Max: 9530.73Min: 8011.06 / Avg: 8050 / Max: 8126.55Min: 7012.07 / Avg: 7034.05 / Max: 7046.41Min: 9082.01 / Avg: 9134.72 / Max: 9186.32

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU5001000150020002500SE +/- 1.12, N = 3SE +/- 0.99, N = 3SE +/- 1.06, N = 3SE +/- 16.10, N = 32259.971944.041671.942130.41
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU400800120016002000Min: 2257.95 / Avg: 2259.97 / Max: 2261.8Min: 1942.49 / Avg: 1944.04 / Max: 1945.89Min: 1670.56 / Avg: 1671.94 / Max: 1674.03Min: 2098.4 / Avg: 2130.41 / Max: 2149.4

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU306090120150SE +/- 1.01, N = 3SE +/- 0.40, N = 3SE +/- 0.07, N = 3SE +/- 0.64, N = 3157.69145.03116.59154.36
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU306090120150Min: 155.67 / Avg: 157.69 / Max: 158.79Min: 144.38 / Avg: 145.03 / Max: 145.76Min: 116.45 / Avg: 116.59 / Max: 116.68Min: 153.52 / Avg: 154.36 / Max: 155.62

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU11002200330044005500SE +/- 27.27, N = 3SE +/- 39.72, N = 3SE +/- 2.06, N = 3SE +/- 30.36, N = 34936.294308.073777.304716.12
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU9001800270036004500Min: 4884.45 / Avg: 4936.29 / Max: 4976.88Min: 4234.29 / Avg: 4308.07 / Max: 4370.48Min: 3774.9 / Avg: 3777.3 / Max: 3781.39Min: 4656.66 / Avg: 4716.12 / Max: 4756.51

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CBare MetalVirtualBoxXen HVM DomUKVM-QEMU306090120150SE +/- 0.32, N = 3SE +/- 2.55, N = 6SE +/- 0.06, N = 3SE +/- 2.73, N = 6141.8278.2497.6887.87
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CBare MetalVirtualBoxXen HVM DomUKVM-QEMU306090120150Min: 141.48 / Avg: 141.82 / Max: 142.45Min: 73.08 / Avg: 78.24 / Max: 87Min: 97.57 / Avg: 97.68 / Max: 97.75Min: 74.65 / Avg: 87.87 / Max: 92.63

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU2K4K6K8K10KSE +/- 435.53, N = 6SE +/- 76.11, N = 3SE +/- 7.03, N = 3SE +/- 118.14, N = 68803.397893.536254.728525.19
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU15003000450060007500Min: 6646.6 / Avg: 8803.39 / Max: 9362.73Min: 7746.38 / Avg: 7893.53 / Max: 8000.84Min: 6240.89 / Avg: 6254.72 / Max: 6263.81Min: 7959.83 / Avg: 8525.19 / Max: 8711.29

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU11002200330044005500SE +/- 4.12, N = 3SE +/- 28.77, N = 3SE +/- 222.22, N = 6SE +/- 18.27, N = 35262.674575.893843.844980.32
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BBare MetalVirtualBoxXen HVM DomUKVM-QEMU9001800270036004500Min: 5255.86 / Avg: 5262.67 / Max: 5270.09Min: 4535.45 / Avg: 4575.89 / Max: 4631.56Min: 2735.36 / Avg: 3843.84 / Max: 4128.66Min: 4961.46 / Avg: 4980.32 / Max: 5016.86

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU10002000300040005000SE +/- 11.34, N = 3SE +/- 16.78, N = 3SE +/- 41.04, N = 3SE +/- 72.35, N = 64604.694093.853405.654190.15
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU8001600240032004000Min: 4590.75 / Avg: 4604.69 / Max: 4627.16Min: 4060.93 / Avg: 4093.85 / Max: 4115.96Min: 3324.6 / Avg: 3405.65 / Max: 3457.34Min: 3938.36 / Avg: 4190.15 / Max: 4376.34

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU714212835SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.67, N = 6SE +/- 0.50, N = 332.0427.7121.2228.63
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.ABare MetalVirtualBoxXen HVM DomUKVM-QEMU714212835Min: 31.96 / Avg: 32.04 / Max: 32.13Min: 27.61 / Avg: 27.71 / Max: 27.84Min: 17.99 / Avg: 21.22 / Max: 22.47Min: 27.83 / Avg: 28.63 / Max: 29.54

Timed MAFFT Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentBare MetalVirtualBoxXen HVM DomUKVM-QEMU816243240SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 325.0126.9536.4325.59
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentBare MetalVirtualBoxXen HVM DomUKVM-QEMU816243240Min: 24.95 / Avg: 25.01 / Max: 25.08Min: 26.94 / Avg: 26.95 / Max: 26.98Min: 36.42 / Avg: 36.43 / Max: 36.45Min: 25.58 / Avg: 25.59 / Max: 25.6

CLOMP

CLOMP is the C version of the Livermore OpenMP benchmark developed to measure OpenMP overheads and other performance impacts due to threading in order to influence future system designs. This particular test profile configuration is currently set to look at the OpenMP static schedule speed-up across all available CPU cores using the recommended test configuration. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupBare MetalVirtualBoxXen HVM DomUKVM-QEMU1.10252.2053.30754.415.5125SE +/- 0.04, N = 5SE +/- 0.13, N = 10SE +/- 0.03, N = 5SE +/- 0.09, N = 104.904.014.244.70
OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupBare MetalVirtualBoxXen HVM DomUKVM-QEMU246810Min: 4.79 / Avg: 4.9 / Max: 5.03Min: 3.22 / Avg: 4.01 / Max: 4.47Min: 4.16 / Avg: 4.24 / Max: 4.3Min: 3.95 / Avg: 4.7 / Max: 4.92

Apache Benchmark

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingBare MetalVirtualBoxXen HVM DomUKVM-QEMU3K6K9K12K15KSE +/- 123.21, N = 3SE +/- 22.06, N = 3SE +/- 44.78, N = 3SE +/- 167.10, N = 315642.744315.6311231.4811247.06
OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingBare MetalVirtualBoxXen HVM DomUKVM-QEMU3K6K9K12K15KMin: 15495.51 / Avg: 15642.74 / Max: 15887.49Min: 4292.16 / Avg: 4315.63 / Max: 4359.72Min: 11184.04 / Avg: 11231.48 / Max: 11320.99Min: 11010.8 / Avg: 11247.06 / Max: 11569.9

PostMark

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceBare MetalVirtualBoxXen HVM DomUKVM-QEMU9001800270036004500SE +/- 0.00, N = 5SE +/- 34.80, N = 10SE +/- 37.23, N = 10SE +/- 72.83, N = 104166309024093393
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceBare MetalVirtualBoxXen HVM DomUKVM-QEMU7001400210028003500Min: 4166 / Avg: 4166 / Max: 4166Min: 2777 / Avg: 3090.2 / Max: 3125Min: 2272 / Avg: 2408.8 / Max: 2500Min: 3125 / Avg: 3392.6 / Max: 3571

SQLite

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryBare MetalVirtualBoxXen HVM DomUKVM-QEMU130260390520650SE +/- 0.66, N = 3SE +/- 0.75, N = 3SE +/- 2.30, N = 3SE +/- 0.89, N = 3319.92147.70608.92416.75
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryBare MetalVirtualBoxXen HVM DomUKVM-QEMU110220330440550Min: 319.15 / Avg: 319.92 / Max: 321.24Min: 146.67 / Avg: 147.7 / Max: 149.17Min: 604.47 / Avg: 608.92 / Max: 612.16Min: 415 / Avg: 416.75 / Max: 417.85