Xen HVM domU vs. KVM vs. VirtualBox - Ubuntu

Xen benchmarking from Ubuntu 11.10 on host and guest against KVM-QEMU on Ubuntu 11.10 and VirtualBox. Testing by Phoronix.com Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1110164-AR-1110169AR92
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

C/C++ Compiler Tests 7 Tests
CPU Massive 9 Tests
Creator Workloads 3 Tests
Cryptography 2 Tests
Disk Test Suite 2 Tests
HPC - High Performance Computing 2 Tests
Common Kernel Benchmarks 3 Tests
Multi-Core 6 Tests
Raytracing 2 Tests
Renderers 3 Tests
Server 3 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Bare Metal
October 16 2011
 
VirtualBox
October 16 2011
 
Xen HVM DomU
October 15 2011
 
KVM-QEMU
October 16 2011
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Xen HVM domU vs. KVM vs. VirtualBox - UbuntuProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelDesktopDisplay ServerDisplay DriverCompilerFile-SystemScreen ResolutionSystem LayerOpenGLXen HVM DomUKVM-QEMUVirtualBoxBare MetalIntel Core i7-2630QM @ 2.00GHz (8 Cores)Xen HVM domU v4.1.1Intel 440FX - 82441FX PMC6144MB32GBCirrus Logic GD 5446Ensoniq ES1370Ubuntu 11.103.0.0-12-generic (x86_64)Unity 4.22.0X Server 1.10.4cirrus 1.3.2GCC 4.6.1ext41024x768Xen HVM domU 4.1.1QEMU Virtual 0.14.1 @ 2.00GHz (8 Cores)BochsRed Hat VirtioGeneric 1af4 ID 20Red Hat Virtio device2.1 Mesa 7.11QEMUIntel Core i7-2630QM @ 1.99GHz (8 Cores)innotek VirtualBox v1.2Intel 440FX - 82441FX PMC42GB VBOX HDDInnoTek VirtualBoxIntel 82801AA AC 97 AudioVBOX monitorIntel 82540EM Gigabitvboxvideo 1.0.11920x1034VirtualBox 4.1.2_Ubuntur38459Intel Core i7-2630QM @ 2.00GHz (8 Cores)Compal PBL21Intel 2nd Generation Core Family8192MB128GB Super Talent STT_FTM28G225HNVIDIA GeForce GT 555M (672/900MHz)Realtek ALC259Realtek RTL8111/8168B + Atheros AR9285 Wirelessnouveau 0.0.161920x1080OpenBenchmarking.orgSystem Details- VirtualBox: Disk Scheduler: CFQ.

Xen HVM DomUKVM-QEMUVirtualBoxBare MetalLogarithmic Result OverviewPhoronix Test SuiteSQLiteApache BenchmarkPostMarkPOV-RayC-RayTimed MAFFT AlignmentJohn The RipperOpenSSLNAS Parallel Benchmarks7-Zip CompressionSmallptCLOMP

Xen HVM domU vs. KVM vs. VirtualBox - Ubuntusqlite: Default Test Directorypostmark: Disk Transaction Performanceapache: Static Web Page Servingclomp: Static OMP Speedupmafft: Multiple Sequence Alignmentnpb: UA.Anpb: SP.Anpb: MG.Bnpb: LU.Anpb: IS.Cnpb: FT.Bnpb: EP.Bnpb: CG.Bnpb: BT.Acompress-7zip: Compress Speed Testopenssl: RSA 4096-bit Performancejohn-the-ripper: Blowfishjohn-the-ripper: MD5john-the-ripper: Traditional DESsmallpt: Global Illumination Renderer; 100 Samplespovray: Total Timec-ray: Total TimeXen HVM DomUKVM-QEMUVirtualBoxBare Metal608.92240911231.484.2436.4321.223405.653843.846254.7297.683777.30116.591671.947034.05977146.73491762823973331881328107.65416.75339311247.064.7025.5928.634190.154980.328525.1987.874716.12154.362130.419134.721175767.1571011063338300014690580.52147.7030904315.634.0126.9527.714093.854575.897893.5378.244308.07145.031944.048050.001129563.9368310562325766715796286.15319.92416615642.744.9025.0132.044604.695262.678803.39141.824936.29157.692259.979483.241333167.7571411124347500014490073.25OpenBenchmarking.org

SQLite

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryXen HVM DomUKVM-QEMUVirtualBoxBare Metal130260390520650SE +/- 2.30, N = 3SE +/- 0.89, N = 3SE +/- 0.75, N = 3SE +/- 0.66, N = 3608.92416.75147.70319.92
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.3Test Target: Default Test DirectoryXen HVM DomUKVM-QEMUVirtualBoxBare Metal110220330440550Min: 604.47 / Avg: 608.92 / Max: 612.16Min: 415 / Avg: 416.75 / Max: 417.85Min: 146.67 / Avg: 147.7 / Max: 149.17Min: 319.15 / Avg: 319.92 / Max: 321.24

PostMark

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceXen HVM DomUKVM-QEMUVirtualBoxBare Metal9001800270036004500SE +/- 37.23, N = 10SE +/- 72.83, N = 10SE +/- 34.80, N = 10SE +/- 0.00, N = 52409339330904166
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceXen HVM DomUKVM-QEMUVirtualBoxBare Metal7001400210028003500Min: 2272 / Avg: 2408.8 / Max: 2500Min: 3125 / Avg: 3392.6 / Max: 3571Min: 2777 / Avg: 3090.2 / Max: 3125Min: 4166 / Avg: 4166 / Max: 4166

Apache Benchmark

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingXen HVM DomUKVM-QEMUVirtualBoxBare Metal3K6K9K12K15KSE +/- 44.78, N = 3SE +/- 167.10, N = 3SE +/- 22.06, N = 3SE +/- 123.21, N = 311231.4811247.064315.6315642.74
OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page ServingXen HVM DomUKVM-QEMUVirtualBoxBare Metal3K6K9K12K15KMin: 11184.04 / Avg: 11231.48 / Max: 11320.99Min: 11010.8 / Avg: 11247.06 / Max: 11569.9Min: 4292.16 / Avg: 4315.63 / Max: 4359.72Min: 15495.51 / Avg: 15642.74 / Max: 15887.49

CLOMP

CLOMP is the C version of the Livermore OpenMP benchmark developed to measure OpenMP overheads and other performance impacts due to threading in order to influence future system designs. This particular test profile configuration is currently set to look at the OpenMP static schedule speed-up across all available CPU cores using the recommended test configuration. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupXen HVM DomUKVM-QEMUVirtualBoxBare Metal1.10252.2053.30754.415.5125SE +/- 0.03, N = 5SE +/- 0.09, N = 10SE +/- 0.13, N = 10SE +/- 0.04, N = 54.244.704.014.90
OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupXen HVM DomUKVM-QEMUVirtualBoxBare Metal246810Min: 4.16 / Avg: 4.24 / Max: 4.3Min: 3.95 / Avg: 4.7 / Max: 4.92Min: 3.22 / Avg: 4.01 / Max: 4.47Min: 4.79 / Avg: 4.9 / Max: 5.03

Timed MAFFT Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentXen HVM DomUKVM-QEMUVirtualBoxBare Metal816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 336.4325.5926.9525.01
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.706Multiple Sequence AlignmentXen HVM DomUKVM-QEMUVirtualBoxBare Metal816243240Min: 36.42 / Avg: 36.43 / Max: 36.45Min: 25.58 / Avg: 25.59 / Max: 25.6Min: 26.94 / Avg: 26.95 / Max: 26.98Min: 24.95 / Avg: 25.01 / Max: 25.08

NAS Parallel Benchmarks

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal714212835SE +/- 0.67, N = 6SE +/- 0.50, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 321.2228.6327.7132.04
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: UA.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal714212835Min: 17.99 / Avg: 21.22 / Max: 22.47Min: 27.83 / Avg: 28.63 / Max: 29.54Min: 27.61 / Avg: 27.71 / Max: 27.84Min: 31.96 / Avg: 32.04 / Max: 32.13

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal10002000300040005000SE +/- 41.04, N = 3SE +/- 72.35, N = 6SE +/- 16.78, N = 3SE +/- 11.34, N = 33405.654190.154093.854604.69
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: SP.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal8001600240032004000Min: 3324.6 / Avg: 3405.65 / Max: 3457.34Min: 3938.36 / Avg: 4190.15 / Max: 4376.34Min: 4060.93 / Avg: 4093.85 / Max: 4115.96Min: 4590.75 / Avg: 4604.69 / Max: 4627.16

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal11002200330044005500SE +/- 222.22, N = 6SE +/- 18.27, N = 3SE +/- 28.77, N = 3SE +/- 4.12, N = 33843.844980.324575.895262.67
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: MG.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal9001800270036004500Min: 2735.36 / Avg: 3843.84 / Max: 4128.66Min: 4961.46 / Avg: 4980.32 / Max: 5016.86Min: 4535.45 / Avg: 4575.89 / Max: 4631.56Min: 5255.86 / Avg: 5262.67 / Max: 5270.09

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal2K4K6K8K10KSE +/- 7.03, N = 3SE +/- 118.14, N = 6SE +/- 76.11, N = 3SE +/- 435.53, N = 66254.728525.197893.538803.39
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal15003000450060007500Min: 6240.89 / Avg: 6254.72 / Max: 6263.81Min: 7959.83 / Avg: 8525.19 / Max: 8711.29Min: 7746.38 / Avg: 7893.53 / Max: 8000.84Min: 6646.6 / Avg: 8803.39 / Max: 9362.73

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CXen HVM DomUKVM-QEMUVirtualBoxBare Metal306090120150SE +/- 0.06, N = 3SE +/- 2.73, N = 6SE +/- 2.55, N = 6SE +/- 0.32, N = 397.6887.8778.24141.82
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: IS.CXen HVM DomUKVM-QEMUVirtualBoxBare Metal306090120150Min: 97.57 / Avg: 97.68 / Max: 97.75Min: 74.65 / Avg: 87.87 / Max: 92.63Min: 73.08 / Avg: 78.24 / Max: 87Min: 141.48 / Avg: 141.82 / Max: 142.45

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal11002200330044005500SE +/- 2.06, N = 3SE +/- 30.36, N = 3SE +/- 39.72, N = 3SE +/- 27.27, N = 33777.304716.124308.074936.29
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: FT.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal9001800270036004500Min: 3774.9 / Avg: 3777.3 / Max: 3781.39Min: 4656.66 / Avg: 4716.12 / Max: 4756.51Min: 4234.29 / Avg: 4308.07 / Max: 4370.48Min: 4884.45 / Avg: 4936.29 / Max: 4976.88

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal306090120150SE +/- 0.07, N = 3SE +/- 0.64, N = 3SE +/- 0.40, N = 3SE +/- 1.01, N = 3116.59154.36145.03157.69
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal306090120150Min: 116.45 / Avg: 116.59 / Max: 116.68Min: 153.52 / Avg: 154.36 / Max: 155.62Min: 144.38 / Avg: 145.03 / Max: 145.76Min: 155.67 / Avg: 157.69 / Max: 158.79

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal5001000150020002500SE +/- 1.06, N = 3SE +/- 16.10, N = 3SE +/- 0.99, N = 3SE +/- 1.12, N = 31671.942130.411944.042259.97
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: CG.BXen HVM DomUKVM-QEMUVirtualBoxBare Metal400800120016002000Min: 1670.56 / Avg: 1671.94 / Max: 1674.03Min: 2098.4 / Avg: 2130.41 / Max: 2149.4Min: 1942.49 / Avg: 1944.04 / Max: 1945.89Min: 2257.95 / Avg: 2259.97 / Max: 2261.8

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal2K4K6K8K10KSE +/- 11.02, N = 3SE +/- 30.12, N = 3SE +/- 38.28, N = 3SE +/- 32.43, N = 37034.059134.728050.009483.24
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: BT.AXen HVM DomUKVM-QEMUVirtualBoxBare Metal16003200480064008000Min: 7012.07 / Avg: 7034.05 / Max: 7046.41Min: 9082.01 / Avg: 9134.72 / Max: 9186.32Min: 8011.06 / Avg: 8050 / Max: 8126.55Min: 9421.24 / Avg: 9483.24 / Max: 9530.73

7-Zip Compression

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestXen HVM DomUKVM-QEMUVirtualBoxBare Metal3K6K9K12K15KSE +/- 81.83, N = 3SE +/- 70.24, N = 3SE +/- 48.81, N = 3SE +/- 219.83, N = 39771117571129513331
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed TestXen HVM DomUKVM-QEMUVirtualBoxBare Metal2K4K6K8K10KMin: 9610 / Avg: 9770.67 / Max: 9878Min: 11629 / Avg: 11757.33 / Max: 11871Min: 11198 / Avg: 11295 / Max: 11353Min: 12891 / Avg: 13330.67 / Max: 13551

OpenSSL

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceXen HVM DomUKVM-QEMUVirtualBoxBare Metal1530456075SE +/- 0.02, N = 4SE +/- 0.21, N = 4SE +/- 0.37, N = 4SE +/- 0.27, N = 446.7367.1563.9367.75
OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit PerformanceXen HVM DomUKVM-QEMUVirtualBoxBare Metal1326395265Min: 46.7 / Avg: 46.73 / Max: 46.8Min: 66.7 / Avg: 67.15 / Max: 67.6Min: 63.3 / Avg: 63.93 / Max: 64.7Min: 67.3 / Avg: 67.75 / Max: 68.4

John The Ripper

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishXen HVM DomUKVM-QEMUVirtualBoxBare Metal150300450600750SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 2.60, N = 3SE +/- 0.88, N = 3491710683714
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: BlowfishXen HVM DomUKVM-QEMUVirtualBoxBare Metal130260390520650Min: 489 / Avg: 490.67 / Max: 492Min: 709 / Avg: 710.33 / Max: 712Min: 679 / Avg: 683.33 / Max: 688Min: 713 / Avg: 714.33 / Max: 716

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Xen HVM DomUKVM-QEMUVirtualBoxBare Metal2K4K6K8K10KSE +/- 2.85, N = 3SE +/- 8.35, N = 3SE +/- 25.54, N = 3SE +/- 16.68, N = 37628110631056211124
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: MD5Xen HVM DomUKVM-QEMUVirtualBoxBare Metal2K4K6K8K10KMin: 7622 / Avg: 7627.67 / Max: 7631Min: 11046 / Avg: 11062.67 / Max: 11072Min: 10525 / Avg: 10562 / Max: 10611Min: 11106 / Avg: 11123.67 / Max: 11157

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESXen HVM DomUKVM-QEMUVirtualBoxBare Metal700K1400K2100K2800K3500KSE +/- 6641.62, N = 3SE +/- 29365.51, N = 3SE +/- 7264.83, N = 3SE +/- 50302.42, N = 32397333338300032576673475000
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.8Test: Traditional DESXen HVM DomUKVM-QEMUVirtualBoxBare Metal600K1200K1800K2400K3000KMin: 2386000 / Avg: 2397333.33 / Max: 2409000Min: 3346000 / Avg: 3383000 / Max: 3441000Min: 3246000 / Avg: 3257666.67 / Max: 3271000Min: 3376000 / Avg: 3475000 / Max: 3540000

Smallpt

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesXen HVM DomUKVM-QEMUVirtualBoxBare Metal4080120160200SE +/- 0.00, N = 3SE +/- 1.33, N = 3SE +/- 1.15, N = 3SE +/- 1.20, N = 3188146157144
OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesXen HVM DomUKVM-QEMUVirtualBoxBare Metal306090120150Min: 188 / Avg: 188 / Max: 188Min: 143 / Avg: 145.67 / Max: 147Min: 155 / Avg: 157 / Max: 159Min: 142 / Avg: 144.33 / Max: 146

POV-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.6.1Total TimeXen HVM DomUKVM-QEMUVirtualBoxBare Metal300600900120015001328905962900

C-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeXen HVM DomUKVM-QEMUVirtualBoxBare Metal20406080100SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 3SE +/- 0.47, N = 3107.6580.5286.1573.25
OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeXen HVM DomUKVM-QEMUVirtualBoxBare Metal20406080100Min: 107.64 / Avg: 107.65 / Max: 107.67Min: 80.32 / Avg: 80.52 / Max: 80.89Min: 85.69 / Avg: 86.15 / Max: 86.38Min: 72.73 / Avg: 73.25 / Max: 74.19