test1 2 x Intel Xeon E5-2680 v2 testing with a Dell 0GFKVD and NVIDIA GeForce GT 640 on Debian 7.2 via the Phoronix Test Suite. PERC H710P: Processor: 2 x Intel Xeon E5-2680 v2 @ 2.80GHz (40 Cores), Motherboard: Dell 0GFKVD, Chipset: Intel Ivytown DMI2, Memory: 24 x 16384 MB DDR3-1600MHz, Disk: 299GB PERC H710P + 2 x 199GB PERC H710P + 4 x 1200GB PERC H710P, Graphics: NVIDIA GeForce GT 640, Network: Intel 10-Gigabit X540-AT2 OS: Debian 7.2, Kernel: 2.6.32-26-pve (x86_64), Display Driver: NVIDIA 313.30), OpenGL: 1.4, Compiler: GCC 4.7, File-System: zfs qcow2 on zfs: Processor: 2 x Intel Xeon E5-2680 v2 @ 2.80GHz (20 Cores), Motherboard: Bochs, Chipset: Intel 440FX- 82441FX PMC, Memory: 4 x 16384 MB RAM, Disk: 9GB, Graphics: Cirrus Logic GD 5446, Network: Red Hat Virtio device OS: Ubuntu 12.04, Kernel: 3.2.0-23-generic (x86_64), File-System: ext4 qcow2 on zvol+ext4: Processor: 2 x Intel Xeon E5-2680 v2 @ 2.80GHz (20 Cores), Motherboard: Bochs, Chipset: Intel 440FX- 82441FX PMC, Memory: 4 x 16384 MB RAM, Disk: 9GB, Graphics: NVIDIA GeForce GT 640, Network: Red Hat Virtio device OS: Ubuntu 12.04, Kernel: 3.2.0-23-generic (x86_64), Display Driver: NVIDIA 313.30), OpenGL: 1.4, Compiler: GCC 4.6, File-System: ext4 zvol: Processor: 2 x Intel Xeon E5-2680 v2 @ 2.80GHz (20 Cores), Motherboard: Bochs, Chipset: Intel 440FX- 82441FX PMC, Memory: 4 x 16384 MB RAM, Disk: 9GB, Graphics: NVIDIA GeForce GT 640, Network: Red Hat Virtio device OS: Ubuntu 12.04, Kernel: 3.2.0-23-generic (x86_64), Display Driver: NVIDIA 313.30), OpenGL: 1.4, Compiler: GCC 4.6, File-System: ext4 qcow2 on zfs on perc raid10: Processor: 2 x Intel Xeon E5-2680 v2 @ 2.80GHz (20 Cores), Motherboard: Bochs, Chipset: Intel 440FX- 82441FX PMC, Memory: 4 x 16384 MB RAM, Disk: 9GB, Graphics: NVIDIA GeForce GT 640, Network: Red Hat Virtio device OS: Ubuntu 12.04, Kernel: 3.2.0-23-generic (x86_64), Display Driver: NVIDIA 313.30), OpenGL: 1.4, Compiler: GCC 4.6, File-System: ext4, Screen Resolution: 800x600 qcow2 on zfs on perc raid10 cachecade: Processor: 2 x Intel Xeon E5-2680 v2 @ 2.80GHz (20 Cores), Motherboard: Bochs, Chipset: Intel 440FX- 82441FX PMC, Memory: 4 x 16384 MB RAM, Disk: 9GB, Graphics: NVIDIA GeForce GT 640, Network: Red Hat Virtio device OS: Ubuntu 12.04, Kernel: 3.2.0-23-generic (x86_64), Display Driver: NVIDIA 313.30), OpenGL: 1.4, Compiler: GCC 4.6, File-System: ext4, Screen Resolution: 800x600 qcow2 on ext4 on perc raid10 cachecade: Processor: 2 x Intel Xeon E5-2680 v2 @ 2.80GHz (20 Cores), Motherboard: Bochs, Chipset: Intel 440FX- 82441FX PMC, Memory: 4 x 16384 MB RAM, Disk: 9GB, Graphics: NVIDIA GeForce GT 640, Network: Red Hat Virtio device OS: Ubuntu 12.04, Kernel: 3.2.0-23-generic (x86_64), Display Driver: NVIDIA 313.30), OpenGL: 1.4, Compiler: GCC 4.6, File-System: ext4, Screen Resolution: 800x600 IOzone 3.405 Record Size: 1MB - File Size: 2GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 3209.49 |========================= qcow2 on zfs ........................... 3085.34 |======================== qcow2 on zvol+ext4 ..................... 2562.17 |==================== zvol ................................... 3703.29 |============================= qcow2 on zfs on perc raid10 ............ 2965.84 |======================= qcow2 on zfs on perc raid10 cachecade .. 3010.68 |======================== qcow2 on ext4 on perc raid10 cachecade . 3161.82 |========================= IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 4004.64 |============================= qcow2 on zfs ........................... 3601.75 |========================== qcow2 on zvol+ext4 ..................... 2805.51 |==================== zvol ................................... 4031.49 |============================= qcow2 on zfs on perc raid10 ............ 3284.66 |======================== qcow2 on zfs on perc raid10 cachecade .. 4040.62 |============================= qcow2 on ext4 on perc raid10 cachecade . 3761.76 |=========================== IOzone 3.405 Record Size: 1MB - File Size: 8GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P . 4578.04 |========================================================= IOzone 3.405 Record Size: 4Kb - File Size: 2GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 869.84 |========= qcow2 on zfs ........................... 2797.59 |============================= qcow2 on zvol+ext4 ..................... 2351.99 |======================== zvol ................................... 2567.05 |========================== qcow2 on zfs on perc raid10 ............ 2574.93 |========================== qcow2 on zfs on perc raid10 cachecade .. 2845.63 |============================= qcow2 on ext4 on perc raid10 cachecade . 2786.00 |============================ IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 896.42 |======= qcow2 on zfs ........................... 3572.01 |============================= qcow2 on zvol+ext4 ..................... 2422.81 |==================== zvol ................................... 3328.72 |=========================== qcow2 on zfs on perc raid10 ............ 3157.44 |========================== qcow2 on zfs on perc raid10 cachecade .. 3423.32 |============================ qcow2 on ext4 on perc raid10 cachecade . 3319.60 |=========================== IOzone 3.405 Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P . 951.62 |========================================================== IOzone 3.405 Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 257.18 |============================== qcow2 on zfs ........................... 118.17 |============== qcow2 on zvol+ext4 ..................... 206.34 |======================== zvol ................................... 110.67 |============= qcow2 on zfs on perc raid10 ............ 231.35 |=========================== qcow2 on zfs on perc raid10 cachecade .. 124.73 |=============== qcow2 on ext4 on perc raid10 cachecade . 229.83 |=========================== IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 328.28 |============================== qcow2 on zfs ........................... 120.53 |=========== qcow2 on zvol+ext4 ..................... 191.17 |================= zvol ................................... 113.82 |========== qcow2 on zfs on perc raid10 ............ 219.92 |==================== qcow2 on zfs on perc raid10 cachecade .. 121.51 |=========== qcow2 on ext4 on perc raid10 cachecade . 252.01 |======================= IOzone 3.405 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P . 346.12 |========================================================== IOzone 3.405 Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 207.44 |============================ qcow2 on zfs ........................... 112.05 |=============== qcow2 on zvol+ext4 ..................... 197.24 |========================== zvol ................................... 110.34 |=============== qcow2 on zfs on perc raid10 ............ 177.49 |======================== qcow2 on zfs on perc raid10 cachecade .. 119.14 |================ qcow2 on ext4 on perc raid10 cachecade . 223.65 |============================== IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 290.64 |============================== qcow2 on zfs ........................... 121.46 |============= qcow2 on zvol+ext4 ..................... 185.06 |=================== zvol ................................... 113.30 |============ qcow2 on zfs on perc raid10 ............ 263.40 |=========================== qcow2 on zfs on perc raid10 cachecade .. 123.45 |============= qcow2 on ext4 on perc raid10 cachecade . 244.93 |========================= IOzone 3.405 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P . 296.85 |========================================================== IOzone 3.405 Record Size: 64Kb - File Size: 2GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 2400.26 |===================== qcow2 on zfs ........................... 3201.58 |============================ qcow2 on zvol+ext4 ..................... 2468.88 |====================== zvol ................................... 3143.54 |============================ qcow2 on zfs on perc raid10 ............ 3132.43 |=========================== qcow2 on zfs on perc raid10 cachecade .. 3148.18 |============================ qcow2 on ext4 on perc raid10 cachecade . 3309.07 |============================= IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 3081.41 |======================= qcow2 on zfs ........................... 3824.39 |============================ qcow2 on zvol+ext4 ..................... 2873.60 |===================== zvol ................................... 3884.84 |============================= qcow2 on zfs on perc raid10 ............ 3505.27 |========================== qcow2 on zfs on perc raid10 cachecade .. 3758.26 |============================ qcow2 on ext4 on perc raid10 cachecade . 3908.27 |============================= IOzone 3.405 Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P . 3580.01 |========================================================= IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 2962.93 |============================= qcow2 on zfs ........................... 3011.39 |============================= qcow2 on zvol+ext4 ..................... 2810.63 |=========================== zvol ................................... 2934.51 |============================ qcow2 on zfs on perc raid10 ............ 2888.35 |============================ qcow2 on zfs on perc raid10 cachecade .. 2981.04 |============================= qcow2 on ext4 on perc raid10 cachecade . 2992.75 |============================= IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 545.99 |==== qcow2 on zfs ........................... 3584.13 |============================= qcow2 on zvol+ext4 ..................... 1988.59 |================ zvol ................................... 2531.63 |==================== qcow2 on zfs on perc raid10 ............ 2384.70 |=================== qcow2 on zfs on perc raid10 cachecade .. 2594.26 |===================== qcow2 on ext4 on perc raid10 cachecade . 2633.26 |===================== IOzone 3.405 Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 190.94 |=================== qcow2 on zfs ........................... 131.00 |============= qcow2 on zvol+ext4 ..................... 209.63 |===================== zvol ................................... 111.66 |=========== qcow2 on zfs on perc raid10 ............ 298.67 |============================== qcow2 on zfs on perc raid10 cachecade .. 124.74 |============= qcow2 on ext4 on perc raid10 cachecade . 242.41 |======================== IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 284.35 |============================= qcow2 on zfs ........................... 120.31 |============ qcow2 on zvol+ext4 ..................... 195.90 |==================== zvol ................................... 115.43 |============ qcow2 on zfs on perc raid10 ............ 289.46 |============================== qcow2 on zfs on perc raid10 cachecade .. 121.58 |============= qcow2 on ext4 on perc raid10 cachecade . 245.72 |========================= IOzone 3.405 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P . 342.34 |========================================================== IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 224.25 |========================== qcow2 on zfs ........................... 185.54 |===================== qcow2 on zvol+ext4 ..................... 250.05 |============================= zvol ................................... 99.52 |=========== qcow2 on zfs on perc raid10 ............ 172.76 |==================== qcow2 on zfs on perc raid10 cachecade .. 173.91 |==================== qcow2 on ext4 on perc raid10 cachecade . 260.89 |============================== IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 172.54 |=================== qcow2 on zfs ........................... 163.37 |================== qcow2 on zvol+ext4 ..................... 252.05 |============================ zvol ................................... 96.84 |=========== qcow2 on zfs on perc raid10 ............ 177.33 |=================== qcow2 on zfs on perc raid10 cachecade .. 191.93 |===================== qcow2 on ext4 on perc raid10 cachecade . 273.52 |============================== IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Read Performance MB/s > Higher Is Better PERC H710P ............................. 1803.89 |=============== qcow2 on zfs ........................... 3305.64 |=========================== qcow2 on zvol+ext4 ..................... 2370.58 |==================== zvol ................................... 2905.28 |======================== qcow2 on zfs on perc raid10 ............ 3016.42 |========================= qcow2 on zfs on perc raid10 cachecade .. 3485.95 |============================= qcow2 on ext4 on perc raid10 cachecade . 3091.76 |========================== IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better PERC H710P ............................. 192.73 |==================== qcow2 on zfs ........................... 170.86 |================== qcow2 on zvol+ext4 ..................... 237.43 |========================= zvol ................................... 98.56 |========== qcow2 on zfs on perc raid10 ............ 170.84 |================== qcow2 on zfs on perc raid10 cachecade .. 200.67 |===================== qcow2 on ext4 on perc raid10 cachecade . 286.08 |==============================