Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 1803243-KH-1803231TY84
ZFS SSD Benchmark: RAW IMAGE vs QCOW2 vs ZVOL for KVM
This benchmark show’s the performance of a zfs pool
providing storage to a kvm virtual machine with three different formats:
raw image files on plain dataset
qcow2 image file on plain dataset
zvol
For each of those several filesystem benchmarks from the phoronix-benchmark-suite are run with two different recordsizes:
8k
64k
Host Details:
cpu: Intel® Xeon® CPU E5320 @ 1.86GHz
ram: 6GB DDR2
sata: Intel Corporation 631xESB/632xESB SATA AHCI Controller (rev 09
os: Debian GNU/Linux 9.4 (stretch), fully upgraded as of 2018-03-15
zfs: 0.7.6-1~bpo9+1 (from stretch-backports)
ssd: 2x samsung 840 pro 256GB
KVM machine:
cpu: host
ram: 1024MB
disk: bus=scsi,cache=writeback,io=threads
os: Debian GNU/Linux 9.1 (stretch)
fs: ext4
The zfs pool used consists of a single mirrored vdev with samsung 840 pro ssd’s.
Each benchmark is run like this:
drop all caches
trim whole ssd’s
create zfs pool (ashift=13,compression=lz4,atime=on,relatime=on
benchmark,devices=off,exec=off,setuid=off,xattr=off)
create disk:
qemu-img create -f raw debian9.raw 50G
qemu-img create -f qcow2 -o cluster_size=8k,preallocation=metadata,compat=1.1,lazy_refcounts=on debian9.qcow2 50G
zfs create -o volblocksize=8k -V 50G benchmark/kvm/debian9
create kvm machine
take timestamp
let debian9 install automatically
save install time
install phoronix-test-suite and needed dependencies in the vm
run the pts
trim the filesystem and save the time it took
copy the results to the kvm host
destroy vm and zpool
other test results:
8k_raw - install time: 619s, trim: 39.401s
64k raw - install time: 589s, trim: 0m9.593s
8k qcow2 - install time: 615s, trim: 1m45.421s
64k qcow2 - install time: 590s, trim: 0m7.598s
8k zvol - install time: 621s, trim: 0m11.353s
64k zvol - install time: 605s
,,"zfs ssd mirror, ashift=13, recordsize 8k, raw image","zfs ssd mirror, ashift=13, recordsize 64k, raw image","zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image","zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image","zfs ssd mirror, ashift=13, recordsize 8k, zvol","zfs ssd mirror, ashift=13, recordsize 64k, zvol","pve-ubuntu-local-1"
Processor,,8 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores),8 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores),8 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores),8 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores),8 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores),8 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores),Common KVM @ 3.09GHz (2 Cores)
Motherboard,,QEMU Standard PC (i440FX + PIIX 1996),QEMU Standard PC (i440FX + PIIX 1996),QEMU Standard PC (i440FX + PIIX 1996),QEMU Standard PC (i440FX + PIIX 1996),QEMU Standard PC (i440FX + PIIX 1996),QEMU Standard PC (i440FX + PIIX 1996),QEMU Standard PC (i440FX + PIIX 1996)
Chipset,,Intel 440FX- 82441FX PMC,Intel 440FX- 82441FX PMC,Intel 440FX- 82441FX PMC,Intel 440FX- 82441FX PMC,Intel 440FX- 82441FX PMC,Intel 440FX- 82441FX PMC,Intel 440FX- 82441FX PMC
Memory,,1 x 1024 MB RAM QEMU,1 x 1024 MB RAM QEMU,1 x 1024 MB RAM QEMU,1 x 1024 MB RAM QEMU,1 x 1024 MB RAM QEMU,1 x 1024 MB RAM QEMU,2048MB
Disk,,54GB QEMU HDD,54GB QEMU HDD,54GB QEMU HDD,54GB QEMU HDD,54GB QEMU HDD,54GB QEMU HDD,34GB QEMU HDD
Graphics,,Cirrus Logic GD 5446,Cirrus Logic GD 5446,Cirrus Logic GD 5446,Cirrus Logic GD 5446,Cirrus Logic GD 5446,Cirrus Logic GD 5446,Device 1234:1111
Network,,Realtek RTL-8100/8101L/8139,Realtek RTL-8100/8101L/8139,Realtek RTL-8100/8101L/8139,Realtek RTL-8100/8101L/8139,Realtek RTL-8100/8101L/8139,Realtek RTL-8100/8101L/8139,Red Hat Virtio device
OS,,Debian 9.1,Debian 9.1,Debian 9.1,Debian 9.1,Debian 9.1,Debian 9.1,Ubuntu 16.04
Kernel,,4.9.0-4-amd64 (x86_64),4.9.0-4-amd64 (x86_64),4.9.0-4-amd64 (x86_64),4.9.0-4-amd64 (x86_64),4.9.0-4-amd64 (x86_64),4.9.0-4-amd64 (x86_64),4.4.0-116-generic (x86_64)
Compiler,,GCC 6.3.0 20170516,GCC 6.3.0 20170516,GCC 6.3.0 20170516,GCC 6.3.0 20170516,GCC 6.3.0 20170516,GCC 6.3.0 20170516,GCC 5.4.0 20160609
File-System,,ext4,ext4,ext4,ext4,ext4,ext4,ext4
Screen Resolution,,1024x768,1024x768,1024x768,1024x768,1024x768,1024x768,800x600
System Layer,,qemu,qemu,qemu,qemu,qemu,qemu,qemu
,,"zfs ssd mirror, ashift=13, recordsize 8k, raw image","zfs ssd mirror, ashift=13, recordsize 64k, raw image","zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image","zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image","zfs ssd mirror, ashift=13, recordsize 8k, zvol","zfs ssd mirror, ashift=13, recordsize 64k, zvol","pve-ubuntu-local-1"
"AIO-Stress - Test: Random Write (MB/s)",HIB,98.01,131.81,93.70,125.74,100.87,111.33,49.15
"Compile Bench - Test: Compile (MB/s)",HIB,72.13,147.18,61.65,142.88,91.69,81.59,262.57
"Compile Bench - Test: Initial Create (MB/s)",HIB,48.40,86.85,42.54,82.40,49.32,50.11,182.82
"Compile Bench - Test: Read Compiled Tree (MB/s)",HIB,55.72,64.83,56.72,64.69,46.58,60.72,166.58
"Dbench - Client Count: 1 (MB/s)",HIB,42.18,42.60,42.20,42.33,40.87,42.72,430.74
"Dbench - Client Count: 6 (MB/s)",HIB,91.96,105.25,89.99,102.98,86.79,88.54,826.51
"Dbench - Client Count: 12 (MB/s)",HIB,137.66,166.12,137.50,162.59,128.76,133.55,779.05
"Dbench - Client Count: 48 (MB/s)",HIB,181.38,292.22,176.41,294.03,153.63,177.89,792.05
"Dbench - Client Count: 128 (MB/s)",HIB,97.79,207.32,89.75,203.76,88.41,102.07,308.19
"Dbench - Client Count: 256 (MB/s)",HIB,55.77,120.18,55.57,118.70,58.47,62.00,201.67
"Flexible IO Tester - Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory (MB/s)",HIB,230,294,228,292,473,454,
"Flexible IO Tester - Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory (MB/s)",HIB,36.80,38.93,40.65,38.60,39.20,40.73,
"Flexible IO Tester - Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory (MB/s)",HIB,229,239,232,237,230,230,
"Flexible IO Tester - Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory (MB/s)",HIB,71.20,146,70.23,143,42.05,54.75,
"Flexible IO Tester - Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory (MB/s)",HIB,29.20,17.20,25.73,15.97,20.70,12.05,
"Flexible IO Tester - Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory (MB/s)",HIB,61.33,118,59.40,113,38.75,66.40,
"Flexible IO Tester - Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory (MB/s)",HIB,229,289,226,291,472,458,
"Flexible IO Tester - Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory (MB/s)",HIB,58.32,55.50,45.85,54.17,45.02,44.73,
"Flexible IO Tester - Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory (MB/s)",HIB,252,303,244,306,353,347,
"Flexible IO Tester - Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory (MB/s)",HIB,74.37,152,72.03,147,45.33,66.28,
"Flexible IO Tester - Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory (MB/s)",HIB,41.83,47.10,32.70,46.30,24.15,29.77,
"Flexible IO Tester - Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory (MB/s)",HIB,74.27,138,70.77,139,36.43,71.37,
"IOzone - Record Size: 1MB - File Size: 8GB - Disk Test: Read Performance (MB/s)",HIB,167.07,216.63,165.90,215.34,80.50,86.07,245.63
"IOzone - Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performance (MB/s)",HIB,174.63,224.74,173.68,223.31,84.95,94.99,256.87
"IOzone - Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance (MB/s)",HIB,60.00,157.79,65.22,156.30,72.07,66.79,206.19
"IOzone - Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance (MB/s)",HIB,57.00,162.04,61.43,161.59,74.06,63.10,207.63
"IOzone - Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performance (MB/s)",HIB,172.38,226.37,174.56,225.08,84.86,88.90,262.94
"IOzone - Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance (MB/s)",HIB,55.72,160.28,58.87,156.04,67.62,60.03,207.41