ERROR: This option is not supported in this configuration.ERROR: This option is not supported in this configuration.

ZFS SSD Benchmark: RAW IMAGE vs QCOW2 vs ZVOL for KVM

This benchmark show’s the performance of a zfs pool
providing storage to a kvm virtual machine with three different formats:

raw image files on plain dataset
qcow2 image file on plain dataset
zvol

For each of those several filesystem benchmarks from the phoronix-benchmark-suite are run with two different recordsizes:

8k
64k

Host Details:

cpu: Intel® Xeon® CPU E5320 @ 1.86GHz
ram: 6GB DDR2
sata: Intel Corporation 631xESB/632xESB SATA AHCI Controller (rev 09
os: Debian GNU/Linux 9.4 (stretch), fully upgraded as of 2018-03-15
zfs: 0.7.6-1~bpo9+1 (from stretch-backports)
ssd: 2x samsung 840 pro 256GB

KVM machine:

cpu: host
ram: 1024MB
disk: bus=scsi,cache=writeback,io=threads
os: Debian GNU/Linux 9.1 (stretch)
fs: ext4

The zfs pool used consists of a single mirrored vdev with samsung 840 pro ssd’s.
Each benchmark is run like this:

drop all caches
trim whole ssd’s
create zfs pool (ashift=13,compression=lz4,atime=on,relatime=on
benchmark,devices=off,exec=off,setuid=off,xattr=off)
create disk:

qemu-img create -f raw debian9.raw 50G
qemu-img create -f qcow2 -o cluster_size=8k,preallocation=metadata,compat=1.1,lazy_refcounts=on debian9.qcow2 50G
zfs create -o volblocksize=8k -V 50G benchmark/kvm/debian9


create kvm machine
take timestamp
let debian9 install automatically
save install time
install phoronix-test-suite and needed dependencies in the vm
run the pts
trim the filesystem and save the time it took
copy the results to the kvm host
destroy vm and zpool

other test results:

8k_raw - install time: 619s, trim: 39.401s
64k raw - install time: 589s, trim: 0m9.593s
8k qcow2 - install time: 615s, trim: 1m45.421s
64k qcow2 - install time: 590s, trim: 0m7.598s
8k zvol - install time: 621s, trim: 0m11.353s
64k zvol - install time: 605s

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1803231-TY-MERGE995140
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Perf-Per
Dollar
Date
Triggered
  Test
  Duration
zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image
March 17 2018
 
zfs ssd mirror, ashift=13, recordsize 64k, raw image
March 16 2018
 
zfs ssd mirror, ashift=13, recordsize 64k, zvol
March 18 2018
 
zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image
March 16 2018
 
zfs ssd mirror, ashift=13, recordsize 8k, raw image
March 15 2018
 
zfs ssd mirror, ashift=13, recordsize 8k, zvol
March 17 2018
 
Invert Hiding All Results Option
  1 Minute
Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):

zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image

zfs ssd mirror, ashift=13, recordsize 64k, raw image

zfs ssd mirror, ashift=13, recordsize 64k, zvol

zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image

zfs ssd mirror, ashift=13, recordsize 8k, raw image

zfs ssd mirror, ashift=13, recordsize 8k, zvol

Processor: 8 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996), Chipset: Intel 440FX- 82441FX PMC, Memory: 1 x 1024 MB RAM QEMU, Disk: 54GB QEMU HDD, Graphics: Cirrus Logic GD 5446, Network: Realtek RTL-8100/8101L/8139

OS: Debian 9.1, Kernel: 4.9.0-4-amd64 (x86_64), Compiler: GCC 6.3.0 20170516, File-System: ext4, Screen Resolution: 1024x768, System Layer: qemu

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v
Disk Notes: CFQ / data=ordered,errors=remount-ro,relatime,rw
System Notes: Python 2.7.13.

ZFS SSD Benchmark: RAW IMAGE vs QCOW2 vs ZVOL for KVMOpenBenchmarking.orgPhoronix Test Suite 10.2.08 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores)QEMU Standard PC (i440FX + PIIX 1996)Intel 440FX- 82441FX PMC1 x 1024 MB RAM QEMU54GB QEMU HDDCirrus Logic GD 5446Realtek RTL-8100/8101L/8139Debian 9.14.9.0-4-amd64 (x86_64)GCC 6.3.0 20170516ext41024x768qemuProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerZFS SSD Benchmark: RAW IMAGE Vs QCOW2 Vs ZVOL For KVM PerformanceSystem Logs- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - CFQ / data=ordered,errors=remount-ro,relatime,rw- Python 2.7.13.

zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolResult OverviewPhoronix Test Suite 10.2.0100%138%175%213%250%IOzoneCompile BenchDbenchFlexible IO TesterAIO-Stress

ZFS SSD Benchmark: RAW IMAGE vs QCOW2 vs ZVOL for KVMaio-stress: Rand Writefio: Rand Read - Linux AIO - No - Yes - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 8KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 8KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 64KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 8KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 8KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 64KB - Default Test Directorydbench: 1dbench: 6dbench: 12dbench: 48dbench: 128dbench: 256iozone: 1MB - 8GB - Read Performanceiozone: 4Kb - 8GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performanceiozone: 64Kb - 8GB - Read Performanceiozone: 64Kb - 8GB - Write Performancecompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol125.7429238.6023714315.9711329154.1730614746.3013942.33102.98162.59294.03203.76118.70215.34223.31156.30161.59225.08156.04142.8882.4064.69131.8129438.9323914617.2011828955.5030315247.1013842.60105.25166.12292.22207.32120.18216.63224.74157.79162.04226.37160.28147.1886.8564.83111.3345440.7323054.7512.0566.4045844.7334766.2829.7771.3742.7288.54133.55177.89102.0762.0086.0794.9966.7963.1088.9060.0381.5950.1160.7293.7022840.6523270.2325.7359.4022645.8524472.0332.7070.7742.2089.99137.50176.4189.7555.57165.90173.6865.2261.43174.5658.8761.6542.5456.7298.0123036.8022971.2029.2061.3322958.3225274.3741.8374.2742.1891.96137.66181.3897.7955.77167.07174.6360.0057.00172.3855.7272.1348.4055.72100.8747339.2023042.0520.7038.7547245.0235345.3324.1536.4340.8786.79128.76153.6388.4158.4780.5084.9572.0774.0684.8667.6291.6949.3246.58OpenBenchmarking.org

AIO-Stress

AIO-Stress is an a-synchronous I/O benchmark created by SuSE. Current this profile uses a 2048MB test file and a 64KB record size. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Test: Random Writezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.78, N = 3SE +/- 0.94, N = 3SE +/- 0.51, N = 3SE +/- 1.19, N = 3SE +/- 0.50, N = 3SE +/- 3.01, N = 6125.74131.81111.3393.7098.01100.871. (CC) gcc options: -pthread -laio
OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Test: Random Writezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol20406080100Min: 124.26 / Avg: 125.74 / Max: 126.89Min: 130.01 / Avg: 131.81 / Max: 133.2Min: 110.53 / Avg: 111.33 / Max: 112.29Min: 91.33 / Avg: 93.7 / Max: 95.11Min: 97.11 / Avg: 98.01 / Max: 98.82Min: 89.63 / Avg: 100.87 / Max: 109.011. (CC) gcc options: -pthread -laio

Flexible IO Tester

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol100200300400500SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 10.34, N = 6SE +/- 1.00, N = 3SE +/- 1.00, N = 3SE +/- 7.46, N = 62922944542282304731. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol80160240320400Min: 290 / Avg: 291.67 / Max: 294Min: 291 / Avg: 294 / Max: 298Min: 412 / Avg: 454.33 / Max: 484Min: 226 / Avg: 228 / Max: 229Min: 229 / Avg: 230 / Max: 232Min: 443 / Avg: 472.67 / Max: 4871. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol918273645SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.52, N = 3SE +/- 0.65, N = 4SE +/- 0.40, N = 3SE +/- 0.38, N = 338.6038.9340.7340.6536.8039.201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol816243240Min: 38.5 / Avg: 38.6 / Max: 38.8Min: 38.9 / Avg: 38.93 / Max: 39Min: 39.7 / Avg: 40.73 / Max: 41.4Min: 39 / Avg: 40.65 / Max: 42.1Min: 36 / Avg: 36.8 / Max: 37.2Min: 38.5 / Avg: 39.2 / Max: 39.81. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol50100150200250SE +/- 1.45, N = 3SE +/- 0.58, N = 3SE +/- 2.52, N = 3SE +/- 0.88, N = 32372392302322292301. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200Min: 237 / Avg: 239.33 / Max: 242Min: 229 / Avg: 230 / Max: 231Min: 229 / Avg: 232 / Max: 237Min: 229 / Avg: 230.33 / Max: 2321. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 2.09, N = 6SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 1.08, N = 6143.00146.0054.7570.2371.2042.051. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 142 / Avg: 143.33 / Max: 144Min: 145 / Avg: 146 / Max: 147Min: 50.1 / Avg: 54.75 / Max: 63.8Min: 70.1 / Avg: 70.23 / Max: 70.4Min: 70.8 / Avg: 71.2 / Max: 71.8Min: 38.9 / Avg: 42.05 / Max: 45.31. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol714212835SE +/- 0.24, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 4SE +/- 0.19, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 315.9717.2012.0525.7329.2020.701. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol612182430Min: 15.5 / Avg: 15.97 / Max: 16.3Min: 16.8 / Avg: 17.2 / Max: 17.7Min: 11.6 / Avg: 12.05 / Max: 12.5Min: 25.5 / Avg: 25.73 / Max: 26.1Min: 28.8 / Avg: 29.2 / Max: 29.4Min: 20.5 / Avg: 20.7 / Max: 20.81. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 0.81, N = 3SE +/- 0.25, N = 3SE +/- 0.03, N = 3SE +/- 3.30, N = 6113.00118.0066.4059.4061.3338.751. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol20406080100Min: 112 / Avg: 113.33 / Max: 114Min: 116 / Avg: 117.67 / Max: 119Min: 65 / Avg: 66.4 / Max: 67.8Min: 58.9 / Avg: 59.4 / Max: 59.7Min: 61.3 / Avg: 61.33 / Max: 61.4Min: 30.9 / Avg: 38.75 / Max: 50.41. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol100200300400500SE +/- 1.20, N = 3SE +/- 0.67, N = 3SE +/- 5.61, N = 3SE +/- 0.67, N = 3SE +/- 10.48, N = 62912894582262294721. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol80160240320400Min: 289 / Avg: 291.33 / Max: 293Min: 288 / Avg: 289.33 / Max: 290Min: 447 / Avg: 457.67 / Max: 466Min: 225 / Avg: 226.33 / Max: 227Min: 450 / Avg: 471.83 / Max: 5051. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1326395265SE +/- 1.33, N = 6SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 1.52, N = 6SE +/- 2.11, N = 6SE +/- 1.10, N = 654.1755.5044.7345.8558.3245.021. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1224364860Min: 50.3 / Avg: 54.17 / Max: 59.2Min: 55.1 / Avg: 55.5 / Max: 55.9Min: 44.2 / Avg: 44.73 / Max: 45.3Min: 42 / Avg: 45.85 / Max: 50.6Min: 52.5 / Avg: 58.32 / Max: 65.6Min: 41.3 / Avg: 45.02 / Max: 46.91. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol80160240320400SE +/- 1.33, N = 3SE +/- 1.76, N = 3SE +/- 7.51, N = 6SE +/- 0.58, N = 3SE +/- 1.33, N = 3SE +/- 4.51, N = 33063033472442523531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol60120180240300Min: 305 / Avg: 306.33 / Max: 309Min: 300 / Avg: 302.67 / Max: 306Min: 318 / Avg: 347.33 / Max: 369Min: 243 / Avg: 244 / Max: 245Min: 249 / Avg: 251.67 / Max: 253Min: 348 / Avg: 353 / Max: 3621. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 2.33, N = 3SE +/- 1.94, N = 6SE +/- 1.08, N = 3SE +/- 0.93, N = 3SE +/- 6.42, N = 6147.00152.0066.2872.0374.3745.331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 143 / Avg: 146.67 / Max: 151Min: 61.2 / Avg: 66.28 / Max: 71.4Min: 70 / Avg: 72.03 / Max: 73.7Min: 72.7 / Avg: 74.37 / Max: 75.9Min: 33.6 / Avg: 45.33 / Max: 75.11. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1122334455SE +/- 1.72, N = 6SE +/- 1.80, N = 6SE +/- 0.64, N = 6SE +/- 1.80, N = 6SE +/- 1.78, N = 6SE +/- 0.57, N = 646.3047.1029.7732.7041.8324.151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1020304050Min: 40.7 / Avg: 46.3 / Max: 51.1Min: 40 / Avg: 47.1 / Max: 50.6Min: 27.4 / Avg: 29.77 / Max: 31.8Min: 25 / Avg: 32.7 / Max: 36.4Min: 35 / Avg: 41.83 / Max: 46.6Min: 21.9 / Avg: 24.15 / Max: 25.31. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.67, N = 3SE +/- 0.59, N = 3SE +/- 0.03, N = 3SE +/- 0.41, N = 3SE +/- 3.31, N = 6139.00138.0071.3770.7774.2736.431. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 138 / Avg: 139.33 / Max: 140Min: 70.2 / Avg: 71.37 / Max: 72.1Min: 70.7 / Avg: 70.77 / Max: 70.8Min: 73.5 / Avg: 74.27 / Max: 74.9Min: 30 / Avg: 36.43 / Max: 52.31. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1020304050SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 342.3342.6042.7242.2042.1840.871. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol918273645Min: 42.19 / Avg: 42.33 / Max: 42.45Min: 42.43 / Avg: 42.6 / Max: 42.72Min: 42.69 / Avg: 42.72 / Max: 42.74Min: 42.17 / Avg: 42.2 / Max: 42.25Min: 42.11 / Avg: 42.18 / Max: 42.27Min: 40.71 / Avg: 40.87 / Max: 41.171. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol20406080100SE +/- 0.91, N = 3SE +/- 1.07, N = 3SE +/- 1.27, N = 3SE +/- 0.90, N = 3SE +/- 1.36, N = 3SE +/- 0.16, N = 3102.98105.2588.5489.9991.9686.791. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol20406080100Min: 101.58 / Avg: 102.98 / Max: 104.68Min: 104.08 / Avg: 105.25 / Max: 107.38Min: 87.03 / Avg: 88.54 / Max: 91.07Min: 88.53 / Avg: 89.99 / Max: 91.62Min: 89.9 / Avg: 91.96 / Max: 94.52Min: 86.5 / Avg: 86.79 / Max: 87.061. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200SE +/- 0.75, N = 3SE +/- 0.58, N = 3SE +/- 0.41, N = 3SE +/- 1.47, N = 3SE +/- 1.52, N = 3SE +/- 0.84, N = 3162.59166.12133.55137.50137.66128.761. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 161.12 / Avg: 162.59 / Max: 163.61Min: 165.44 / Avg: 166.12 / Max: 167.27Min: 132.77 / Avg: 133.55 / Max: 134.14Min: 134.66 / Avg: 137.5 / Max: 139.59Min: 135.61 / Avg: 137.66 / Max: 140.62Min: 127.18 / Avg: 128.76 / Max: 130.061. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 48zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol60120180240300SE +/- 4.38, N = 3SE +/- 4.21, N = 3SE +/- 6.43, N = 6SE +/- 7.08, N = 6SE +/- 7.08, N = 6SE +/- 6.84, N = 6294.03292.22177.89176.41181.38153.631. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 48zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol50100150200250Min: 288.73 / Avg: 294.03 / Max: 302.71Min: 284.17 / Avg: 292.22 / Max: 298.38Min: 159.34 / Avg: 177.89 / Max: 197.47Min: 153.47 / Avg: 176.41 / Max: 196.04Min: 157.66 / Avg: 181.38 / Max: 203.24Min: 135.63 / Avg: 153.63 / Max: 179.581. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 128zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol50100150200250SE +/- 0.99, N = 3SE +/- 2.00, N = 3SE +/- 4.96, N = 6SE +/- 5.76, N = 6SE +/- 5.85, N = 6SE +/- 4.52, N = 6203.76207.32102.0789.7597.7988.411. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 128zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200Min: 201.78 / Avg: 203.76 / Max: 204.88Min: 203.47 / Avg: 207.32 / Max: 210.18Min: 84.97 / Avg: 102.07 / Max: 118.02Min: 71.9 / Avg: 89.75 / Max: 110.12Min: 79.78 / Avg: 97.79 / Max: 118.14Min: 75.11 / Avg: 88.41 / Max: 104.931. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 256zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.23, N = 3SE +/- 0.40, N = 3SE +/- 2.00, N = 6SE +/- 0.85, N = 3SE +/- 2.11, N = 6SE +/- 1.39, N = 6118.70120.1862.0055.5755.7758.471. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 256zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol20406080100Min: 118.32 / Avg: 118.7 / Max: 119.12Min: 119.74 / Avg: 120.18 / Max: 120.97Min: 56.76 / Avg: 62 / Max: 69.12Min: 53.96 / Avg: 55.57 / Max: 56.82Min: 49.06 / Avg: 55.77 / Max: 61.92Min: 56.01 / Avg: 58.47 / Max: 64.771. (CC) gcc options: -lpopt -O2

IOzone

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol50100150200250SE +/- 0.79, N = 3SE +/- 0.57, N = 3SE +/- 0.58, N = 3SE +/- 1.22, N = 3SE +/- 1.25, N = 3SE +/- 1.26, N = 3215.34216.6386.07165.90167.0780.501. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200Min: 214.03 / Avg: 215.34 / Max: 216.76Min: 215.5 / Avg: 216.63 / Max: 217.24Min: 84.98 / Avg: 86.07 / Max: 86.95Min: 164.47 / Avg: 165.9 / Max: 168.32Min: 165.56 / Avg: 167.07 / Max: 169.54Min: 78.74 / Avg: 80.5 / Max: 82.931. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol50100150200250SE +/- 0.88, N = 3SE +/- 2.04, N = 3SE +/- 1.27, N = 3SE +/- 0.12, N = 3SE +/- 0.79, N = 3SE +/- 2.19, N = 6223.31224.7494.99173.68174.6384.951. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200Min: 221.57 / Avg: 223.31 / Max: 224.4Min: 220.66 / Avg: 224.74 / Max: 226.99Min: 93.66 / Avg: 94.99 / Max: 97.53Min: 173.55 / Avg: 173.68 / Max: 173.92Min: 173.19 / Avg: 174.63 / Max: 175.92Min: 81.2 / Avg: 84.95 / Max: 93.881. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.82, N = 3SE +/- 0.85, N = 3SE +/- 0.50, N = 3SE +/- 2.01, N = 6SE +/- 1.42, N = 6SE +/- 2.02, N = 6156.30157.7966.7965.2260.0072.071. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 154.67 / Avg: 156.3 / Max: 157.23Min: 156.74 / Avg: 157.79 / Max: 159.47Min: 66.24 / Avg: 66.79 / Max: 67.8Min: 58.73 / Avg: 65.22 / Max: 71.05Min: 57.1 / Avg: 60 / Max: 65.15Min: 67.3 / Avg: 72.07 / Max: 81.11. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200SE +/- 1.79, N = 3SE +/- 1.03, N = 3SE +/- 1.08, N = 3SE +/- 1.02, N = 6SE +/- 1.60, N = 6SE +/- 1.13, N = 3161.59162.0463.1061.4357.0074.061. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 158.77 / Avg: 161.59 / Max: 164.92Min: 160.4 / Avg: 162.04 / Max: 163.93Min: 61.35 / Avg: 63.1 / Max: 65.07Min: 58.11 / Avg: 61.43 / Max: 64.56Min: 52.64 / Avg: 57 / Max: 62.51Min: 72.03 / Avg: 74.06 / Max: 75.931. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol50100150200250SE +/- 0.72, N = 3SE +/- 0.36, N = 3SE +/- 1.37, N = 4SE +/- 0.49, N = 3SE +/- 0.49, N = 3SE +/- 2.08, N = 6225.08226.3788.90174.56172.3884.861. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200Min: 223.68 / Avg: 225.08 / Max: 226.04Min: 225.64 / Avg: 226.37 / Max: 226.77Min: 85.77 / Avg: 88.9 / Max: 92.46Min: 173.86 / Avg: 174.56 / Max: 175.51Min: 171.49 / Avg: 172.38 / Max: 173.17Min: 80.99 / Avg: 84.86 / Max: 92.321. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200SE +/- 2.73, N = 6SE +/- 2.94, N = 6SE +/- 1.77, N = 6SE +/- 0.92, N = 6SE +/- 0.37, N = 3SE +/- 3.14, N = 6156.04160.2860.0358.8755.7267.621. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 147.87 / Avg: 156.04 / Max: 164.35Min: 153.6 / Avg: 160.28 / Max: 173.13Min: 51.66 / Avg: 60.03 / Max: 63.61Min: 57.22 / Avg: 58.87 / Max: 63.21Min: 54.99 / Avg: 55.72 / Max: 56.21Min: 60.89 / Avg: 67.62 / Max: 81.491. (CC) gcc options: -O3

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compilezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 5.01, N = 6SE +/- 5.21, N = 6SE +/- 1.40, N = 3SE +/- 4.97, N = 6SE +/- 2.12, N = 6SE +/- 2.73, N = 6142.88147.1881.5961.6572.1391.69
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compilezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 118.1 / Avg: 142.88 / Max: 150.7Min: 121.26 / Avg: 147.18 / Max: 154.92Min: 79.68 / Avg: 81.59 / Max: 84.31Min: 39.42 / Avg: 61.65 / Max: 74.62Min: 66.78 / Avg: 72.13 / Max: 78.69Min: 84.43 / Avg: 91.69 / Max: 99.93

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol20406080100SE +/- 6.42, N = 3SE +/- 3.08, N = 3SE +/- 5.96, N = 3SE +/- 8.32, N = 3SE +/- 1.91, N = 3SE +/- 3.57, N = 382.4086.8550.1142.5448.4049.32
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1632486480Min: 69.68 / Avg: 82.4 / Max: 90.26Min: 80.72 / Avg: 86.85 / Max: 90.52Min: 39.26 / Avg: 50.11 / Max: 59.82Min: 26.3 / Avg: 42.54 / Max: 53.76Min: 44.83 / Avg: 48.4 / Max: 51.36Min: 45.55 / Avg: 49.32 / Max: 56.46

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1428425670SE +/- 0.14, N = 3SE +/- 0.33, N = 3SE +/- 2.51, N = 3SE +/- 0.52, N = 3SE +/- 0.15, N = 3SE +/- 0.65, N = 364.6964.8360.7256.7255.7246.58
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1326395265Min: 64.52 / Avg: 64.69 / Max: 64.96Min: 64.19 / Avg: 64.83 / Max: 65.29Min: 58.05 / Avg: 60.72 / Max: 65.73Min: 55.68 / Avg: 56.72 / Max: 57.26Min: 55.49 / Avg: 55.72 / Max: 55.99Min: 45.51 / Avg: 46.58 / Max: 47.74

OpenBenchmarking.org Community User Comments

Post A Comment