ZFS SSD Benchmark: RAW IMAGE vs QCOW2 vs ZVOL for KVM

FNAS

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1803243-KH-1803231TY25
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image
March 17 2018
 
zfs ssd mirror, ashift=13, recordsize 64k, raw image
March 16 2018
 
zfs ssd mirror, ashift=13, recordsize 64k, zvol
March 18 2018
 
zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image
March 16 2018
 
zfs ssd mirror, ashift=13, recordsize 8k, raw image
March 15 2018
 
zfs ssd mirror, ashift=13, recordsize 8k, zvol
March 17 2018
 
pve-ubuntu-fnas-1
March 24 2018
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ZFS SSD Benchmark: RAW IMAGE vs QCOW2 vs ZVOL for KVMProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layerzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-18 x Intel Celeron_4x0 (Conroe/Merom Class Core 2) @ 1.86GHz (8 Cores)QEMU Standard PC (i440FX + PIIX 1996)Intel 440FX- 82441FX PMC1 x 1024 MB RAM QEMU54GB QEMU HDDCirrus Logic GD 5446Realtek RTL-8100/8101L/8139Debian 9.14.9.0-4-amd64 (x86_64)GCC 6.3.0 20170516ext41024x768qemuCommon KVM @ 3.09GHz (2 Cores)2048MB537GB QEMU HDDDevice 1234:1111Red Hat Virtio deviceUbuntu 16.044.4.0-116-generic (x86_64)GCC 5.4.0 20160609800x600OpenBenchmarking.orgCompiler Details- zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - zfs ssd mirror, ashift=13, recordsize 64k, raw image: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - zfs ssd mirror, ashift=13, recordsize 64k, zvol: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - zfs ssd mirror, ashift=13, recordsize 8k, raw image: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - zfs ssd mirror, ashift=13, recordsize 8k, zvol: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - pve-ubuntu-fnas-1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image: CFQ / data=ordered,errors=remount-ro,relatime,rw- zfs ssd mirror, ashift=13, recordsize 64k, raw image: CFQ / data=ordered,errors=remount-ro,relatime,rw- zfs ssd mirror, ashift=13, recordsize 64k, zvol: CFQ / data=ordered,errors=remount-ro,relatime,rw- zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image: CFQ / data=ordered,errors=remount-ro,relatime,rw- zfs ssd mirror, ashift=13, recordsize 8k, raw image: CFQ / data=ordered,errors=remount-ro,relatime,rw- zfs ssd mirror, ashift=13, recordsize 8k, zvol: CFQ / data=ordered,errors=remount-ro,relatime,rw- pve-ubuntu-fnas-1: DEADLINE / data=ordered,errors=remount-ro,relatime,rwSystem Details- zfs ssd mirror, ashift=13, recordsize 64k, qcow2 image: Python 2.7.13.- zfs ssd mirror, ashift=13, recordsize 64k, raw image: Python 2.7.13.- zfs ssd mirror, ashift=13, recordsize 64k, zvol: Python 2.7.13.- zfs ssd mirror, ashift=13, recordsize 8k, qcow2 image: Python 2.7.13.- zfs ssd mirror, ashift=13, recordsize 8k, raw image: Python 2.7.13.- zfs ssd mirror, ashift=13, recordsize 8k, zvol: Python 2.7.13.- pve-ubuntu-fnas-1: Disk Scheduler: DEADLINE. Python 2.7.12.

zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1Logarithmic Result OverviewPhoronix Test SuiteDbenchIOzoneAIO-StressCompile Bench

ZFS SSD Benchmark: RAW IMAGE vs QCOW2 vs ZVOL for KVMaio-stress: Rand Writedbench: 1dbench: 6dbench: 12dbench: 48dbench: 128dbench: 256iozone: 1MB - 8GB - Read Performanceiozone: 4Kb - 8GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performanceiozone: 64Kb - 8GB - Read Performanceiozone: 64Kb - 8GB - Write Performancecompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1125.7442.33102.98162.59294.03203.76118.70215.34223.31156.30161.59225.08156.04142.8882.4064.69131.8142.60105.25166.12292.22207.32120.18216.63224.74157.79162.04226.37160.28147.1886.8564.83111.3342.7288.54133.55177.89102.0762.0086.0794.9966.7963.1088.9060.0381.5950.1160.7293.7042.2089.99137.50176.4189.7555.57165.90173.6865.2261.43174.5658.8761.6542.5456.7298.0142.1891.96137.66181.3897.7955.77167.07174.6360.0057.00172.3855.7272.1348.4055.72100.8740.8786.79128.76153.6388.4158.4780.5084.9572.0774.0684.8667.6291.6949.3246.581449.77179.20320.86387.51437.60259.95333.19111.88112.02111.94111.83112.04111.94117.05100.8964.91OpenBenchmarking.org

AIO-Stress

AIO-Stress is an a-synchronous I/O benchmark created by SuSE. Current this profile uses a 2048MB test file and a 64KB record size. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Test: Random Writezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-130060090012001500SE +/- 0.78, N = 3SE +/- 0.94, N = 3SE +/- 0.51, N = 3SE +/- 1.19, N = 3SE +/- 0.50, N = 3SE +/- 3.01, N = 6SE +/- 21.95, N = 5125.74131.81111.3393.7098.01100.871449.771. (CC) gcc options: -pthread -laio
OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Test: Random Writezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-130060090012001500Min: 124.26 / Avg: 125.74 / Max: 126.89Min: 130.01 / Avg: 131.81 / Max: 133.2Min: 110.53 / Avg: 111.33 / Max: 112.29Min: 91.33 / Avg: 93.7 / Max: 95.11Min: 97.11 / Avg: 98.01 / Max: 98.82Min: 89.63 / Avg: 100.87 / Max: 109.01Min: 1406.3 / Avg: 1449.77 / Max: 1529.171. (CC) gcc options: -pthread -laio

Flexible IO Tester

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol100200300400500SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 10.34, N = 6SE +/- 1.00, N = 3SE +/- 1.00, N = 3SE +/- 7.46, N = 62922944542282304731. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol80160240320400Min: 290 / Avg: 291.67 / Max: 294Min: 291 / Avg: 294 / Max: 298Min: 412 / Avg: 454.33 / Max: 484Min: 226 / Avg: 228 / Max: 229Min: 229 / Avg: 230 / Max: 232Min: 443 / Avg: 472.67 / Max: 4871. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol918273645SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.52, N = 3SE +/- 0.65, N = 4SE +/- 0.40, N = 3SE +/- 0.38, N = 338.6038.9340.7340.6536.8039.201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol816243240Min: 38.5 / Avg: 38.6 / Max: 38.8Min: 38.9 / Avg: 38.93 / Max: 39Min: 39.7 / Avg: 40.73 / Max: 41.4Min: 39 / Avg: 40.65 / Max: 42.1Min: 36 / Avg: 36.8 / Max: 37.2Min: 38.5 / Avg: 39.2 / Max: 39.81. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol50100150200250SE +/- 1.45, N = 3SE +/- 0.58, N = 3SE +/- 2.52, N = 3SE +/- 0.88, N = 32372392302322292301. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol4080120160200Min: 237 / Avg: 239.33 / Max: 242Min: 229 / Avg: 230 / Max: 231Min: 229 / Avg: 232 / Max: 237Min: 229 / Avg: 230.33 / Max: 2321. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 2.09, N = 6SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 1.08, N = 6143.00146.0054.7570.2371.2042.051. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 142 / Avg: 143.33 / Max: 144Min: 145 / Avg: 146 / Max: 147Min: 50.1 / Avg: 54.75 / Max: 63.8Min: 70.1 / Avg: 70.23 / Max: 70.4Min: 70.8 / Avg: 71.2 / Max: 71.8Min: 38.9 / Avg: 42.05 / Max: 45.31. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol714212835SE +/- 0.24, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 4SE +/- 0.19, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 315.9717.2012.0525.7329.2020.701. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol612182430Min: 15.5 / Avg: 15.97 / Max: 16.3Min: 16.8 / Avg: 17.2 / Max: 17.7Min: 11.6 / Avg: 12.05 / Max: 12.5Min: 25.5 / Avg: 25.73 / Max: 26.1Min: 28.8 / Avg: 29.2 / Max: 29.4Min: 20.5 / Avg: 20.7 / Max: 20.81. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 0.81, N = 3SE +/- 0.25, N = 3SE +/- 0.03, N = 3SE +/- 3.30, N = 6113.00118.0066.4059.4061.3338.751. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol20406080100Min: 112 / Avg: 113.33 / Max: 114Min: 116 / Avg: 117.67 / Max: 119Min: 65 / Avg: 66.4 / Max: 67.8Min: 58.9 / Avg: 59.4 / Max: 59.7Min: 61.3 / Avg: 61.33 / Max: 61.4Min: 30.9 / Avg: 38.75 / Max: 50.41. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol100200300400500SE +/- 1.20, N = 3SE +/- 0.67, N = 3SE +/- 5.61, N = 3SE +/- 0.67, N = 3SE +/- 10.48, N = 62912894582262294721. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol80160240320400Min: 289 / Avg: 291.33 / Max: 293Min: 288 / Avg: 289.33 / Max: 290Min: 447 / Avg: 457.67 / Max: 466Min: 225 / Avg: 226.33 / Max: 227Min: 450 / Avg: 471.83 / Max: 5051. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1326395265SE +/- 1.33, N = 6SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 1.52, N = 6SE +/- 2.11, N = 6SE +/- 1.10, N = 654.1755.5044.7345.8558.3245.021. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1224364860Min: 50.3 / Avg: 54.17 / Max: 59.2Min: 55.1 / Avg: 55.5 / Max: 55.9Min: 44.2 / Avg: 44.73 / Max: 45.3Min: 42 / Avg: 45.85 / Max: 50.6Min: 52.5 / Avg: 58.32 / Max: 65.6Min: 41.3 / Avg: 45.02 / Max: 46.91. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol80160240320400SE +/- 1.33, N = 3SE +/- 1.76, N = 3SE +/- 7.51, N = 6SE +/- 0.58, N = 3SE +/- 1.33, N = 3SE +/- 4.51, N = 33063033472442523531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol60120180240300Min: 305 / Avg: 306.33 / Max: 309Min: 300 / Avg: 302.67 / Max: 306Min: 318 / Avg: 347.33 / Max: 369Min: 243 / Avg: 244 / Max: 245Min: 249 / Avg: 251.67 / Max: 253Min: 348 / Avg: 353 / Max: 3621. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 2.33, N = 3SE +/- 1.94, N = 6SE +/- 1.08, N = 3SE +/- 0.93, N = 3SE +/- 6.42, N = 6147.00152.0066.2872.0374.3745.331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 143 / Avg: 146.67 / Max: 151Min: 61.2 / Avg: 66.28 / Max: 71.4Min: 70 / Avg: 72.03 / Max: 73.7Min: 72.7 / Avg: 74.37 / Max: 75.9Min: 33.6 / Avg: 45.33 / Max: 75.11. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1122334455SE +/- 1.72, N = 6SE +/- 1.80, N = 6SE +/- 0.64, N = 6SE +/- 1.80, N = 6SE +/- 1.78, N = 6SE +/- 0.57, N = 646.3047.1029.7732.7041.8324.151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol1020304050Min: 40.7 / Avg: 46.3 / Max: 51.1Min: 40 / Avg: 47.1 / Max: 50.6Min: 27.4 / Avg: 29.77 / Max: 31.8Min: 25 / Avg: 32.7 / Max: 36.4Min: 35 / Avg: 41.83 / Max: 46.6Min: 21.9 / Avg: 24.15 / Max: 25.31. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150SE +/- 0.67, N = 3SE +/- 0.59, N = 3SE +/- 0.03, N = 3SE +/- 0.41, N = 3SE +/- 3.31, N = 6139.00138.0071.3770.7774.2736.431. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvol306090120150Min: 138 / Avg: 139.33 / Max: 140Min: 70.2 / Avg: 71.37 / Max: 72.1Min: 70.7 / Avg: 70.77 / Max: 70.8Min: 73.5 / Avg: 74.27 / Max: 74.9Min: 30 / Avg: 36.43 / Max: 52.31. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-14080120160200SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 342.3342.6042.7242.2042.1840.87179.201. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1306090120150Min: 42.19 / Avg: 42.33 / Max: 42.45Min: 42.43 / Avg: 42.6 / Max: 42.72Min: 42.69 / Avg: 42.72 / Max: 42.74Min: 42.17 / Avg: 42.2 / Max: 42.25Min: 42.11 / Avg: 42.18 / Max: 42.27Min: 40.71 / Avg: 40.87 / Max: 41.17Min: 179.13 / Avg: 179.2 / Max: 179.311. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-170140210280350SE +/- 0.91, N = 3SE +/- 1.07, N = 3SE +/- 1.27, N = 3SE +/- 0.90, N = 3SE +/- 1.36, N = 3SE +/- 0.16, N = 3SE +/- 6.43, N = 6102.98105.2588.5489.9991.9686.79320.861. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-160120180240300Min: 101.58 / Avg: 102.98 / Max: 104.68Min: 104.08 / Avg: 105.25 / Max: 107.38Min: 87.03 / Avg: 88.54 / Max: 91.07Min: 88.53 / Avg: 89.99 / Max: 91.62Min: 89.9 / Avg: 91.96 / Max: 94.52Min: 86.5 / Avg: 86.79 / Max: 87.06Min: 289.6 / Avg: 320.86 / Max: 333.851. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-180160240320400SE +/- 0.75, N = 3SE +/- 0.58, N = 3SE +/- 0.41, N = 3SE +/- 1.47, N = 3SE +/- 1.52, N = 3SE +/- 0.84, N = 3SE +/- 2.88, N = 3162.59166.12133.55137.50137.66128.76387.511. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-170140210280350Min: 161.12 / Avg: 162.59 / Max: 163.61Min: 165.44 / Avg: 166.12 / Max: 167.27Min: 132.77 / Avg: 133.55 / Max: 134.14Min: 134.66 / Avg: 137.5 / Max: 139.59Min: 135.61 / Avg: 137.66 / Max: 140.62Min: 127.18 / Avg: 128.76 / Max: 130.06Min: 382.68 / Avg: 387.51 / Max: 392.651. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 48zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-190180270360450SE +/- 4.38, N = 3SE +/- 4.21, N = 3SE +/- 6.43, N = 6SE +/- 7.08, N = 6SE +/- 7.08, N = 6SE +/- 6.84, N = 6SE +/- 4.55, N = 3294.03292.22177.89176.41181.38153.63437.601. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 48zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-180160240320400Min: 288.73 / Avg: 294.03 / Max: 302.71Min: 284.17 / Avg: 292.22 / Max: 298.38Min: 159.34 / Avg: 177.89 / Max: 197.47Min: 153.47 / Avg: 176.41 / Max: 196.04Min: 157.66 / Avg: 181.38 / Max: 203.24Min: 135.63 / Avg: 153.63 / Max: 179.58Min: 430.98 / Avg: 437.6 / Max: 446.311. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 128zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-160120180240300SE +/- 0.99, N = 3SE +/- 2.00, N = 3SE +/- 4.96, N = 6SE +/- 5.76, N = 6SE +/- 5.85, N = 6SE +/- 4.52, N = 6SE +/- 6.29, N = 6203.76207.32102.0789.7597.7988.41259.951. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 128zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-150100150200250Min: 201.78 / Avg: 203.76 / Max: 204.88Min: 203.47 / Avg: 207.32 / Max: 210.18Min: 84.97 / Avg: 102.07 / Max: 118.02Min: 71.9 / Avg: 89.75 / Max: 110.12Min: 79.78 / Avg: 97.79 / Max: 118.14Min: 75.11 / Avg: 88.41 / Max: 104.93Min: 233.05 / Avg: 259.95 / Max: 275.181. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 256zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-170140210280350SE +/- 0.23, N = 3SE +/- 0.40, N = 3SE +/- 2.00, N = 6SE +/- 0.85, N = 3SE +/- 2.11, N = 6SE +/- 1.39, N = 6SE +/- 6.69, N = 3118.70120.1862.0055.5755.7758.47333.191. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 256zfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-160120180240300Min: 118.32 / Avg: 118.7 / Max: 119.12Min: 119.74 / Avg: 120.18 / Max: 120.97Min: 56.76 / Avg: 62 / Max: 69.12Min: 53.96 / Avg: 55.57 / Max: 56.82Min: 49.06 / Avg: 55.77 / Max: 61.92Min: 56.01 / Avg: 58.47 / Max: 64.77Min: 320.25 / Avg: 333.19 / Max: 342.571. (CC) gcc options: -lpopt -O2

IOzone

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-150100150200250SE +/- 0.79, N = 3SE +/- 0.57, N = 3SE +/- 0.58, N = 3SE +/- 1.22, N = 3SE +/- 1.25, N = 3SE +/- 1.26, N = 3SE +/- 0.24, N = 3215.34216.6386.07165.90167.0780.50111.881. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-14080120160200Min: 214.03 / Avg: 215.34 / Max: 216.76Min: 215.5 / Avg: 216.63 / Max: 217.24Min: 84.98 / Avg: 86.07 / Max: 86.95Min: 164.47 / Avg: 165.9 / Max: 168.32Min: 165.56 / Avg: 167.07 / Max: 169.54Min: 78.74 / Avg: 80.5 / Max: 82.93Min: 111.39 / Avg: 111.88 / Max: 112.121. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-150100150200250SE +/- 0.88, N = 3SE +/- 2.04, N = 3SE +/- 1.27, N = 3SE +/- 0.12, N = 3SE +/- 0.79, N = 3SE +/- 2.19, N = 6SE +/- 0.09, N = 3223.31224.7494.99173.68174.6384.95112.021. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-14080120160200Min: 221.57 / Avg: 223.31 / Max: 224.4Min: 220.66 / Avg: 224.74 / Max: 226.99Min: 93.66 / Avg: 94.99 / Max: 97.53Min: 173.55 / Avg: 173.68 / Max: 173.92Min: 173.19 / Avg: 174.63 / Max: 175.92Min: 81.2 / Avg: 84.95 / Max: 93.88Min: 111.85 / Avg: 112.02 / Max: 112.131. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1306090120150SE +/- 0.82, N = 3SE +/- 0.85, N = 3SE +/- 0.50, N = 3SE +/- 2.01, N = 6SE +/- 1.42, N = 6SE +/- 2.02, N = 6SE +/- 0.04, N = 3156.30157.7966.7965.2260.0072.07111.941. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1306090120150Min: 154.67 / Avg: 156.3 / Max: 157.23Min: 156.74 / Avg: 157.79 / Max: 159.47Min: 66.24 / Avg: 66.79 / Max: 67.8Min: 58.73 / Avg: 65.22 / Max: 71.05Min: 57.1 / Avg: 60 / Max: 65.15Min: 67.3 / Avg: 72.07 / Max: 81.1Min: 111.87 / Avg: 111.94 / Max: 111.991. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-14080120160200SE +/- 1.79, N = 3SE +/- 1.03, N = 3SE +/- 1.08, N = 3SE +/- 1.02, N = 6SE +/- 1.60, N = 6SE +/- 1.13, N = 3SE +/- 0.03, N = 3161.59162.0463.1061.4357.0074.06111.831. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1306090120150Min: 158.77 / Avg: 161.59 / Max: 164.92Min: 160.4 / Avg: 162.04 / Max: 163.93Min: 61.35 / Avg: 63.1 / Max: 65.07Min: 58.11 / Avg: 61.43 / Max: 64.56Min: 52.64 / Avg: 57 / Max: 62.51Min: 72.03 / Avg: 74.06 / Max: 75.93Min: 111.78 / Avg: 111.83 / Max: 111.851. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-150100150200250SE +/- 0.72, N = 3SE +/- 0.36, N = 3SE +/- 1.37, N = 4SE +/- 0.49, N = 3SE +/- 0.49, N = 3SE +/- 2.08, N = 6SE +/- 0.08, N = 3225.08226.3788.90174.56172.3884.86112.041. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-14080120160200Min: 223.68 / Avg: 225.08 / Max: 226.04Min: 225.64 / Avg: 226.37 / Max: 226.77Min: 85.77 / Avg: 88.9 / Max: 92.46Min: 173.86 / Avg: 174.56 / Max: 175.51Min: 171.49 / Avg: 172.38 / Max: 173.17Min: 80.99 / Avg: 84.86 / Max: 92.32Min: 111.87 / Avg: 112.04 / Max: 112.121. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-14080120160200SE +/- 2.73, N = 6SE +/- 2.94, N = 6SE +/- 1.77, N = 6SE +/- 0.92, N = 6SE +/- 0.37, N = 3SE +/- 3.14, N = 6SE +/- 0.04, N = 3156.04160.2860.0358.8755.7267.62111.941. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performancezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1306090120150Min: 147.87 / Avg: 156.04 / Max: 164.35Min: 153.6 / Avg: 160.28 / Max: 173.13Min: 51.66 / Avg: 60.03 / Max: 63.61Min: 57.22 / Avg: 58.87 / Max: 63.21Min: 54.99 / Avg: 55.72 / Max: 56.21Min: 60.89 / Avg: 67.62 / Max: 81.49Min: 111.88 / Avg: 111.94 / Max: 1121. (CC) gcc options: -O3

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compilezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1306090120150SE +/- 5.01, N = 6SE +/- 5.21, N = 6SE +/- 1.40, N = 3SE +/- 4.97, N = 6SE +/- 2.12, N = 6SE +/- 2.73, N = 6SE +/- 0.37, N = 3142.88147.1881.5961.6572.1391.69117.05
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compilezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-1306090120150Min: 118.1 / Avg: 142.88 / Max: 150.7Min: 121.26 / Avg: 147.18 / Max: 154.92Min: 79.68 / Avg: 81.59 / Max: 84.31Min: 39.42 / Avg: 61.65 / Max: 74.62Min: 66.78 / Avg: 72.13 / Max: 78.69Min: 84.43 / Avg: 91.69 / Max: 99.93Min: 116.35 / Avg: 117.05 / Max: 117.61

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-120406080100SE +/- 6.42, N = 3SE +/- 3.08, N = 3SE +/- 5.96, N = 3SE +/- 8.32, N = 3SE +/- 1.91, N = 3SE +/- 3.57, N = 3SE +/- 2.22, N = 382.4086.8550.1142.5448.4049.32100.89
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createzfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-120406080100Min: 69.68 / Avg: 82.4 / Max: 90.26Min: 80.72 / Avg: 86.85 / Max: 90.52Min: 39.26 / Avg: 50.11 / Max: 59.82Min: 26.3 / Avg: 42.54 / Max: 53.76Min: 44.83 / Avg: 48.4 / Max: 51.36Min: 45.55 / Avg: 49.32 / Max: 56.46Min: 96.84 / Avg: 100.89 / Max: 104.47

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-11428425670SE +/- 0.14, N = 3SE +/- 0.33, N = 3SE +/- 2.51, N = 3SE +/- 0.52, N = 3SE +/- 0.15, N = 3SE +/- 0.65, N = 3SE +/- 0.23, N = 364.6964.8360.7256.7255.7246.5864.91
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treezfs ssd mirror, ashift=13, recordsize 64k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 64k, raw imagezfs ssd mirror, ashift=13, recordsize 64k, zvolzfs ssd mirror, ashift=13, recordsize 8k, qcow2 imagezfs ssd mirror, ashift=13, recordsize 8k, raw imagezfs ssd mirror, ashift=13, recordsize 8k, zvolpve-ubuntu-fnas-11326395265Min: 64.52 / Avg: 64.69 / Max: 64.96Min: 64.19 / Avg: 64.83 / Max: 65.29Min: 58.05 / Avg: 60.72 / Max: 65.73Min: 55.68 / Avg: 56.72 / Max: 57.26Min: 55.49 / Avg: 55.72 / Max: 55.99Min: 45.51 / Avg: 46.58 / Max: 47.74Min: 64.46 / Avg: 64.91 / Max: 65.23