zfs-fio

KVM testing on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2104267-HA-ZFSFIO38243
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
volblocksize=8k
April 26 2021
  2 Hours, 30 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

volblocksize=8k

Processor: 2 x Intel Xeon Gold 5218R (4 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) (0.0.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 16GB, Disk: 215GB QEMU HDD, Graphics: bochs-drmdrmfb, Monitor: QEMU Monitor, Network: Red Hat Virtio device

OS: Ubuntu 20.04, Kernel: 5.4.0-72-generic (x86_64), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: KVM

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x1
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

zfs-fioOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon Gold 5218R (4 Cores)QEMU Standard PC (i440FX + PIIX 1996) (0.0.0 BIOS)Intel 440FX 82441FX PMC16GB215GB QEMU HDDbochs-drmdrmfbQEMU MonitorRed Hat Virtio deviceUbuntu 20.045.4.0-72-generic (x86_64)GCC 9.3.0ext41024x768KVMProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerZfs-fio BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - NONE / relatime,rw / Block Size: 4096- CPU Microcode: 0x1- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

zfs-fiofio: Rand Write - Linux AIO - No - Yes - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 8KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 8KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 32KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 32KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 256KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 256KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 512KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 512KB - Default Test Directoryvolblocksize=8k2737.2473232210.153833600.676885549.68135209726.839232913073.246491621744.649139571192.79655072933.1455861OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryvolblocksize=8k6001200180024003000SE +/- 1020.89, N = 132737.251. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directoryvolblocksize=8k7001400210028003500SE +/- 1147.58, N = 1132321. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryvolblocksize=8k50100150200250SE +/- 64.68, N = 13210.11. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryvolblocksize=8k12K24K36K48K60KSE +/- 16585.10, N = 13538331. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryvolblocksize=8k130260390520650SE +/- 132.92, N = 15600.61. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directoryvolblocksize=8k16K32K48K64K80KSE +/- 17014.66, N = 15768851. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directoryvolblocksize=8k120240360480600SE +/- 259.51, N = 12549.681. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directoryvolblocksize=8k8K16K24K32K40KSE +/- 16635.99, N = 12352091. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 32KB - Disk Target: Default Test Directoryvolblocksize=8k160320480640800SE +/- 456.95, N = 12726.841. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 32KB - Disk Target: Default Test Directoryvolblocksize=8k5K10K15K20K25KSE +/- 14649.07, N = 12232911. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryvolblocksize=8k7001400210028003500SE +/- 677.75, N = 153073.251. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directoryvolblocksize=8k11K22K33K44K55KSE +/- 10841.25, N = 15491621. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directoryvolblocksize=8k400800120016002000SE +/- 842.26, N = 151744.651. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directoryvolblocksize=8k3K6K9K12K15KSE +/- 6740.18, N = 15139571. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 256KB - Disk Target: Default Test Directoryvolblocksize=8k30060090012001500SE +/- 631.89, N = 151192.801. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 256KB - Disk Target: Default Test Directoryvolblocksize=8k12002400360048006000SE +/- 2877.97, N = 1355071. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: Default Test Directoryvolblocksize=8k6001200180024003000SE +/- 990.77, N = 152933.151. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: Default Test Directoryvolblocksize=8k13002600390052006500SE +/- 1980.75, N = 1558611. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

18 Results Shown

Flexible IO Tester:
  Rand Write - Linux AIO - No - Yes - 1MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 8KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 16KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 32KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 64KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 128KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 256KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 512KB - Default Test Directory:
    MB/s
    IOPS

volblocksize=8k

Processor: 2 x Intel Xeon Gold 5218R (4 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) (0.0.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 16GB, Disk: 215GB QEMU HDD, Graphics: bochs-drmdrmfb, Monitor: QEMU Monitor, Network: Red Hat Virtio device

OS: Ubuntu 20.04, Kernel: 5.4.0-72-generic (x86_64), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: KVM

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x1
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 26 April 2021 09:25 by user smorozov.