dev01-fs

VMware I/O performance testing

HTML result view exported from: https://openbenchmarking.org/result/2109209-IB-DEV01FS0507&sor.

dev01-fsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerVulkanxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 980112 x Intel Xeon Gold 6258R (223 Cores)Intel 440BX (VMW71.00V.16460286.B64.2006250725 BIOS)Intel 440BX/ZX/DX494GB537GB VMware Virtual NVMe Disk + 137GB VMware Virtual NVMe Disk + 1100GB VMware Virtual NVMe Disk + 4948GB VMware Virtual NVMe DiskVMware SVGA IIVMware VMXNET3Ubuntu 20.045.8.0-59-generic (x86_64)GCC 9.3.0xfs1176x885VMware2 x Intel Xeon Gold 6258R (112 Cores)Intel 440BX (6.00 BIOS)474GB2 x SK hynix PC401 NVMe 512GB + 4 x 2000GB Samsung SSD 980 PRO 2TB + 172GB Virtual disk5.11.0-34-generic (x86_64)1.0.2GCC 9.3.0 + Clang 10.0.0-4ubuntu15.4.0-84-generic (x86_64)5.11.0-34-generic (x86_64)zfsext4OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Details- xfs vNVME vSAN: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw / Block Size: 4096- xfs passthru raid0 2x Hynix: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw,sunit=64,swidth=128 / raid0 nvme1n1p1[1] nvme0n1p1[0] Block Size: 4096- xfs passthru 1x 980: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw / Block Size: 4096- xfs passthru raid0 4x 980: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw,sunit=64,swidth=256 / raid0 nvme5n1p1[3] nvme4n1p1[2] nvme3n1p1[1] nvme2n1p1[0] Block Size: 4096- xfs passthru raid5 4x 980: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw,sunit=1024,swidth=3072 / raid5 nvme5n1p1[4] nvme4n1p1[2] nvme3n1p1[1] nvme2n1p1[0] Block Size: 4096- ext4 passthru raid5 4x 980: NONE / noatime,rw,stripe=384 / raid5 nvme4n1[3] nvme5n1[2] nvme2n1[1] nvme3n1[0] Block Size: 4096Processor Details- CPU Microcode: 0x5003005Python Details- xfs vNVME vSAN: Python 2.7.18 + Python 3.8.10- xfs passthru raid0 2x Hynix: Python 3.8.10- xfs passthru 1x 980: Python 3.8.10- xfs passthru raid0 4x 980: Python 3.8.10- xfs passthru raid5 4x 980: Python 3.8.10- zfs passthru raidz1 4x 980: Python 3.8.10- zfs passthru raidz1 4x 980 dedup+lz4: Python 3.8.10- ext4 passthru raid5 4x 980: Python 3.8.10Security Details- xfs vNVME vSAN: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru raid0 2x Hynix: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru 1x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru raid0 4x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru raid5 4x 980: itlb_multihit: KVM: Vulnerable + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- zfs passthru raidz1 4x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- zfs passthru raidz1 4x 980 dedup+lz4: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- ext4 passthru raid5 4x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affectedDisk Scheduler Details- zfs passthru raidz1 4x 980, zfs passthru raidz1 4x 980 dedup+lz4: NONE

dev01-fsfio: Rand Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 512KB - Default Test Directorycompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treexfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98036793880270533538798700586702234446447895359315166726463273859847560872172534484428811872.66407.782465.6594924266718952337341880001350165194338829831962774198333196824275719366711951462000399795919152309.72487.302626.199832516672674331860220000183522626165228118223617761990002650328868222000169920926065208115923152278.30462.562610.2312003072002856353942241000178822023654726135927157481916672777344952243667179122023674729140928152298.12483.312513.9421.974572711451188640002274378171445711193318215.6533315122521886400022223705451454118631622152.95462.012419.801290330133208112163116679329125238950283081418363000201813613483339402121235192266531032.06201.851138.71127132520022341051268667977212184648726907135734733320791211310000966912053954025300970.40227.151075.94117630126727313384591176676958323164629533106110342648002702334446114267646772300459553210601613.80500.932500.45OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixxfs vNVME vSANxfs passthru raid5 4x 98030060090012001500SE +/- 31.22, N = 15SE +/- 25.30, N = 15SE +/- 12.03, N = 5SE +/- 25.23, N = 15SE +/- 26.17, N = 15SE +/- 7.00, N = 3SE +/- 3.10, N = 15SE +/- 3.39, N = 131290.01271.01200.01176.0983.0949.0367.021.91. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixxfs vNVME vSANxfs passthru raid5 4x 98070K140K210K280K350KSE +/- 8014.19, N = 15SE +/- 6445.52, N = 15SE +/- 3231.10, N = 5SE +/- 6470.79, N = 15SE +/- 6675.23, N = 15SE +/- 1763.83, N = 3SE +/- 816.86, N = 15SE +/- 1155.18, N = 133301333252003072003012672516672426679388074571. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru raid5 4x 980xfs vNVME vSANxfs passthru 1x 980xfs passthru raid0 2x Hynix6001200180024003000SE +/- 29.16, N = 5SE +/- 42.23, N = 15SE +/- 26.00, N = 3SE +/- 30.94, N = 4SE +/- 32.74, N = 3SE +/- 39.25, N = 152856273127112705267418951. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980 dedup+lz4zfs passthru raidz1 4x 980xfs passthru raid5 4x 980xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs vNVME vSANxfs passthru 1x 980xfs passthru raid0 2x Hynix5001000150020002500SE +/- 68.03, N = 12SE +/- 70.21, N = 15SE +/- 4.33, N = 3SE +/- 3.67, N = 5SE +/- 5.29, N = 15SE +/- 3.79, N = 4SE +/- 4.06, N = 3SE +/- 4.91, N = 15223421744513533383353312331. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSANxfs passthru raid5 4x 98030060090012001500SE +/- 7.31, N = 3SE +/- 3.21, N = 3SE +/- 1.76, N = 3SE +/- 2.40, N = 3SE +/- 6.98, N = 3SE +/- 6.20, N = 12SE +/- 4.40, N = 4121610519428607344593871881. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSANxfs passthru raid5 4x 98070K140K210K280K350KSE +/- 1763.83, N = 3SE +/- 881.92, N = 3SE +/- 577.35, N = 3SE +/- 577.35, N = 3SE +/- 1527.53, N = 3SE +/- 1563.47, N = 12SE +/- 1260.95, N = 431166726866724100022000018800011766798700640001. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980 dedup+lz4zfs passthru raidz1 4x 980xfs passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN2K4K6K8K10KSE +/- 113.09, N = 4SE +/- 90.92, N = 15SE +/- 32.92, N = 15SE +/- 13.78, N = 3SE +/- 23.95, N = 3SE +/- 13.60, N = 6SE +/- 5.90, N = 3SE +/- 27.37, N = 129772932922741835178813506955861. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN30060090012001500SE +/- 15.21, N = 35SE +/- 14.13, N = 4SE +/- 5.51, N = 15SE +/- 1.76, N = 3SE +/- 3.21, N = 3SE +/- 1.70, N = 6SE +/- 0.67, N = 3SE +/- 3.44, N = 121252121837822622016583701. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs passthru 1x 980xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru raid5 4x 9806001200180024003000SE +/- 11.22, N = 3SE +/- 11.24, N = 3SE +/- 33.04, N = 15SE +/- 17.04, N = 3SE +/- 23.82, N = 32616236523162234194317141. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980 dedup+lz4zfs passthru raidz1 4x 980xfs passthru 1x 980xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru raid5 4x 980xfs vNVME vSANxfs passthru raid0 2x Hynix10K20K30K40K50KSE +/- 458.35, N = 15SE +/- 1040.21, N = 12SE +/- 22.36, N = 3SE +/- 22.15, N = 3SE +/- 66.11, N = 15SE +/- 34.09, N = 3SE +/- 47.91, N = 346487389505228472646294571446438821. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs passthru raid0 4x 980xfs passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN30060090012001500SE +/- 9.03, N = 14SE +/- 18.59, N = 12SE +/- 13.95, N = 4SE +/- 10.02, N = 3SE +/- 7.95, N = 15SE +/- 0.88, N = 31359119311829835334781. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid5 4x 980xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN6K12K18K24K30KSE +/- 765.10, N = 12SE +/- 274.03, N = 15SE +/- 49.63, N = 12SE +/- 18.10, N = 14SE +/- 27.68, N = 4SE +/- 19.78, N = 3SE +/- 15.87, N = 15SE +/- 1.45, N = 32830826907318227152361196210619531. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixxfs passthru raid0 4x 980xfs vNVME vSANxfs passthru raid5 4x 98030060090012001500SE +/- 13.84, N = 3SE +/- 13.87, N = 3SE +/- 12.19, N = 15SE +/- 5.57, N = 3SE +/- 2.40, N = 3SE +/- 3.38, N = 3SE +/- 6.81, N = 3SE +/- 0.00, N = 31418.01357.01034.0776.0774.0748.0593.015.61. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixxfs passthru raid0 4x 980xfs vNVME vSANxfs passthru raid5 4x 98080K160K240K320K400KSE +/- 3511.88, N = 3SE +/- 3282.95, N = 3SE +/- 3147.49, N = 15SE +/- 1527.53, N = 3SE +/- 666.67, N = 3SE +/- 881.92, N = 3SE +/- 1763.83, N = 336300034733326480019900019833319166715166753331. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru 1x 980xfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru raid5 4x 9806001200180024003000SE +/- 35.50, N = 3SE +/- 13.65, N = 3SE +/- 14.22, N = 3SE +/- 29.36, N = 15SE +/- 38.32, N = 12SE +/- 17.03, N = 32777270226502646196815121. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980 dedup+lz4zfs passthru raidz1 4x 980xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru 1x 980xfs vNVME vSANxfs passthru raid5 4x 980xfs passthru raid0 2x Hynix400800120016002000SE +/- 43.47, N = 15SE +/- 45.72, N = 15SE +/- 4.48, N = 3SE +/- 1.73, N = 3SE +/- 1.76, N = 3SE +/- 3.69, N = 15SE +/- 2.91, N = 3SE +/- 4.84, N = 12207920183443343283272522421. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSANxfs passthru raid5 4x 98030060090012001500SE +/- 5.29, N = 3SE +/- 13.05, N = 3SE +/- 7.57, N = 3SE +/- 2.19, N = 3SE +/- 7.64, N = 3SE +/- 5.48, N = 15SE +/- 6.67, N = 12136112119528687574463851881. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSANxfs passthru raid5 4x 98070K140K210K280K350KSE +/- 1201.85, N = 3SE +/- 3511.88, N = 3SE +/- 1763.83, N = 3SE +/- 2185.81, N = 3SE +/- 1357.40, N = 15SE +/- 1697.69, N = 1234833331000024366722200019366711426798475640001. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980 dedup+lz4zfs passthru raidz1 4x 980xfs passthru raid5 4x 980xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN2K4K6K8K10KSE +/- 110.57, N = 3SE +/- 157.49, N = 9SE +/- 34.07, N = 14SE +/- 1.53, N = 3SE +/- 6.39, N = 3SE +/- 8.92, N = 11SE +/- 15.55, N = 15SE +/- 20.16, N = 159669940222221791169911956466081. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid5 4x 980xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN30060090012001500SE +/- 17.59, N = 15SE +/- 14.01, N = 3SE +/- 5.70, N = 14SE +/- 1.15, N = 11SE +/- 1.94, N = 15SE +/- 2.49, N = 151212120537022020914677721. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs passthru 1x 980xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru raid0 2x Hynixxfs vNVME vSANxfs passthru raid5 4x 9806001200180024003000SE +/- 8.41, N = 3SE +/- 9.68, N = 3SE +/- 40.82, N = 15SE +/- 41.03, N = 12SE +/- 17.64, N = 15260623672300200017255451. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980 dedup+lz4zfs passthru raidz1 4x 980xfs passthru 1x 980xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs passthru raid0 2x Hynixxfs vNVME vSANxfs passthru raid5 4x 9808K16K24K32K40KSE +/- 584.30, N = 15SE +/- 1058.12, N = 12SE +/- 17.03, N = 3SE +/- 19.85, N = 3SE +/- 81.61, N = 15SE +/- 82.05, N = 12SE +/- 35.27, N = 1539540351925208472945953997344814541. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs passthru raid0 4x 980xfs passthru raid5 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN30060090012001500SE +/- 6.17, N = 3SE +/- 14.25, N = 4SE +/- 9.35, N = 15SE +/- 4.04, N = 3SE +/- 9.52, N = 15SE +/- 7.31, N = 121409118611599595324421. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryzfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4xfs passthru raid5 4x 980xfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid0 2x Hynixext4 passthru raid5 4x 980xfs vNVME vSAN6K12K18K24K30KSE +/- 497.89, N = 15SE +/- 251.66, N = 3SE +/- 38.25, N = 4SE +/- 12.35, N = 3SE +/- 18.69, N = 15SE +/- 8.29, N = 3SE +/- 19.05, N = 15SE +/- 14.51, N = 122665325300316228152315191510608811. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compilexfs passthru raid0 2x Hynixxfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid5 4x 980xfs vNVME vSANext4 passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz45001000150020002500SE +/- 25.06, N = 4SE +/- 11.28, N = 3SE +/- 15.18, N = 14SE +/- 17.03, N = 15SE +/- 13.69, N = 15SE +/- 22.78, N = 3SE +/- 14.12, N = 3SE +/- 9.57, N = 152309.722298.122278.302152.951872.661613.801032.06970.40

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createext4 passthru raid5 4x 980xfs passthru raid0 2x Hynixxfs passthru raid0 4x 980xfs passthru 1x 980xfs passthru raid5 4x 980xfs vNVME vSANzfs passthru raidz1 4x 980 dedup+lz4zfs passthru raidz1 4x 980110220330440550SE +/- 5.61, N = 3SE +/- 2.26, N = 3SE +/- 2.38, N = 3SE +/- 3.32, N = 3SE +/- 3.30, N = 3SE +/- 4.50, N = 3SE +/- 3.07, N = 3SE +/- 4.95, N = 3500.93487.30483.31462.56462.01407.78227.15201.85

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treexfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980ext4 passthru raid5 4x 980xfs vNVME vSANxfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz46001200180024003000SE +/- 9.01, N = 3SE +/- 13.93, N = 3SE +/- 48.76, N = 3SE +/- 61.62, N = 3SE +/- 40.68, N = 3SE +/- 38.29, N = 3SE +/- 22.28, N = 3SE +/- 10.94, N = 32626.192610.232513.942500.452465.652419.801138.711075.94

Phoronix Test Suite v10.8.4