dev01-fs

VMware I/O performance testing

HTML result view exported from: https://openbenchmarking.org/result/2109209-IB-DEV01FS0507&grt.

dev01-fsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerVulkanxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 980112 x Intel Xeon Gold 6258R (223 Cores)Intel 440BX (VMW71.00V.16460286.B64.2006250725 BIOS)Intel 440BX/ZX/DX494GB537GB VMware Virtual NVMe Disk + 137GB VMware Virtual NVMe Disk + 1100GB VMware Virtual NVMe Disk + 4948GB VMware Virtual NVMe DiskVMware SVGA IIVMware VMXNET3Ubuntu 20.045.8.0-59-generic (x86_64)GCC 9.3.0xfs1176x885VMware2 x Intel Xeon Gold 6258R (112 Cores)Intel 440BX (6.00 BIOS)474GB2 x SK hynix PC401 NVMe 512GB + 4 x 2000GB Samsung SSD 980 PRO 2TB + 172GB Virtual disk5.11.0-34-generic (x86_64)1.0.2GCC 9.3.0 + Clang 10.0.0-4ubuntu15.4.0-84-generic (x86_64)5.11.0-34-generic (x86_64)zfsext4OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Details- xfs vNVME vSAN: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw / Block Size: 4096- xfs passthru raid0 2x Hynix: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw,sunit=64,swidth=128 / raid0 nvme1n1p1[1] nvme0n1p1[0] Block Size: 4096- xfs passthru 1x 980: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw / Block Size: 4096- xfs passthru raid0 4x 980: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw,sunit=64,swidth=256 / raid0 nvme5n1p1[3] nvme4n1p1[2] nvme3n1p1[1] nvme2n1p1[0] Block Size: 4096- xfs passthru raid5 4x 980: NONE / attr2,inode64,logbsize=32k,logbufs=8,noatime,noquota,rw,sunit=1024,swidth=3072 / raid5 nvme5n1p1[4] nvme4n1p1[2] nvme3n1p1[1] nvme2n1p1[0] Block Size: 4096- ext4 passthru raid5 4x 980: NONE / noatime,rw,stripe=384 / raid5 nvme4n1[3] nvme5n1[2] nvme2n1[1] nvme3n1[0] Block Size: 4096Processor Details- CPU Microcode: 0x5003005Python Details- xfs vNVME vSAN: Python 2.7.18 + Python 3.8.10- xfs passthru raid0 2x Hynix: Python 3.8.10- xfs passthru 1x 980: Python 3.8.10- xfs passthru raid0 4x 980: Python 3.8.10- xfs passthru raid5 4x 980: Python 3.8.10- zfs passthru raidz1 4x 980: Python 3.8.10- zfs passthru raidz1 4x 980 dedup+lz4: Python 3.8.10- ext4 passthru raid5 4x 980: Python 3.8.10Security Details- xfs vNVME vSAN: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru raid0 2x Hynix: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru 1x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru raid0 4x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- xfs passthru raid5 4x 980: itlb_multihit: KVM: Vulnerable + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- zfs passthru raidz1 4x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- zfs passthru raidz1 4x 980 dedup+lz4: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- ext4 passthru raid5 4x 980: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affectedDisk Scheduler Details- zfs passthru raidz1 4x 980, zfs passthru raidz1 4x 980 dedup+lz4: NONE

dev01-fscompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treefio: Rand Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Rand Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Rand Write - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 4KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 8MB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Read - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 512KB - Default Test Directoryfio: Seq Write - IO_uring - Yes - No - 512KB - Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9801872.66407.782465.6536793880270533538798700586702234446447895359315166726463273859847560872172534484428812309.72487.302626.1994924266718952337341880001350165194338829831962774198333196824275719366711951462000399795919152278.30462.562610.239832516672674331860220000183522626165228118223617761990002650328868222000169920926065208115923152298.12483.312513.9412003072002856353942241000178822023654726135927157481916672777344952243667179122023674729140928152152.95462.012419.8021.974572711451188640002274378171445711193318215.6533315122521886400022223705451454118631621032.06201.851138.71129033013320811216311667932912523895028308141836300020181361348333940212123519226653970.40227.151075.941271325200223410512686679772121846487269071357347333207912113100009669120539540253001613.80500.932500.4511763012672731338459117667695832316462953310611034264800270233444611426764677230045955321060OpenBenchmarking.org

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compilexfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9805001000150020002500SE +/- 13.69, N = 15SE +/- 25.06, N = 4SE +/- 15.18, N = 14SE +/- 11.28, N = 3SE +/- 17.03, N = 15SE +/- 14.12, N = 3SE +/- 9.57, N = 15SE +/- 22.78, N = 31872.662309.722278.302298.122152.951032.06970.401613.80

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 980110220330440550SE +/- 4.50, N = 3SE +/- 2.26, N = 3SE +/- 3.32, N = 3SE +/- 2.38, N = 3SE +/- 3.30, N = 3SE +/- 4.95, N = 3SE +/- 3.07, N = 3SE +/- 5.61, N = 3407.78487.30462.56483.31462.01201.85227.15500.93

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treexfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9806001200180024003000SE +/- 40.68, N = 3SE +/- 9.01, N = 3SE +/- 13.93, N = 3SE +/- 48.76, N = 3SE +/- 38.29, N = 3SE +/- 22.28, N = 3SE +/- 10.94, N = 3SE +/- 61.62, N = 32465.652626.192610.232513.942419.801138.711075.942500.45

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98030060090012001500SE +/- 3.10, N = 15SE +/- 7.00, N = 3SE +/- 26.17, N = 15SE +/- 12.03, N = 5SE +/- 3.39, N = 13SE +/- 31.22, N = 15SE +/- 25.30, N = 15SE +/- 25.23, N = 15367.0949.0983.01200.021.91290.01271.01176.01. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98070K140K210K280K350KSE +/- 816.86, N = 15SE +/- 1763.83, N = 3SE +/- 6675.23, N = 15SE +/- 3231.10, N = 5SE +/- 1155.18, N = 13SE +/- 8014.19, N = 15SE +/- 6445.52, N = 15SE +/- 6470.79, N = 159388024266725166730720074573301333252003012671. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980ext4 passthru raid5 4x 9806001200180024003000SE +/- 30.94, N = 4SE +/- 39.25, N = 15SE +/- 32.74, N = 3SE +/- 29.16, N = 5SE +/- 26.00, N = 3SE +/- 42.23, N = 152705189526742856271127311. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9805001000150020002500SE +/- 3.79, N = 4SE +/- 4.91, N = 15SE +/- 4.06, N = 3SE +/- 3.67, N = 5SE +/- 4.33, N = 3SE +/- 70.21, N = 15SE +/- 68.03, N = 12SE +/- 5.29, N = 15335233331353451217422343381. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98030060090012001500SE +/- 4.40, N = 4SE +/- 6.98, N = 3SE +/- 2.40, N = 3SE +/- 1.76, N = 3SE +/- 7.31, N = 3SE +/- 3.21, N = 3SE +/- 6.20, N = 12387734860942188121610514591. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98070K140K210K280K350KSE +/- 1260.95, N = 4SE +/- 1527.53, N = 3SE +/- 577.35, N = 3SE +/- 577.35, N = 3SE +/- 1763.83, N = 3SE +/- 881.92, N = 3SE +/- 1563.47, N = 1298700188000220000241000640003116672686671176671. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9802K4K6K8K10KSE +/- 27.37, N = 12SE +/- 13.60, N = 6SE +/- 13.78, N = 3SE +/- 23.95, N = 3SE +/- 32.92, N = 15SE +/- 90.92, N = 15SE +/- 113.09, N = 4SE +/- 5.90, N = 35861350183517882274932997726951. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98030060090012001500SE +/- 3.44, N = 12SE +/- 1.70, N = 6SE +/- 1.76, N = 3SE +/- 3.21, N = 3SE +/- 5.51, N = 15SE +/- 15.21, N = 35SE +/- 14.13, N = 4SE +/- 0.67, N = 37016522622037812521218831. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980ext4 passthru raid5 4x 9806001200180024003000SE +/- 17.04, N = 3SE +/- 23.82, N = 3SE +/- 11.22, N = 3SE +/- 11.24, N = 3SE +/- 33.04, N = 152234194326162365171423161. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98010K20K30K40K50KSE +/- 34.09, N = 3SE +/- 47.91, N = 3SE +/- 22.36, N = 3SE +/- 22.15, N = 3SE +/- 1020.14, N = 12SE +/- 458.35, N = 15SE +/- 66.11, N = 1544643882522847264571383924648746291. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980ext4 passthru raid5 4x 98030060090012001500SE +/- 0.88, N = 3SE +/- 10.02, N = 3SE +/- 13.95, N = 4SE +/- 9.03, N = 14SE +/- 18.59, N = 12SE +/- 7.95, N = 154789831182135911935331. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9806K12K18K24K30KSE +/- 1.45, N = 3SE +/- 19.78, N = 3SE +/- 27.68, N = 4SE +/- 18.10, N = 14SE +/- 49.63, N = 12SE +/- 610.27, N = 12SE +/- 274.03, N = 15SE +/- 15.87, N = 159531962236127153182273002690710611. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98030060090012001500SE +/- 6.81, N = 3SE +/- 2.40, N = 3SE +/- 5.57, N = 3SE +/- 3.38, N = 3SE +/- 0.00, N = 3SE +/- 13.84, N = 3SE +/- 13.87, N = 3SE +/- 12.19, N = 15593.0774.0776.0748.015.61418.01357.01034.01. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98080K160K240K320K400KSE +/- 1763.83, N = 3SE +/- 666.67, N = 3SE +/- 1527.53, N = 3SE +/- 881.92, N = 3SE +/- 3511.88, N = 3SE +/- 3282.95, N = 3SE +/- 3147.49, N = 1515166719833319900019166753333630003473332648001. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980ext4 passthru raid5 4x 9806001200180024003000SE +/- 29.36, N = 15SE +/- 38.32, N = 12SE +/- 14.22, N = 3SE +/- 35.50, N = 3SE +/- 17.03, N = 3SE +/- 13.65, N = 32646196826502777151227021. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 980400800120016002000SE +/- 3.69, N = 15SE +/- 4.84, N = 12SE +/- 1.76, N = 3SE +/- 4.48, N = 3SE +/- 2.91, N = 3SE +/- 52.64, N = 15SE +/- 43.47, N = 15SE +/- 1.73, N = 3327242328344252194520793341. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98030060090012001500SE +/- 6.67, N = 12SE +/- 7.64, N = 3SE +/- 2.19, N = 3SE +/- 7.57, N = 3SE +/- 5.29, N = 3SE +/- 13.05, N = 3SE +/- 5.48, N = 15385757868952188136112114461. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98070K140K210K280K350KSE +/- 1697.69, N = 12SE +/- 2185.81, N = 3SE +/- 1763.83, N = 3SE +/- 1201.85, N = 3SE +/- 3511.88, N = 3SE +/- 1357.40, N = 1598475193667222000243667640003483333100001142671. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9802K4K6K8K10KSE +/- 20.16, N = 15SE +/- 8.92, N = 11SE +/- 6.39, N = 3SE +/- 1.53, N = 3SE +/- 34.07, N = 14SE +/- 157.49, N = 9SE +/- 110.57, N = 3SE +/- 15.55, N = 156081195169917912222940296696461. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 98030060090012001500SE +/- 2.49, N = 15SE +/- 1.15, N = 11SE +/- 5.70, N = 14SE +/- 17.59, N = 15SE +/- 14.01, N = 3SE +/- 1.94, N = 157214620922037012121205771. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980ext4 passthru raid5 4x 9806001200180024003000SE +/- 17.64, N = 15SE +/- 41.03, N = 12SE +/- 8.41, N = 3SE +/- 9.68, N = 3SE +/- 40.82, N = 15172520002606236754523001. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9808K16K24K32K40KSE +/- 35.27, N = 15SE +/- 82.05, N = 12SE +/- 17.03, N = 3SE +/- 19.85, N = 3SE +/- 1058.12, N = 12SE +/- 584.30, N = 15SE +/- 81.61, N = 1534483997520847291454351923954045951. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980ext4 passthru raid5 4x 98030060090012001500SE +/- 7.31, N = 12SE +/- 4.04, N = 3SE +/- 9.35, N = 15SE +/- 6.17, N = 3SE +/- 14.25, N = 4SE +/- 9.52, N = 154429591159140911865321. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directoryxfs vNVME vSANxfs passthru raid0 2x Hynixxfs passthru 1x 980xfs passthru raid0 4x 980xfs passthru raid5 4x 980zfs passthru raidz1 4x 980zfs passthru raidz1 4x 980 dedup+lz4ext4 passthru raid5 4x 9806K12K18K24K30KSE +/- 14.51, N = 12SE +/- 8.29, N = 3SE +/- 18.69, N = 15SE +/- 12.35, N = 3SE +/- 38.25, N = 4SE +/- 497.89, N = 15SE +/- 251.66, N = 3SE +/- 19.05, N = 158811915231528153162266532530010601. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Phoronix Test Suite v10.8.4