45drivesxl60

2 x AMD EPYC 7513 32-Core testing with a Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) and Matrox G200eW3 on Debian GNU/Linux 11 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2209212-NE-2209211NE32&gru&sor.

45drivesxl60ProcessorMotherboardMemoryDiskChipsetGraphicsMonitorNetworkOSKernelCompilerFile-SystemVulkanScreen Resolution10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2Intel Xeon Silver 4216 (32 Cores)45Drives XL60 0123456789256GB742117GBFreeBSD12.2-RELEASE-p10 (x86_64)Clang 10.0.1zfs2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads)Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS)AMD Starship/Matisse8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8Matrox G200eW3DELL E172FP4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIeDebian GNU/Linux 115.15.30-2-pve (x86_64)1.0.2GCC 10.2.1 20210110ext41280x1024zfsext4zfsOpenBenchmarking.orgKernel Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: Transparent Huge Pages: madviseCompiler Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- DELL ENT NVME SSD1: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- DELL SAMSUNG SSD4: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- DELL ENTERPRISE NVME: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- SAMSUNG ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- DELLENT ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- PERC RAID1 SAMSUNG 256-A-D-C: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- PERC RAID1 DELL ENT. H755: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- 4xNVME ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- DELLENT ZFS MIRROR2: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- SAMSUNG ZFS MIRROR2: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072Processor Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: CPU Microcode: 0xa00115dSecurity Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

45drivesxl60fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR21753339230015666772700188000127000146933730336853609083735495913117733311033315700093500188000135667131333913006924327355291783331293331563339573318933313766713260099900697505739537699118260156116177183178711553162327.371.320328.170.320319619598256242632716400630676385171331663338.424.4205424624.3208079121381210061233763318300225006150094571830047.2240228687.6240228595511829913318000058733496334401333539175443349140388703621017201382614573406804985831850005736751633434467333333528474844638672164541698130260747172662220533326339613224003436739767217002240080.51282798134157280112022754468004294212767187005210048167131671978718316823342041882475159116459339211880057225442334598673153335370738433365464553017971232480571556724107000182000571675143342392931960053575497004187116430165612486213714666989738318033357600518674610003350005206748936381704648218011309611771986511OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2DELLENT ZFS MIRROR2SAMSUNG ZFS MIRRORDELLENT ZFS MIRRORSAMSUNG ZFS MIRROR24xNVME ZFS MIRRORPERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD140K80K120K160K200KSE +/- 666.67, N = 3SE +/- 666.67, N = 3SE +/- 666.67, N = 3SE +/- 577.35, N = 3SE +/- 366.67, N = 3SE +/- 2927.48, N = 12SE +/- 3366.00, N = 12SE +/- 5435.76, N = 12SE +/- 1886.59, N = 15SE +/- 4.63, N = 3SE +/- 14.33, N = 31786671773331753331070009913398583973839339246800205331210098256991

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryDELLENT ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2SAMSUNG ZFS MIRRORMirrors4xNVME ZFS MIRROR5 Per VDEV RaidZ210 Per VDEV RaidZ2DELL ENTERPRISE NVMEPERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENT NVME SSD1DELL SAMSUNG SSD440K80K120K160K200KSE +/- 1527.53, N = 3SE +/- 1944.47, N = 15SE +/- 2728.45, N = 3SE +/- 1452.97, N = 3SE +/- 1313.66, N = 15SE +/- 881.92, N = 3SE +/- 416.33, N = 3SE +/- 66.67, N = 3SE +/- 1055.04, N = 12SE +/- 283.12, N = 15SE +/- 222.92, N = 15SE +/- 1.86, N = 318500018200018033318000012933311880011033392300612334294232633182606242

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory5 Per VDEV RaidZ210 Per VDEV RaidZ2MirrorsSAMSUNG ZFS MIRRORSAMSUNG ZFS MIRROR2DELLENT ZFS MIRROR4xNVME ZFS MIRRORDELLENT ZFS MIRROR2PERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD130K60K90K120K150KSE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 600.93, N = 3SE +/- 577.35, N = 3SE +/- 578.31, N = 3SE +/- 668.80, N = 4SE +/- 384.42, N = 3SE +/- 33.33, N = 3SE +/- 26.74, N = 3SE +/- 3.79, N = 3SE +/- 43.75, N = 3SE +/- 2.89, N = 31570001566671563335873357600573675722557167127679613763363271561

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2SAMSUNG ZFS MIRROR2DELLENT ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR4xNVME ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H755DELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD120K40K60K80K100KSE +/- 517.47, N = 3SE +/- 757.19, N = 3SE +/- 862.17, N = 3SE +/- 333.33, N = 3SE +/- 480.74, N = 3SE +/- 296.27, N = 3SE +/- 120.19, N = 3SE +/- 536.45, N = 3SE +/- 57.74, N = 3SE +/- 10.41, N = 39573393500727005186751633514334963344233224001870018300164001617

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAMSUNG ZFS MIRROR24xNVME ZFS MIRRORSAMSUNG ZFS MIRRORDELLENT ZFS MIRRORDELLENT ZFS MIRROR2Mirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2DELL SAMSUNG SSD4PERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENTERPRISE NVMEDELL ENT NVME SSD1100K200K300K400K500KSE +/- 1527.53, N = 3SE +/- 8694.21, N = 15SE +/- 10885.49, N = 15SE +/- 7940.17, N = 15SE +/- 11135.26, N = 14SE +/- 333.33, N = 3SE +/- 577.35, N = 3SE +/- 577.35, N = 3SE +/- 33.33, N = 3SE +/- 100.00, N = 3SE +/- 33.33, N = 3SE +/- 11.72, N = 3461000459867440133434467423929189333188000188000630675210034367225007183

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAMSUNG ZFS MIRRORSAMSUNG ZFS MIRROR2DELLENT ZFS MIRRORDELLENT ZFS MIRROR24xNVME ZFS MIRRORMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2DELL ENTERPRISE NVMEPERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENT NVME SSD1DELL SAMSUNG SSD480K160K240K320K400KSE +/- 5411.07, N = 12SE +/- 3386.25, N = 6SE +/- 3073.18, N = 15SE +/- 4423.75, N = 15SE +/- 7030.32, N = 15SE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 57.74, N = 3SE +/- 185.59, N = 3SE +/- 384.42, N = 3SE +/- 180.48, N = 14SE +/- 1.20, N = 3353917335000333333319600315333137667135667127000615004816739767178716385

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ2Mirrors5 Per VDEV RaidZ2SAMSUNG ZFS MIRROR4xNVME ZFS MIRRORDELLENT ZFS MIRROR2DELLENT ZFS MIRRORSAMSUNG ZFS MIRROR2PERC RAID1 SAMSUNG 256-A-D-CDELL SAMSUNG SSD4PERC RAID1 DELL ENT. H755DELL ENTERPRISE NVMEDELL ENT NVME SSD130K60K90K120K150KSE +/- 2369.38, N = 15SE +/- 1400.00, N = 5SE +/- 333.33, N = 3SE +/- 693.62, N = 3SE +/- 548.72, N = 15SE +/- 673.76, N = 4SE +/- 522.53, N = 15SE +/- 837.89, N = 15SE +/- 351.19, N = 3SE +/- 33.33, N = 3SE +/- 88.19, N = 3SE +/- 4.33, N = 3SE +/- 4.10, N = 3146933132600131333544335370753575528475206721700171331316794571553

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2DELLENT ZFS MIRROR2SAMSUNG ZFS MIRRORSAMSUNG ZFS MIRROR2DELLENT ZFS MIRROR4xNVME ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H755DELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD120K40K60K80K100KSE +/- 1081.67, N = 3SE +/- 709.46, N = 3SE +/- 924.36, N = 3SE +/- 351.19, N = 3SE +/- 376.59, N = 10SE +/- 633.98, N = 14SE +/- 752.31, N = 13SE +/- 133.33, N = 3SE +/- 141.04, N = 15SE +/- 33.33, N = 3SE +/- 4.84, N = 39990091300730334970049140489364844638433224001978718300166331623

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2DELLENT ZFS MIRROR2SAMSUNG ZFS MIRRORDELLENT ZFS MIRRORSAMSUNG ZFS MIRROR24xNVME ZFS MIRRORPERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD1150300450600750SE +/- 2.85, N = 3SE +/- 2.67, N = 3SE +/- 3.06, N = 3SE +/- 2.08, N = 3SE +/- 1.33, N = 3SE +/- 11.53, N = 12SE +/- 13.16, N = 12SE +/- 21.18, N = 12SE +/- 7.35, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3697.0692.0685.0418.0388.0386.0381.0365.0183.080.547.238.427.3

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryDELLENT ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2SAMSUNG ZFS MIRRORMirrors4xNVME ZFS MIRROR5 Per VDEV RaidZ210 Per VDEV RaidZ2DELL ENTERPRISE NVMEPERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENT NVME SSD1DELL SAMSUNG SSD4160320480640800SE +/- 6.23, N = 3SE +/- 7.59, N = 15SE +/- 10.09, N = 3SE +/- 0.67, N = 3SE +/- 5.61, N = 3SE +/- 4.95, N = 15SE +/- 2.33, N = 3SE +/- 1.76, N = 3SE +/- 0.33, N = 3SE +/- 4.12, N = 12SE +/- 1.07, N = 15SE +/- 0.86, N = 15SE +/- 0.00, N = 3721.0711.0704.0703.0505.0464.0432.0360.0240.0168.0128.071.324.4

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ2SAMSUNG ZFS MIRROR2DELLENT ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR4xNVME ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H755DELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD12K4K6K8K10KSE +/- 108.58, N = 3SE +/- 40.18, N = 3SE +/- 58.30, N = 3SE +/- 39.43, N = 3SE +/- 15.21, N = 3SE +/- 65.54, N = 3SE +/- 1.33, N = 3SE +/- 6.39, N = 3SE +/- 1.53, N = 3SE +/- 1.45, N = 39083648264546430621055302798233422862054203

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAMSUNG ZFS MIRROR24xNVME ZFS MIRRORSAMSUNG ZFS MIRRORDELLENT ZFS MIRRORDELLENT ZFS MIRROR2Mirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2DELL SAMSUNG SSD4PERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENTERPRISE NVMEDELL ENT NVME SSD1400800120016002000SE +/- 6.77, N = 3SE +/- 33.83, N = 15SE +/- 42.44, N = 15SE +/- 30.86, N = 15SE +/- 43.36, N = 14SE +/- 1.67, N = 3SE +/- 1.76, N = 3SE +/- 1.76, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.32, N = 3SE +/- 0.06, N = 31801.01797.01720.01698.01656.0739.0735.0735.0246.0204.0134.087.628.1

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAMSUNG ZFS MIRRORSAMSUNG ZFS MIRROR2DELLENT ZFS MIRRORDELLENT ZFS MIRROR24xNVME ZFS MIRRORMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2DELL ENTERPRISE NVMEPERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENT NVME SSD1DELL SAMSUNG SSD430060090012001500SE +/- 21.11, N = 12SE +/- 13.25, N = 6SE +/- 11.95, N = 15SE +/- 17.29, N = 15SE +/- 27.37, N = 15SE +/- 1.20, N = 3SE +/- 0.67, N = 3SE +/- 0.73, N = 14SE +/- 0.30, N = 31382.01309.01302.01248.01232.0537.0529.0495.0240.0188.0157.070.324.3

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ2DELLENT ZFS MIRROR2SAMSUNG ZFS MIRRORSAMSUNG ZFS MIRROR2DELLENT ZFS MIRROR4xNVME ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H755DELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD12K4K6K8K10KSE +/- 114.13, N = 3SE +/- 44.24, N = 3SE +/- 46.95, N = 10SE +/- 78.92, N = 14SE +/- 85.11, N = 13SE +/- 17.49, N = 3SE +/- 1.86, N = 3SE +/- 17.87, N = 15SE +/- 0.67, N = 3SE +/- 1.20, N = 3SE +/- 0.67, N = 39131621361456117607448052801247522852080203

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectorySAMSUNG ZFS MIRRORSAMSUNG ZFS MIRROR2DELLENT ZFS MIRROR4xNVME ZFS MIRRORDELLENT ZFS MIRROR2PERC RAID1 DELL ENT. H755PERC RAID1 SAMSUNG 256-A-D-CDELL ENTERPRISE NVMEDELL SAMSUNG SSD4DELL ENT NVME SSD116003200480064008000SE +/- 74.71, N = 3SE +/- 71.04, N = 3SE +/- 69.68, N = 3SE +/- 83.90, N = 4SE +/- 48.90, N = 3SE +/- 3.18, N = 3SE +/- 3.38, N = 3SE +/- 0.33, N = 3SE +/- 5.24, N = 3SE +/- 0.33, N = 373407198717271557146159112029557911961. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectorySAMSUNG ZFS MIRROR4xNVME ZFS MIRRORDELLENT ZFS MIRROR2DELLENT ZFS MIRRORSAMSUNG ZFS MIRROR2PERC RAID1 SAMSUNG 256-A-D-CDELL SAMSUNG SSD4PERC RAID1 DELL ENT. H755DELL ENTERPRISE NVMEDELL ENT NVME SSD115003000450060007500SE +/- 88.50, N = 3SE +/- 70.16, N = 15SE +/- 83.02, N = 4SE +/- 59.56, N = 15SE +/- 104.53, N = 15SE +/- 6.81, N = 3SE +/- 4.18, N = 3SE +/- 7.62, N = 3SE +/- 0.67, N = 36804672466986622651127542138164511821951. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native


Phoronix Test Suite v10.8.4