45drivesxl60

2 x AMD EPYC 7513 32-Core testing with a Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) and Matrox G200eW3 on Debian GNU/Linux 11 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2209212-NE-2209211NE32&grr.

45drivesxl60ProcessorMotherboardMemoryDiskChipsetGraphicsMonitorNetworkOSKernelCompilerFile-SystemVulkanScreen Resolution10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2Intel Xeon Silver 4216 (32 Cores)45Drives XL60 0123456789256GB742117GBFreeBSD12.2-RELEASE-p10 (x86_64)Clang 10.0.1zfs2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads)Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS)AMD Starship/Matisse8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8Matrox G200eW3DELL E172FP4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIeDebian GNU/Linux 115.15.30-2-pve (x86_64)1.0.2GCC 10.2.1 20210110ext41280x1024zfsext4zfsOpenBenchmarking.orgKernel Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: Transparent Huge Pages: madviseCompiler Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- DELL ENT NVME SSD1: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- DELL SAMSUNG SSD4: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- DELL ENTERPRISE NVME: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- SAMSUNG ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- DELLENT ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- PERC RAID1 SAMSUNG 256-A-D-C: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- PERC RAID1 DELL ENT. H755: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- 4xNVME ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- DELLENT ZFS MIRROR2: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072- SAMSUNG ZFS MIRROR2: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072Processor Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: CPU Microcode: 0xa00115dSecurity Details- DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, 4xNVME ZFS MIRROR, DELLENT ZFS MIRROR2, SAMSUNG ZFS MIRROR2: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

45drivesxl60fio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR212700049592300360146933188000735913168573033175333156667727009083135667529110333432131333188000735692913001773331570009350013766753712933350513260018933373969799900178333156333957331787170.31826071.31553718328.119520327.31623699119615611617203638524.3624224.417133630672462138208038.41663398257916327164002054615002406123324094572250087.61182228547.21830012100955763318300228635391713821800007035443344013317206804614538849140991337340587334963362103333331302185000721528474344671698662260743864844698583717257367516336454397671573263312821700343671342754280180.5224002053312029613224002798481671884294216813167521002041645247518319787468001591127671870023343153331232118800464537074598671797672448053653843393392715557225442335530319600124818200071153575423929165666986213418497001070007146571675143364303350001309180333704520674610001801651161173814893697383719857600518676482OpenBenchmarking.org

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR280K160K240K320K400KSE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 180.48, N = 14SE +/- 1.20, N = 3SE +/- 57.74, N = 3SE +/- 5411.07, N = 12SE +/- 3073.18, N = 15SE +/- 384.42, N = 3SE +/- 185.59, N = 3SE +/- 7030.32, N = 15SE +/- 4423.75, N = 15SE +/- 3386.25, N = 6127000135667137667178716385615003539173333333976748167315333319600335000

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR230060090012001500SE +/- 1.20, N = 3SE +/- 0.73, N = 14SE +/- 0.30, N = 3SE +/- 21.11, N = 12SE +/- 11.95, N = 15SE +/- 0.67, N = 3SE +/- 27.37, N = 15SE +/- 17.29, N = 15SE +/- 13.25, N = 6495.0529.0537.070.324.3240.01382.01302.0157.0188.01232.01248.01309.0

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR240K80K120K160K200KSE +/- 416.33, N = 3SE +/- 881.92, N = 3SE +/- 1452.97, N = 3SE +/- 222.92, N = 15SE +/- 1.86, N = 3SE +/- 66.67, N = 3SE +/- 1527.53, N = 3SE +/- 283.12, N = 15SE +/- 1055.04, N = 12SE +/- 1313.66, N = 15SE +/- 1944.47, N = 15SE +/- 2728.45, N = 392300110333129333182606242612331800001850003263342942118800182000180333

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2160320480640800SE +/- 1.76, N = 3SE +/- 2.33, N = 3SE +/- 5.61, N = 3SE +/- 0.86, N = 15SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 6.23, N = 3SE +/- 1.07, N = 15SE +/- 4.12, N = 12SE +/- 4.95, N = 15SE +/- 7.59, N = 15SE +/- 10.09, N = 3360.0432.0505.071.324.4240.0703.0721.0128.0168.0464.0711.0704.0

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR230K60K90K120K150KSE +/- 2369.38, N = 15SE +/- 333.33, N = 3SE +/- 1400.00, N = 5SE +/- 4.10, N = 3SE +/- 33.33, N = 3SE +/- 4.33, N = 3SE +/- 693.62, N = 3SE +/- 522.53, N = 15SE +/- 351.19, N = 3SE +/- 88.19, N = 3SE +/- 548.72, N = 15SE +/- 673.76, N = 4SE +/- 837.89, N = 15146933131333132600155317133945754433528472170013167537075357552067

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2100K200K300K400K500KSE +/- 577.35, N = 3SE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 11.72, N = 3SE +/- 33.33, N = 3SE +/- 10885.49, N = 15SE +/- 7940.17, N = 15SE +/- 33.33, N = 3SE +/- 100.00, N = 3SE +/- 8694.21, N = 15SE +/- 11135.26, N = 14SE +/- 1527.53, N = 3188000188000189333718363067225004401334344673436752100459867423929461000

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2400800120016002000SE +/- 1.76, N = 3SE +/- 1.76, N = 3SE +/- 1.67, N = 3SE +/- 0.06, N = 3SE +/- 0.33, N = 3SE +/- 0.32, N = 3SE +/- 42.44, N = 15SE +/- 30.86, N = 15SE +/- 0.33, N = 3SE +/- 33.83, N = 15SE +/- 43.36, N = 14SE +/- 6.77, N = 3735.0735.0739.028.1246.087.61720.01698.0134.0204.01797.01656.01801.0

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectoryDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR215003000450060007500SE +/- 4.18, N = 3SE +/- 0.67, N = 3SE +/- 88.50, N = 3SE +/- 59.56, N = 15SE +/- 6.81, N = 3SE +/- 7.62, N = 3SE +/- 70.16, N = 15SE +/- 83.02, N = 4SE +/- 104.53, N = 151952138118268046622275416456724669865111. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ2DELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR22K4K6K8K10KSE +/- 114.13, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 3SE +/- 0.67, N = 3SE +/- 46.95, N = 10SE +/- 85.11, N = 13SE +/- 1.86, N = 3SE +/- 17.87, N = 15SE +/- 17.49, N = 3SE +/- 44.24, N = 3SE +/- 78.92, N = 149131203208022856145607428012475480562136117

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR2150300450600750SE +/- 3.06, N = 3SE +/- 2.67, N = 3SE +/- 2.85, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.33, N = 3SE +/- 11.53, N = 12SE +/- 7.35, N = 15SE +/- 21.18, N = 12SE +/- 2.08, N = 3SE +/- 13.16, N = 12685.0692.0697.027.338.447.2388.0386.080.5183.0365.0418.0381.0

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR220K40K60K80K100KSE +/- 924.36, N = 3SE +/- 709.46, N = 3SE +/- 1081.67, N = 3SE +/- 4.84, N = 3SE +/- 33.33, N = 3SE +/- 376.59, N = 10SE +/- 752.31, N = 13SE +/- 141.04, N = 15SE +/- 133.33, N = 3SE +/- 351.19, N = 3SE +/- 633.98, N = 147303391300999001623166331830049140484462240019787384334970048936

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR240K80K120K160K200KSE +/- 666.67, N = 3SE +/- 666.67, N = 3SE +/- 666.67, N = 3SE +/- 14.33, N = 3SE +/- 4.63, N = 3SE +/- 366.67, N = 3SE +/- 2927.48, N = 12SE +/- 1886.59, N = 15SE +/- 5435.76, N = 12SE +/- 577.35, N = 3SE +/- 3366.00, N = 121753331773331786676991982512100991339858320533468009339210700097383

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectoryDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR216003200480064008000SE +/- 0.33, N = 3SE +/- 5.24, N = 3SE +/- 0.33, N = 3SE +/- 74.71, N = 3SE +/- 69.68, N = 3SE +/- 3.38, N = 3SE +/- 3.18, N = 3SE +/- 83.90, N = 4SE +/- 48.90, N = 3SE +/- 71.04, N = 319679195573407172120215917155714671981. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR230K60K90K120K150KSE +/- 333.33, N = 3SE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 2.89, N = 3SE +/- 43.75, N = 3SE +/- 3.79, N = 3SE +/- 600.93, N = 3SE +/- 578.31, N = 3SE +/- 26.74, N = 3SE +/- 33.33, N = 3SE +/- 668.80, N = 4SE +/- 384.42, N = 3SE +/- 577.35, N = 31566671570001563331561632776335873357367961312767572255716757600

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsDELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR220K40K60K80K100KSE +/- 862.17, N = 3SE +/- 757.19, N = 3SE +/- 517.47, N = 3SE +/- 10.41, N = 3SE +/- 120.19, N = 3SE +/- 480.74, N = 3SE +/- 57.74, N = 3SE +/- 536.45, N = 3SE +/- 296.27, N = 3SE +/- 333.33, N = 37270093500957331617164001830049633516332240018700442335143351867

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ2DELL ENT NVME SSD1DELL SAMSUNG SSD4DELL ENTERPRISE NVMESAMSUNG ZFS MIRRORDELLENT ZFS MIRRORPERC RAID1 SAMSUNG 256-A-D-CPERC RAID1 DELL ENT. H7554xNVME ZFS MIRRORDELLENT ZFS MIRROR2SAMSUNG ZFS MIRROR22K4K6K8K10KSE +/- 108.58, N = 3SE +/- 1.45, N = 3SE +/- 1.53, N = 3SE +/- 15.21, N = 3SE +/- 58.30, N = 3SE +/- 1.33, N = 3SE +/- 6.39, N = 3SE +/- 65.54, N = 3SE +/- 39.43, N = 3SE +/- 40.18, N = 39083203205422866210645427982334553064306482


Phoronix Test Suite v10.8.4