45drivesxl60 2 x AMD EPYC 7513 32-Core testing with a Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) and Matrox G200eW3 on Debian GNU/Linux 11 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2210041-NE-2209208NE88&grs&sro .
45drivesxl60 Processor Motherboard Memory Disk Chipset Graphics Monitor Network OS Kernel Compiler File-System Vulkan Screen Resolution 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD Intel Xeon Silver 4216 (32 Cores) 45Drives XL60 0123456789 256GB 742117GB FreeBSD 12.2-RELEASE-p10 (x86_64) Clang 10.0.1 zfs 2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads) Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) AMD Starship/Matisse 8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2 240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8 Matrox G200eW3 DELL E172FP 4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIe Debian GNU/Linux 11 5.15.30-2-pve (x86_64) 1.0.2 GCC 10.2.1 20210110 ext4 1280x1024 zfs ext4 nfs OpenBenchmarking.org Kernel Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: Transparent Huge Pages: madvise Compiler Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details - DELL ENT NVME SSD1: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - DELL SAMSUNG SSD4: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - DELL ENTERPRISE NVME: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - SAMSUNG ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 - DELLENT ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 - PERC RAID1 SAMSUNG 256-A-D-C: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - PERC RAID1 DELL ENT. H755: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - NFS 1 NO SSD: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 Processor Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: CPU Microcode: 0xa00115d Security Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
45drivesxl60 fio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD 146933 92300 360 175333 685 73033 72700 9083 9131 188000 735 127000 495 156667 131333 110333 432 177333 692 91300 93500 188000 735 135667 529 157000 132600 129333 505 178333 697 99900 95733 189333 739 137667 537 156333 1553 18260 71.3 6991 27.3 1623 1617 203 203 196 195 7183 28.1 17871 70.3 1561 17133 6242 24.4 9825 38.4 16633 16400 2054 2080 791 2138 63067 246 6385 24.3 6327 9457 61233 240 12100 47.2 18300 18300 2286 2285 955 1182 22500 87.6 61500 240 7633 54433 180000 703 99133 388 49140 49633 6210 6145 7340 6804 440133 1720 353917 1382 58733 52847 185000 721 98583 386 48446 51633 6454 6074 7172 6622 434467 1698 333333 1302 57367 21700 32633 128 20533 80.5 22400 22400 2798 2801 1202 2754 34367 134 39767 157 9613 13167 42942 168 46800 183 19787 18700 2334 2475 1591 1645 52100 204 48167 188 12767 2166 2215 8.875 2472 9.904 1544 1534 192 194 268 271 2488 9.967 2319 9.289 2139 OpenBenchmarking.org
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 30K 60K 90K 120K 150K SE +/- 2369.38, N = 15 SE +/- 333.33, N = 3 SE +/- 4.10, N = 3 SE +/- 4.33, N = 3 SE +/- 33.33, N = 3 SE +/- 522.53, N = 15 SE +/- 1400.00, N = 5 SE +/- 16.80, N = 3 SE +/- 88.19, N = 3 SE +/- 351.19, N = 3 SE +/- 693.62, N = 3 146933 131333 1553 9457 17133 52847 132600 2166 13167 21700 54433
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 40K 80K 120K 160K 200K SE +/- 416.33, N = 3 SE +/- 881.92, N = 3 SE +/- 222.92, N = 15 SE +/- 66.67, N = 3 SE +/- 1.86, N = 3 SE +/- 1527.53, N = 3 SE +/- 1452.97, N = 3 SE +/- 10.50, N = 3 SE +/- 1055.04, N = 12 SE +/- 283.12, N = 15 92300 110333 18260 61233 6242 185000 129333 2215 42942 32633 180000
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 160 320 480 640 800 SE +/- 1.764, N = 3 SE +/- 2.333, N = 3 SE +/- 0.861, N = 15 SE +/- 0.333, N = 3 SE +/- 0.000, N = 3 SE +/- 6.227, N = 3 SE +/- 5.608, N = 3 SE +/- 0.041, N = 3 SE +/- 4.123, N = 12 SE +/- 1.073, N = 15 SE +/- 0.667, N = 3 360.000 432.000 71.300 240.000 24.400 721.000 505.000 8.875 168.000 128.000 703.000
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 40K 80K 120K 160K 200K SE +/- 666.67, N = 3 SE +/- 666.67, N = 3 SE +/- 14.33, N = 3 SE +/- 4.63, N = 3 SE +/- 2927.48, N = 12 SE +/- 666.67, N = 3 SE +/- 8.14, N = 3 SE +/- 1886.59, N = 15 SE +/- 366.67, N = 3 175333 177333 6991 12100 9825 98583 178333 2472 46800 20533 99133
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 150 300 450 600 750 SE +/- 3.055, N = 3 SE +/- 2.667, N = 3 SE +/- 0.058, N = 3 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 11.528, N = 12 SE +/- 2.848, N = 3 SE +/- 0.033, N = 3 SE +/- 7.354, N = 15 SE +/- 1.333, N = 3 685.000 692.000 27.300 47.200 38.400 386.000 697.000 9.904 183.000 80.500 388.000
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 20K 40K 60K 80K 100K SE +/- 924.36, N = 3 SE +/- 709.46, N = 3 SE +/- 4.84, N = 3 SE +/- 33.33, N = 3 SE +/- 752.31, N = 13 SE +/- 1081.67, N = 3 SE +/- 7.13, N = 3 SE +/- 141.04, N = 15 SE +/- 376.59, N = 10 73033 91300 1623 18300 16633 48446 99900 1544 19787 22400 49140
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 20K 40K 60K 80K 100K SE +/- 862.17, N = 3 SE +/- 757.19, N = 3 SE +/- 10.41, N = 3 SE +/- 480.74, N = 3 SE +/- 517.47, N = 3 SE +/- 2.03, N = 3 SE +/- 57.74, N = 3 SE +/- 120.19, N = 3 72700 93500 1617 18300 16400 51633 95733 1534 18700 22400 49633
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 2K 4K 6K 8K 10K SE +/- 108.58, N = 3 SE +/- 1.45, N = 3 SE +/- 1.53, N = 3 SE +/- 58.30, N = 3 SE +/- 0.33, N = 3 SE +/- 6.39, N = 3 SE +/- 1.33, N = 3 SE +/- 15.21, N = 3 9083 203 2286 2054 6454 192 2334 2798 6210
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 2K 4K 6K 8K 10K SE +/- 114.13, N = 3 SE +/- 0.67, N = 3 SE +/- 0.67, N = 3 SE +/- 1.20, N = 3 SE +/- 85.11, N = 13 SE +/- 0.88, N = 3 SE +/- 17.87, N = 15 SE +/- 1.86, N = 3 SE +/- 46.95, N = 10 9131 203 2285 2080 6074 194 2475 2801 6145
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 1600 3200 4800 6400 8000 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 5.24, N = 3 SE +/- 69.68, N = 3 SE +/- 3.71, N = 3 SE +/- 3.18, N = 3 SE +/- 3.38, N = 3 SE +/- 74.71, N = 3 196 955 791 7172 268 1591 1202 7340 1. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 1500 3000 4500 6000 7500 SE +/- 0.67, N = 3 SE +/- 4.18, N = 3 SE +/- 59.56, N = 15 SE +/- 2.19, N = 3 SE +/- 7.62, N = 3 SE +/- 6.81, N = 3 SE +/- 88.50, N = 3 195 1182 2138 6622 271 1645 2754 6804 1. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 90K 180K 270K 360K 450K SE +/- 577.35, N = 3 SE +/- 577.35, N = 3 SE +/- 11.72, N = 3 SE +/- 33.33, N = 3 SE +/- 7940.17, N = 15 SE +/- 333.33, N = 3 SE +/- 1.20, N = 3 SE +/- 100.00, N = 3 SE +/- 33.33, N = 3 SE +/- 10885.49, N = 15 188000 188000 7183 22500 63067 434467 189333 2488 52100 34367 440133
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 400 800 1200 1600 2000 SE +/- 1.764, N = 3 SE +/- 1.764, N = 3 SE +/- 0.058, N = 3 SE +/- 0.318, N = 3 SE +/- 0.333, N = 3 SE +/- 30.864, N = 15 SE +/- 1.667, N = 3 SE +/- 0.005, N = 3 SE +/- 0.333, N = 3 SE +/- 42.444, N = 15 735.000 735.000 28.100 87.600 246.000 1698.000 739.000 9.967 204.000 134.000 1720.000
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 80K 160K 240K 320K 400K SE +/- 333.33, N = 3 SE +/- 180.48, N = 14 SE +/- 57.74, N = 3 SE +/- 1.20, N = 3 SE +/- 3073.18, N = 15 SE +/- 333.33, N = 3 SE +/- 6.44, N = 3 SE +/- 185.59, N = 3 SE +/- 384.42, N = 3 SE +/- 5411.07, N = 12 127000 135667 17871 61500 6385 333333 137667 2319 48167 39767 353917
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 300 600 900 1200 1500 SE +/- 0.726, N = 14 SE +/- 0.300, N = 3 SE +/- 11.953, N = 15 SE +/- 1.202, N = 3 SE +/- 0.026, N = 3 SE +/- 0.667, N = 3 SE +/- 21.107, N = 12 495.000 529.000 70.300 240.000 24.300 1302.000 537.000 9.289 188.000 157.000 1382.000
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELLENT ZFS MIRROR Mirrors NFS 1 NO SSD PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C SAMSUNG ZFS MIRROR 30K 60K 90K 120K 150K SE +/- 333.33, N = 3 SE +/- 577.35, N = 3 SE +/- 2.89, N = 3 SE +/- 3.79, N = 3 SE +/- 43.75, N = 3 SE +/- 578.31, N = 3 SE +/- 333.33, N = 3 SE +/- 30.40, N = 3 SE +/- 33.33, N = 3 SE +/- 26.74, N = 3 SE +/- 600.93, N = 3 156667 157000 1561 7633 6327 57367 156333 2139 12767 9613 58733
Phoronix Test Suite v10.8.5