45drivesxl60 2 x AMD EPYC 7513 32-Core testing with a Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) and Matrox G200eW3 on Debian GNU/Linux 11 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2210049-NE-2209208NE73 .
45drivesxl60 Processor Motherboard Memory Disk Chipset Graphics Monitor Network OS Kernel Compiler File-System Vulkan Screen Resolution 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k Intel Xeon Silver 4216 (32 Cores) 45Drives XL60 0123456789 256GB 742117GB FreeBSD 12.2-RELEASE-p10 (x86_64) Clang 10.0.1 zfs 2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads) Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) AMD Starship/Matisse 8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2 240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8 Matrox G200eW3 DELL E172FP 4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIe Debian GNU/Linux 11 5.15.30-2-pve (x86_64) 1.0.2 GCC 10.2.1 20210110 ext4 1280x1024 zfs ext4 nfs OpenBenchmarking.org Kernel Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD, NFS 2 NO SSD 32k: Transparent Huge Pages: madvise Compiler Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD, NFS 2 NO SSD 32k: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details - DELL ENT NVME SSD1: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - DELL SAMSUNG SSD4: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - DELL ENTERPRISE NVME: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - SAMSUNG ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 - DELLENT ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 - PERC RAID1 SAMSUNG 256-A-D-C: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - PERC RAID1 DELL ENT. H755: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - NFS 1 NO SSD: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 - NFS 2 NO SSD 32k: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 32768 Processor Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD, NFS 2 NO SSD 32k: CPU Microcode: 0xa00115d Security Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD, NFS 2 NO SSD 32k: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
45drivesxl60 fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 685 175333 360 92300 156667 9083 72700 735 188000 495 127000 146933 9131 73033 692 177333 432 110333 157000 93500 735 188000 529 135667 131333 91300 697 178333 505 129333 156333 95733 739 189333 537 137667 132600 99900 27.3 6991 71.3 18260 1561 203 1617 28.1 7183 70.3 17871 1553 203 1623 196 195 38.4 9825 24.4 6242 6327 2054 16400 246 63067 24.3 6385 17133 2080 16633 791 2138 47.2 12100 240 61233 7633 2286 18300 87.6 22500 240 61500 9457 2285 18300 955 1182 388 99133 703 180000 58733 6210 49633 1720 440133 1382 353917 54433 6145 49140 7340 6804 386 98583 721 185000 57367 6454 51633 1698 434467 1302 333333 52847 6074 48446 7172 6622 80.5 20533 128 32633 9613 2798 22400 134 34367 157 39767 21700 2801 22400 1202 2754 183 46800 168 42942 12767 2334 18700 204 52100 188 48167 13167 2475 19787 1591 1645 9.904 2472 8.875 2215 2139 192 1534 9.967 2488 9.289 2319 2166 194 1544 268 271 9.895 2490 9.024 2252 2475 129 1030 9.874 2505 9.367 2338 2442 131 1042 310 306 OpenBenchmarking.org
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 150 300 450 600 750 SE +/- 3.055, N = 3 SE +/- 2.667, N = 3 SE +/- 2.848, N = 3 SE +/- 0.058, N = 3 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 1.333, N = 3 SE +/- 11.528, N = 12 SE +/- 7.354, N = 15 SE +/- 0.033, N = 3 SE +/- 0.043, N = 3 685.000 692.000 697.000 27.300 38.400 47.200 388.000 386.000 80.500 183.000 9.904 9.895
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 40K 80K 120K 160K 200K SE +/- 666.67, N = 3 SE +/- 666.67, N = 3 SE +/- 666.67, N = 3 SE +/- 14.33, N = 3 SE +/- 4.63, N = 3 SE +/- 366.67, N = 3 SE +/- 2927.48, N = 12 SE +/- 1886.59, N = 15 SE +/- 8.14, N = 3 SE +/- 11.55, N = 3 175333 177333 178667 6991 9825 12100 99133 98583 20533 46800 2472 2490
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 160 320 480 640 800 SE +/- 1.764, N = 3 SE +/- 2.333, N = 3 SE +/- 5.608, N = 3 SE +/- 0.861, N = 15 SE +/- 0.000, N = 3 SE +/- 0.333, N = 3 SE +/- 0.667, N = 3 SE +/- 6.227, N = 3 SE +/- 1.073, N = 15 SE +/- 4.123, N = 12 SE +/- 0.041, N = 3 SE +/- 0.066, N = 3 360.000 432.000 505.000 71.300 24.400 240.000 703.000 721.000 128.000 168.000 8.875 9.024
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 40K 80K 120K 160K 200K SE +/- 416.33, N = 3 SE +/- 881.92, N = 3 SE +/- 1452.97, N = 3 SE +/- 222.92, N = 15 SE +/- 1.86, N = 3 SE +/- 66.67, N = 3 SE +/- 1527.53, N = 3 SE +/- 283.12, N = 15 SE +/- 1055.04, N = 12 SE +/- 10.50, N = 3 SE +/- 16.60, N = 3 92300 110333 129333 18260 6242 61233 180000 185000 32633 42942 2215 2252
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 30K 60K 90K 120K 150K SE +/- 333.33, N = 3 SE +/- 577.35, N = 3 SE +/- 333.33, N = 3 SE +/- 2.89, N = 3 SE +/- 43.75, N = 3 SE +/- 3.79, N = 3 SE +/- 600.93, N = 3 SE +/- 578.31, N = 3 SE +/- 26.74, N = 3 SE +/- 33.33, N = 3 SE +/- 30.40, N = 3 SE +/- 9.02, N = 3 156667 157000 156333 1561 6327 7633 58733 57367 9613 12767 2139 2475
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 2K 4K 6K 8K 10K SE +/- 108.58, N = 3 SE +/- 1.45, N = 3 SE +/- 1.53, N = 3 SE +/- 15.21, N = 3 SE +/- 58.30, N = 3 SE +/- 1.33, N = 3 SE +/- 6.39, N = 3 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 9083 203 2054 2286 6210 6454 2798 2334 192 129
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 20K 40K 60K 80K 100K SE +/- 862.17, N = 3 SE +/- 757.19, N = 3 SE +/- 517.47, N = 3 SE +/- 10.41, N = 3 SE +/- 120.19, N = 3 SE +/- 480.74, N = 3 SE +/- 57.74, N = 3 SE +/- 2.03, N = 3 SE +/- 6.64, N = 3 72700 93500 95733 1617 16400 18300 49633 51633 22400 18700 1534 1030
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 400 800 1200 1600 2000 SE +/- 1.764, N = 3 SE +/- 1.764, N = 3 SE +/- 1.667, N = 3 SE +/- 0.058, N = 3 SE +/- 0.333, N = 3 SE +/- 0.318, N = 3 SE +/- 42.444, N = 15 SE +/- 30.864, N = 15 SE +/- 0.333, N = 3 SE +/- 0.005, N = 3 SE +/- 0.042, N = 3 735.000 735.000 739.000 28.100 246.000 87.600 1720.000 1698.000 134.000 204.000 9.967 9.874
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 90K 180K 270K 360K 450K SE +/- 577.35, N = 3 SE +/- 577.35, N = 3 SE +/- 333.33, N = 3 SE +/- 11.72, N = 3 SE +/- 33.33, N = 3 SE +/- 10885.49, N = 15 SE +/- 7940.17, N = 15 SE +/- 33.33, N = 3 SE +/- 100.00, N = 3 SE +/- 1.20, N = 3 SE +/- 16.76, N = 3 188000 188000 189333 7183 63067 22500 440133 434467 34367 52100 2488 2505
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 300 600 900 1200 1500 SE +/- 1.202, N = 3 SE +/- 0.726, N = 14 SE +/- 0.300, N = 3 SE +/- 21.107, N = 12 SE +/- 11.953, N = 15 SE +/- 0.667, N = 3 SE +/- 0.026, N = 3 SE +/- 0.083, N = 3 495.000 529.000 537.000 70.300 24.300 240.000 1382.000 1302.000 157.000 188.000 9.289 9.367
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 80K 160K 240K 320K 400K SE +/- 333.33, N = 3 SE +/- 333.33, N = 3 SE +/- 180.48, N = 14 SE +/- 1.20, N = 3 SE +/- 57.74, N = 3 SE +/- 5411.07, N = 12 SE +/- 3073.18, N = 15 SE +/- 384.42, N = 3 SE +/- 185.59, N = 3 SE +/- 6.44, N = 3 SE +/- 20.98, N = 3 127000 135667 137667 17871 6385 61500 353917 333333 39767 48167 2319 2338
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 30K 60K 90K 120K 150K SE +/- 2369.38, N = 15 SE +/- 333.33, N = 3 SE +/- 1400.00, N = 5 SE +/- 4.10, N = 3 SE +/- 33.33, N = 3 SE +/- 4.33, N = 3 SE +/- 693.62, N = 3 SE +/- 522.53, N = 15 SE +/- 351.19, N = 3 SE +/- 88.19, N = 3 SE +/- 16.80, N = 3 SE +/- 24.91, N = 3 146933 131333 132600 1553 17133 9457 54433 52847 21700 13167 2166 2442
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 2K 4K 6K 8K 10K SE +/- 114.13, N = 3 SE +/- 0.67, N = 3 SE +/- 1.20, N = 3 SE +/- 0.67, N = 3 SE +/- 46.95, N = 10 SE +/- 85.11, N = 13 SE +/- 1.86, N = 3 SE +/- 17.87, N = 15 SE +/- 0.88, N = 3 SE +/- 0.67, N = 3 9131 203 2080 2285 6145 6074 2801 2475 194 131
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 20K 40K 60K 80K 100K SE +/- 924.36, N = 3 SE +/- 709.46, N = 3 SE +/- 1081.67, N = 3 SE +/- 4.84, N = 3 SE +/- 33.33, N = 3 SE +/- 376.59, N = 10 SE +/- 752.31, N = 13 SE +/- 141.04, N = 15 SE +/- 7.13, N = 3 SE +/- 3.84, N = 3 73033 91300 99900 1623 16633 18300 49140 48446 22400 19787 1544 1042
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 1600 3200 4800 6400 8000 SE +/- 0.33, N = 3 SE +/- 5.24, N = 3 SE +/- 0.33, N = 3 SE +/- 74.71, N = 3 SE +/- 69.68, N = 3 SE +/- 3.38, N = 3 SE +/- 3.18, N = 3 SE +/- 3.71, N = 3 SE +/- 1.15, N = 3 196 791 955 7340 7172 1202 1591 268 310 1. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD NFS 2 NO SSD 32k 1500 3000 4500 6000 7500 SE +/- 4.18, N = 3 SE +/- 0.67, N = 3 SE +/- 88.50, N = 3 SE +/- 59.56, N = 15 SE +/- 6.81, N = 3 SE +/- 7.62, N = 3 SE +/- 2.19, N = 3 195 2138 1182 6804 6622 2754 1645 271 306 1. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
Phoronix Test Suite v10.8.4