45drivesxl60 2 x AMD EPYC 7513 32-Core testing with a Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) and Matrox G200eW3 on Debian GNU/Linux 11 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2210041-NE-2209208NE88&sor&grr .
45drivesxl60 Processor Motherboard Memory Disk Chipset Graphics Monitor Network OS Kernel Compiler File-System Vulkan Screen Resolution 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD Intel Xeon Silver 4216 (32 Cores) 45Drives XL60 0123456789 256GB 742117GB FreeBSD 12.2-RELEASE-p10 (x86_64) Clang 10.0.1 zfs 2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads) Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) AMD Starship/Matisse 8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2 240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8 Matrox G200eW3 DELL E172FP 4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIe Debian GNU/Linux 11 5.15.30-2-pve (x86_64) 1.0.2 GCC 10.2.1 20210110 ext4 1280x1024 zfs ext4 nfs OpenBenchmarking.org Kernel Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: Transparent Huge Pages: madvise Compiler Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details - DELL ENT NVME SSD1: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - DELL SAMSUNG SSD4: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - DELL ENTERPRISE NVME: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - SAMSUNG ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 - DELLENT ZFS MIRROR: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 - PERC RAID1 SAMSUNG 256-A-D-C: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - PERC RAID1 DELL ENT. H755: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - NFS 1 NO SSD: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 131072 Processor Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: CPU Microcode: 0xa00115d Security Details - DELL ENT NVME SSD1, DELL SAMSUNG SSD4, DELL ENTERPRISE NVME, SAMSUNG ZFS MIRROR, DELLENT ZFS MIRROR, PERC RAID1 SAMSUNG 256-A-D-C, PERC RAID1 DELL ENT. H755, NFS 1 NO SSD: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
45drivesxl60 fio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directory 10 Per VDEV RaidZ2 5 Per VDEV RaidZ2 Mirrors DELL ENT NVME SSD1 DELL SAMSUNG SSD4 DELL ENTERPRISE NVME SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 NFS 1 NO SSD 9131 92300 360 127000 495 73033 146933 188000 735 685 175333 156667 72700 9083 110333 432 135667 529 91300 131333 188000 735 692 177333 157000 93500 129333 505 137667 537 99900 132600 189333 739 697 178333 156333 95733 203 18260 71.3 17871 70.3 1623 1553 7183 28.1 27.3 6991 195 1561 196 1617 203 2080 6242 24.4 6385 24.3 16633 17133 63067 246 38.4 9825 2138 6327 791 16400 2054 2285 61233 240 61500 240 18300 9457 22500 87.6 47.2 12100 1182 7633 955 18300 2286 6145 180000 703 353917 1382 49140 54433 440133 1720 388 99133 6804 58733 7340 49633 6210 6074 185000 721 333333 1302 48446 52847 434467 1698 386 98583 6622 57367 7172 51633 6454 2801 32633 128 39767 157 22400 21700 34367 134 80.5 20533 2754 9613 1202 22400 2798 2475 42942 168 48167 188 19787 13167 52100 204 183 46800 1645 12767 1591 18700 2334 194 2215 8.875 2319 9.289 1544 2166 2488 9.967 9.904 2472 271 2139 268 1534 192 OpenBenchmarking.org
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELL ENT NVME SSD1 NFS 1 NO SSD 2K 4K 6K 8K 10K SE +/- 114.13, N = 3 SE +/- 46.95, N = 10 SE +/- 85.11, N = 13 SE +/- 1.86, N = 3 SE +/- 17.87, N = 15 SE +/- 0.67, N = 3 SE +/- 1.20, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 9131 6145 6074 2801 2475 2285 2080 203 194
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory DELLENT ZFS MIRROR SAMSUNG ZFS MIRROR Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 DELL ENTERPRISE NVME PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENT NVME SSD1 DELL SAMSUNG SSD4 NFS 1 NO SSD 40K 80K 120K 160K 200K SE +/- 1527.53, N = 3 SE +/- 1452.97, N = 3 SE +/- 881.92, N = 3 SE +/- 416.33, N = 3 SE +/- 66.67, N = 3 SE +/- 1055.04, N = 12 SE +/- 283.12, N = 15 SE +/- 222.92, N = 15 SE +/- 1.86, N = 3 SE +/- 10.50, N = 3 185000 180000 129333 110333 92300 61233 42942 32633 18260 6242 2215
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory DELLENT ZFS MIRROR SAMSUNG ZFS MIRROR Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 DELL ENTERPRISE NVME PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENT NVME SSD1 DELL SAMSUNG SSD4 NFS 1 NO SSD 160 320 480 640 800 SE +/- 6.227, N = 3 SE +/- 0.667, N = 3 SE +/- 5.608, N = 3 SE +/- 2.333, N = 3 SE +/- 1.764, N = 3 SE +/- 0.333, N = 3 SE +/- 4.123, N = 12 SE +/- 1.073, N = 15 SE +/- 0.861, N = 15 SE +/- 0.000, N = 3 SE +/- 0.041, N = 3 721.000 703.000 505.000 432.000 360.000 240.000 168.000 128.000 71.300 24.400 8.875
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 DELL ENTERPRISE NVME PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENT NVME SSD1 DELL SAMSUNG SSD4 NFS 1 NO SSD 80K 160K 240K 320K 400K SE +/- 5411.07, N = 12 SE +/- 3073.18, N = 15 SE +/- 333.33, N = 3 SE +/- 333.33, N = 3 SE +/- 57.74, N = 3 SE +/- 185.59, N = 3 SE +/- 384.42, N = 3 SE +/- 180.48, N = 14 SE +/- 1.20, N = 3 SE +/- 6.44, N = 3 353917 333333 137667 135667 127000 61500 48167 39767 17871 6385 2319
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 DELL ENTERPRISE NVME PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENT NVME SSD1 DELL SAMSUNG SSD4 NFS 1 NO SSD 300 600 900 1200 1500 SE +/- 21.107, N = 12 SE +/- 11.953, N = 15 SE +/- 1.202, N = 3 SE +/- 0.667, N = 3 SE +/- 0.726, N = 14 SE +/- 0.300, N = 3 SE +/- 0.026, N = 3 1382.000 1302.000 537.000 529.000 495.000 240.000 188.000 157.000 70.300 24.300 9.289
Flexible IO Tester Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELL ENT NVME SSD1 NFS 1 NO SSD 20K 40K 60K 80K 100K SE +/- 1081.67, N = 3 SE +/- 709.46, N = 3 SE +/- 924.36, N = 3 SE +/- 376.59, N = 10 SE +/- 752.31, N = 13 SE +/- 141.04, N = 15 SE +/- 33.33, N = 3 SE +/- 4.84, N = 3 SE +/- 7.13, N = 3 99900 91300 73033 49140 48446 22400 19787 18300 16633 1623 1544
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 Mirrors 5 Per VDEV RaidZ2 SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C DELL SAMSUNG SSD4 PERC RAID1 DELL ENT. H755 DELL ENTERPRISE NVME NFS 1 NO SSD DELL ENT NVME SSD1 30K 60K 90K 120K 150K SE +/- 2369.38, N = 15 SE +/- 1400.00, N = 5 SE +/- 333.33, N = 3 SE +/- 693.62, N = 3 SE +/- 522.53, N = 15 SE +/- 351.19, N = 3 SE +/- 33.33, N = 3 SE +/- 88.19, N = 3 SE +/- 4.33, N = 3 SE +/- 16.80, N = 3 SE +/- 4.10, N = 3 146933 132600 131333 54433 52847 21700 17133 13167 9457 2166 1553
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 DELL SAMSUNG SSD4 PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENTERPRISE NVME DELL ENT NVME SSD1 NFS 1 NO SSD 90K 180K 270K 360K 450K SE +/- 10885.49, N = 15 SE +/- 7940.17, N = 15 SE +/- 333.33, N = 3 SE +/- 577.35, N = 3 SE +/- 577.35, N = 3 SE +/- 33.33, N = 3 SE +/- 100.00, N = 3 SE +/- 33.33, N = 3 SE +/- 11.72, N = 3 SE +/- 1.20, N = 3 440133 434467 189333 188000 188000 63067 52100 34367 22500 7183 2488
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 DELL SAMSUNG SSD4 PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENTERPRISE NVME DELL ENT NVME SSD1 NFS 1 NO SSD 400 800 1200 1600 2000 SE +/- 42.444, N = 15 SE +/- 30.864, N = 15 SE +/- 1.667, N = 3 SE +/- 1.764, N = 3 SE +/- 1.764, N = 3 SE +/- 0.333, N = 3 SE +/- 0.333, N = 3 SE +/- 0.318, N = 3 SE +/- 0.058, N = 3 SE +/- 0.005, N = 3 1720.000 1698.000 739.000 735.000 735.000 246.000 204.000 134.000 87.600 28.100 9.967
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELL ENT NVME SSD1 NFS 1 NO SSD 150 300 450 600 750 SE +/- 2.848, N = 3 SE +/- 2.667, N = 3 SE +/- 3.055, N = 3 SE +/- 1.333, N = 3 SE +/- 11.528, N = 12 SE +/- 7.354, N = 15 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 0.058, N = 3 SE +/- 0.033, N = 3 697.000 692.000 685.000 388.000 386.000 183.000 80.500 47.200 38.400 27.300 9.904
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELL ENT NVME SSD1 NFS 1 NO SSD 40K 80K 120K 160K 200K SE +/- 666.67, N = 3 SE +/- 666.67, N = 3 SE +/- 666.67, N = 3 SE +/- 366.67, N = 3 SE +/- 2927.48, N = 12 SE +/- 1886.59, N = 15 SE +/- 4.63, N = 3 SE +/- 14.33, N = 3 SE +/- 8.14, N = 3 178667 177333 175333 99133 98583 46800 20533 12100 9825 6991 2472
Flexible IO Tester Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C DELL SAMSUNG SSD4 PERC RAID1 DELL ENT. H755 DELL ENTERPRISE NVME NFS 1 NO SSD DELL ENT NVME SSD1 1500 3000 4500 6000 7500 SE +/- 88.50, N = 3 SE +/- 59.56, N = 15 SE +/- 6.81, N = 3 SE +/- 4.18, N = 3 SE +/- 7.62, N = 3 SE +/- 0.67, N = 3 SE +/- 2.19, N = 3 6804 6622 2754 2138 1645 1182 271 195 1. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 Mirrors SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENTERPRISE NVME DELL SAMSUNG SSD4 NFS 1 NO SSD DELL ENT NVME SSD1 30K 60K 90K 120K 150K SE +/- 577.35, N = 3 SE +/- 333.33, N = 3 SE +/- 333.33, N = 3 SE +/- 600.93, N = 3 SE +/- 578.31, N = 3 SE +/- 33.33, N = 3 SE +/- 26.74, N = 3 SE +/- 3.79, N = 3 SE +/- 43.75, N = 3 SE +/- 30.40, N = 3 SE +/- 2.89, N = 3 157000 156667 156333 58733 57367 12767 9613 7633 6327 2139 1561
Flexible IO Tester Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory SAMSUNG ZFS MIRROR DELLENT ZFS MIRROR PERC RAID1 DELL ENT. H755 PERC RAID1 SAMSUNG 256-A-D-C DELL ENTERPRISE NVME DELL SAMSUNG SSD4 NFS 1 NO SSD DELL ENT NVME SSD1 1600 3200 4800 6400 8000 SE +/- 74.71, N = 3 SE +/- 69.68, N = 3 SE +/- 3.18, N = 3 SE +/- 3.38, N = 3 SE +/- 0.33, N = 3 SE +/- 5.24, N = 3 SE +/- 3.71, N = 3 SE +/- 0.33, N = 3 7340 7172 1591 1202 955 791 268 196 1. (CC) gcc options: -rdynamic -ll -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory Mirrors 5 Per VDEV RaidZ2 10 Per VDEV RaidZ2 DELLENT ZFS MIRROR SAMSUNG ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELL ENT NVME SSD1 NFS 1 NO SSD 20K 40K 60K 80K 100K SE +/- 517.47, N = 3 SE +/- 757.19, N = 3 SE +/- 862.17, N = 3 SE +/- 480.74, N = 3 SE +/- 120.19, N = 3 SE +/- 57.74, N = 3 SE +/- 10.41, N = 3 SE +/- 2.03, N = 3 95733 93500 72700 51633 49633 22400 18700 18300 16400 1617 1534
Flexible IO Tester Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.25 Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory 10 Per VDEV RaidZ2 DELLENT ZFS MIRROR SAMSUNG ZFS MIRROR PERC RAID1 SAMSUNG 256-A-D-C PERC RAID1 DELL ENT. H755 DELL ENTERPRISE NVME DELL SAMSUNG SSD4 DELL ENT NVME SSD1 NFS 1 NO SSD 2K 4K 6K 8K 10K SE +/- 108.58, N = 3 SE +/- 58.30, N = 3 SE +/- 15.21, N = 3 SE +/- 1.33, N = 3 SE +/- 6.39, N = 3 SE +/- 1.53, N = 3 SE +/- 1.45, N = 3 SE +/- 0.33, N = 3 9083 6454 6210 2798 2334 2286 2054 203 192
Phoronix Test Suite v10.8.5