45drivesxl60 2 x AMD EPYC 7513 32-Core testing with a Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) and Matrox G200eW3 on Debian GNU/Linux 11 via the Phoronix Test Suite. ,,"10 Per VDEV RaidZ2","5 Per VDEV RaidZ2","Mirrors","DELL ENT NVME SSD1","DELL SAMSUNG SSD4","DELL ENTERPRISE NVME","SAMSUNG ZFS MIRROR" Processor,,Intel Xeon Silver 4216 (32 Cores),Intel Xeon Silver 4216 (32 Cores),Intel Xeon Silver 4216 (32 Cores),2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads),2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads),2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads),2 x AMD EPYC 7513 32-Core (64 Cores / 128 Threads) Motherboard,,45Drives XL60 0123456789,45Drives XL60 0123456789,45Drives XL60 0123456789,Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS),Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS),Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS),Dell PowerEdge R7525 [0590KW] (2.6.6 BIOS) Memory,,256GB,256GB,256GB,8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2,8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2,8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2,8 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B2 Disk,,742117GB,742117GB,742117GB,240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8,240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8,240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8,240GB DELLBOSS VD + 2 x 1920GB Dell Ent NVMe CM + 2 x 3841GB SAMSUNG MZQL23T8 Chipset,,,,,AMD Starship/Matisse,AMD Starship/Matisse,AMD Starship/Matisse,AMD Starship/Matisse Graphics,,,,,Matrox G200eW3,Matrox G200eW3,Matrox G200eW3,Matrox G200eW3 Monitor,,,,,DELL E172FP,DELL E172FP,DELL E172FP,DELL E172FP Network,,,,,4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIe,4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIe,4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIe,4 x Intel X710 for 10GBASE-T + 2 x Broadcom NetXtreme BCM5720 2-port PCIe OS,,FreeBSD,FreeBSD,FreeBSD,Debian GNU/Linux 11,Debian GNU/Linux 11,Debian GNU/Linux 11,Debian GNU/Linux 11 Kernel,,12.2-RELEASE-p10 (x86_64),12.2-RELEASE-p10 (x86_64),12.2-RELEASE-p10 (x86_64),5.15.30-2-pve (x86_64),5.15.30-2-pve (x86_64),5.15.30-2-pve (x86_64),5.15.30-2-pve (x86_64) Compiler,,Clang 10.0.1,Clang 10.0.1,Clang 10.0.1,GCC 10.2.1 20210110,GCC 10.2.1 20210110,GCC 10.2.1 20210110,GCC 10.2.1 20210110 File-System,,zfs,zfs,zfs,ext4,ext4,ext4,zfs Vulkan,,,,,1.0.2,1.0.2,1.0.2,1.0.2 Screen Resolution,,,,,1280x1024,1280x1024,1280x1024,1280x1024 ,,"10 Per VDEV RaidZ2","5 Per VDEV RaidZ2","Mirrors","DELL ENT NVME SSD1","DELL SAMSUNG SSD4","DELL ENTERPRISE NVME","SAMSUNG ZFS MIRROR" "Flexible IO Tester - Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (IOPS)",HIB,127000,135667,137667,17871,6385,61500,353917 "Flexible IO Tester - Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (MB/s)",HIB,495,529,537,70.3,24.3,240,1382 "Flexible IO Tester - Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (IOPS)",HIB,146933,131333,132600,1553,17133,9457,54433 "Flexible IO Tester - Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (IOPS)",HIB,188000,188000,189333,7183,63067,22500,440133 "Flexible IO Tester - Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (MB/s)",HIB,735,735,739,28.1,246,87.6,1720 "Flexible IO Tester - Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (IOPS)",HIB,92300,110333,129333,18260,6242,61233,180000 "Flexible IO Tester - Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (MB/s)",HIB,360,432,505,71.3,24.4,240,703 "Flexible IO Tester - Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (MB/s)",HIB,9131,,,203,2080,2285,6145 "Flexible IO Tester - Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (IOPS)",HIB,73033,91300,99900,1623,16633,18300,49140 "Flexible IO Tester - Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (IOPS)",HIB,175333,177333,178667,6991,9825,12100,99133 "Flexible IO Tester - Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory (MB/s)",HIB,685,692,697,27.3,38.4,47.2,388 "Flexible IO Tester - Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (IOPS)",HIB,156667,157000,156333,1561,6327,7633,58733 "Flexible IO Tester - Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (MB/s)",HIB,,,,196,791,955,7340 "Flexible IO Tester - Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (MB/s)",HIB,,,,195,2138,1182,6804 "Flexible IO Tester - Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (IOPS)",HIB,72700,93500,95733,1617,16400,18300,49633 "Flexible IO Tester - Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory (MB/s)",HIB,9083,,,203,2054,2286,6210