20190617-glusterfs 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite. Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: fuseblk, Screen Resolution: 1024x768 ZFS RaidZ2 6EA 12TB recordsize 128K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Read Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 574 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 2149 | IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Read Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 614 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 2034 | IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Read Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 620 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 2172 | IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 255 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 317 | IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 297 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 328 | IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 324 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 383 | IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Read Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 583 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 2666 | IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 201 | ZFS RaidZ2 6EA 12TB recordsize 128K ........................................ 374 | FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 20.63 | FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 53.99 | FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 19.80 | FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync Files/s > Higher Is Better Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K . 122.35 |