sds-merge 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0020.122820161512 BIOS) and mgadrmfb on CentOS Linux 7 via the Phoronix Test Suite. Promise D5800 Raid10 14TB 24EA: Processor: 2 x Intel Xeon E5-2620 0 @ 2.50GHz (12 Cores / 24 Threads), Motherboard: Dell 0020HJ (2.5.4 BIOS), Chipset: Intel Xeon E5/Core, Memory: 8 x 16384 MB DDR3-1600MT/s M393B2G70BH0-CK0, Disk: 149GB PERC H710P + 1200GB PERC H710P + 8001GB PERC H710P + 153293GB VTrak D5800, Graphics: Matrox G200eR2, Network: 4 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.12.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768 Promise D5800 Raid5 14TB 24EA: Processor: 2 x Intel Xeon E5-2620 0 @ 2.50GHz (12 Cores / 24 Threads), Motherboard: Dell 0020HJ (2.5.4 BIOS), Chipset: Intel Xeon E5/Core, Memory: 8 x 16384 MB DDR3-1600MT/s M393B2G70BH0-CK0, Disk: 149GB PERC H710P + 1200GB PERC H710P + 8001GB PERC H710P + 153293GB VTrak D5800, Graphics: Matrox G200eR2, Network: 4 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.12.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768 Synology RS2418+ Raid5 8TB 12EA: Processor: Intel Xeon E5-2403 v2 @ 1.80GHz (4 Cores), Motherboard: Dell 0K29HN (2.9.0 BIOS), Memory: 4 x 4096 MB DDR3-1600MT/s M393B5270QB0-YK0, Disk: 120GB INTEL SSDSC2BW12 + 2000GB PERC H310 + 75162GB iSCSI Storage, Graphics: mgadrmfb OS: CentOS Linux 7, Kernel: 3.10.0-1062.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 Synology RS2418+ Raid10 8TB 12EA: Processor: Intel Xeon E5-2403 v2 @ 1.80GHz (4 Cores), Motherboard: Dell 0K29HN (2.9.0 BIOS), Memory: 4 x 4096 MB DDR3-1600MT/s M393B5270QB0-YK0, Disk: 120GB INTEL SSDSC2BW12 + 2000GB PERC H310 + 75162GB iSCSI Storage, Graphics: mgadrmfb OS: CentOS Linux 7, Kernel: 3.10.0-1062.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 Synology RS2418+ Raid5 8TB 12EA noop: Processor: Intel Xeon E5-2403 v2 @ 1.80GHz (4 Cores), Motherboard: Dell 0K29HN (2.9.0 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 4096 MB DDR3-1600MT/s M393B5270QB0-YK0, Disk: 120GB INTEL SSDSC2BW12 + 2000GB PERC H310 + 75162GB iSCSI Storage, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.8.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 Intel S3710 200G 1EA localhost: Processor: Intel Xeon E5-2403 v2 @ 1.80GHz (4 Cores), Motherboard: Dell 0K29HN (2.9.0 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 4096 MB DDR3-1600MT/s M393B5270QB0-YK0, Disk: 120GB INTEL SSDSC2BW12 + 2000GB PERC H310 + 75162GB iSCSI Storage, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.8.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 ZFS Raidz3 12TB 11EA: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0020.122820161512 BIOS), Memory: 16 x 16384 MB DDR4-2400MT/s Samsung M393A2K40CB1-CRC, Disk: 240GB INTEL SSDSC2KB24 + 13 x 12000GB Seagate ST12000NM0027 + 2 x 8002GB Seagate ST8000NM0016-1U3, Graphics: mgadrmfb, Monitor: DELL 1908FP OS: CentOS Linux 7, Kernel: 3.10.0-1062.18.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1280x1024 Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 23.8 |============================ Promise D5800 Raid5 14TB 24EA ........ 20.5 |======================== Synology RS2418+ Raid5 8TB 12EA ...... 16.7 |=================== Synology RS2418+ Raid10 8TB 12EA ..... 15.9 |=================== Synology RS2418+ Raid5 8TB 12EA noop . 14.9 |================= Intel S3710 200G 1EA localhost ....... 29.2 |================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 6082 |============================ Promise D5800 Raid5 14TB 24EA ........ 5255 |======================== Synology RS2418+ Raid5 8TB 12EA ...... 4292 |==================== Synology RS2418+ Raid10 8TB 12EA ..... 4153 |=================== Synology RS2418+ Raid5 8TB 12EA noop . 3828 |================= Intel S3710 200G 1EA localhost ....... 7483 |================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 7.429 |==== Promise D5800 Raid5 14TB 24EA ........ 3.518 |== Synology RS2418+ Raid5 8TB 12EA ...... 20.700 |========== Synology RS2418+ Raid10 8TB 12EA ..... 19.500 |========== Synology RS2418+ Raid5 8TB 12EA noop . 20.900 |========== Intel S3710 200G 1EA localhost ....... 65.100 |================================ Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 1857 |==== Promise D5800 Raid5 14TB 24EA ........ 879 |== Synology RS2418+ Raid5 8TB 12EA ...... 5300 |========== Synology RS2418+ Raid10 8TB 12EA ..... 4993 |========== Synology RS2418+ Raid5 8TB 12EA noop . 5364 |=========== Intel S3710 200G 1EA localhost ....... 16700 |================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 89.1 |=============================== Promise D5800 Raid5 14TB 24EA ........ 80.5 |============================ Synology RS2418+ Raid5 8TB 12EA ...... 65.1 |======================= Synology RS2418+ Raid10 8TB 12EA ..... 56.3 |==================== Synology RS2418+ Raid5 8TB 12EA noop . 71.6 |========================= Intel S3710 200G 1EA localhost ....... 96.6 |================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 5701 |=============================== Promise D5800 Raid5 14TB 24EA ........ 5155 |============================ Synology RS2418+ Raid5 8TB 12EA ...... 4163 |======================= Synology RS2418+ Raid10 8TB 12EA ..... 3604 |==================== Synology RS2418+ Raid5 8TB 12EA noop . 4585 |========================= Intel S3710 200G 1EA localhost ....... 6178 |================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 27.3 |===== Promise D5800 Raid5 14TB 24EA ........ 12.4 |== Synology RS2418+ Raid5 8TB 12EA ...... 61.8 |=========== Synology RS2418+ Raid10 8TB 12EA ..... 61.4 |=========== Synology RS2418+ Raid5 8TB 12EA noop . 63.6 |============ Intel S3710 200G 1EA localhost ....... 180.0 |================================= Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 1755 |===== Promise D5800 Raid5 14TB 24EA ........ 795 |== Synology RS2418+ Raid5 8TB 12EA ...... 3951 |=========== Synology RS2418+ Raid10 8TB 12EA ..... 3930 |=========== Synology RS2418+ Raid5 8TB 12EA noop . 4069 |============ Intel S3710 200G 1EA localhost ....... 11533 |================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 189 |=================================== Promise D5800 Raid5 14TB 24EA ........ 180 |================================= Synology RS2418+ Raid5 8TB 12EA ...... 169 |=============================== Synology RS2418+ Raid10 8TB 12EA ..... 177 |================================= Synology RS2418+ Raid5 8TB 12EA noop . 183 |================================== Intel S3710 200G 1EA localhost ....... 188 |=================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 3015 |================================== Promise D5800 Raid5 14TB 24EA ........ 2885 |================================= Synology RS2418+ Raid5 8TB 12EA ...... 2708 |=============================== Synology RS2418+ Raid10 8TB 12EA ..... 2828 |================================ Synology RS2418+ Raid5 8TB 12EA noop . 2924 |================================= Intel S3710 200G 1EA localhost ....... 3008 |================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 98.4 |=========== Promise D5800 Raid5 14TB 24EA ........ 49.0 |====== Synology RS2418+ Raid5 8TB 12EA ...... 118.0 |============== Synology RS2418+ Raid10 8TB 12EA ..... 164.0 |=================== Synology RS2418+ Raid5 8TB 12EA noop . 121.0 |============== Intel S3710 200G 1EA localhost ....... 287.0 |================================= Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 1571 |============ Promise D5800 Raid5 14TB 24EA ........ 783 |====== Synology RS2418+ Raid5 8TB 12EA ...... 1890 |============== Synology RS2418+ Raid10 8TB 12EA ..... 2618 |=================== Synology RS2418+ Raid5 8TB 12EA noop . 1931 |============== Intel S3710 200G 1EA localhost ....... 4585 |================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 244 |============================= Promise D5800 Raid5 14TB 24EA ........ 246 |============================= Synology RS2418+ Raid5 8TB 12EA ...... 265 |=============================== Synology RS2418+ Raid10 8TB 12EA ..... 295 |=================================== Synology RS2418+ Raid5 8TB 12EA noop . 286 |================================== Intel S3710 200G 1EA localhost ....... 245 |============================= Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 1949 |============================ Promise D5800 Raid5 14TB 24EA ........ 1965 |============================ Synology RS2418+ Raid5 8TB 12EA ...... 2122 |=============================== Synology RS2418+ Raid10 8TB 12EA ..... 2363 |================================== Synology RS2418+ Raid5 8TB 12EA noop . 2285 |================================= Intel S3710 200G 1EA localhost ....... 1955 |============================ Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsi MB/s > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 56.8 |====== Promise D5800 Raid5 14TB 24EA ........ 107.0 |============ Synology RS2418+ Raid5 8TB 12EA ...... 98.4 |=========== Synology RS2418+ Raid10 8TB 12EA ..... 183.0 |===================== Synology RS2418+ Raid5 8TB 12EA noop . 94.9 |=========== Intel S3710 200G 1EA localhost ....... 294.0 |================================= Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsi IOPS > Higher Is Better Promise D5800 Raid10 14TB 24EA ....... 454 |======= Promise D5800 Raid5 14TB 24EA ........ 857 |============ Synology RS2418+ Raid5 8TB 12EA ...... 786 |=========== Synology RS2418+ Raid10 8TB 12EA ..... 1465 |===================== Synology RS2418+ Raid5 8TB 12EA noop . 759 |=========== Intel S3710 200G 1EA localhost ....... 2348 |================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: /iscsi MB/s > Higher Is Better ZFS Raidz3 12TB 11EA . 17.3 |================================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: /iscsi IOPS > Higher Is Better ZFS Raidz3 12TB 11EA . 138 |=================================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: /iscsi MB/s > Higher Is Better ZFS Raidz3 12TB 11EA . 5.468 |================================================= Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: /iscsi IOPS > Higher Is Better ZFS Raidz3 12TB 11EA . 42 |====================================================