storage 2 x Intel Xeon E5-2403 v2 testing with a Dell 0JD6X3 (2.4.2 BIOS) and Matrox G200eR2 on CentOS Linux 7 via the Phoronix Test Suite. freenas-96: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 1000GB VTrak D5800, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.18.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 freenas-97: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 1000GB VTrak D5800, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.18.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 synology: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 1000GB VTrak D5800, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.18.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 freenas-96-mtu9000: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 21475GB iSCSI Storage, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.19.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 freenas-97-mtu9000: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 21475GB iSCSI Storage, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.19.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 synology-mtu9000: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 21475GB iSCSI Storage, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.19.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 truenas-96: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 74292GB iSCSI Disk, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.19.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 truenas-97: Processor: 2 x Intel Xeon E5-2403 v2 @ 1.80GHz (8 Cores), Motherboard: Dell 0JD6X3 (2.4.2 BIOS), Chipset: Intel Xeon E7 v2/Xeon, Memory: 4 x 8192 MB DDR3-1333MT/s, Disk: 199GB PERC H310 + 74292GB iSCSI Disk, Graphics: Matrox G200eR2, Network: 2 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-1127.19.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 148 |=================================== freenas-97 ......... 143 |================================= synology ........... 160 |===================================== freenas-96-mtu9000 . 209 |================================================= freenas-97-mtu9000 . 177 |========================================= synology-mtu9000 ... 130 |============================== truenas-96 ......... 227 |===================================================== truenas-97 ......... 185 |=========================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 37867 |================================= freenas-97 ......... 36700 |================================ synology ........... 41067 |==================================== freenas-96-mtu9000 . 53433 |=============================================== freenas-97-mtu9000 . 45300 |======================================== synology-mtu9000 ... 33233 |============================= truenas-96 ......... 57833 |=================================================== truenas-97 ......... 47400 |========================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 144 |======================================= freenas-97 ......... 136 |==================================== synology ........... 156 |========================================== freenas-96-mtu9000 . 186 |================================================== freenas-97-mtu9000 . 185 |================================================== synology-mtu9000 ... 141 |====================================== truenas-96 ......... 198 |===================================================== truenas-97 ......... 145 |======================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 36833 |===================================== freenas-97 ......... 34967 |=================================== synology ........... 39533 |======================================== freenas-96-mtu9000 . 47667 |================================================ freenas-97-mtu9000 . 47433 |================================================ synology-mtu9000 ... 36033 |==================================== truenas-96 ......... 50700 |=================================================== truenas-97 ......... 37267 |===================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 13.200 |========================= freenas-97 ......... 9.857 |================== synology ........... 15.700 |============================= freenas-96-mtu9000 . 13.000 |======================== freenas-97-mtu9000 . 10.900 |==================== synology-mtu9000 ... 23.500 |============================================ truenas-96 ......... 26.800 |================================================== truenas-97 ......... 22.800 |=========================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 3373 |========================= freenas-97 ......... 2501 |=================== synology ........... 4003 |============================== freenas-96-mtu9000 . 3312 |========================= freenas-97-mtu9000 . 2783 |===================== synology-mtu9000 ... 6105 |============================================== truenas-96 ......... 6935 |==================================================== truenas-97 ......... 5840 |============================================ Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 206.0 |=================================================== freenas-97 ......... 163.0 |======================================== synology ........... 152.0 |===================================== freenas-96-mtu9000 . 207.0 |=================================================== freenas-97-mtu9000 . 163.0 |======================================== synology-mtu9000 ... 96.8 |======================== truenas-96 ......... 182.0 |============================================= truenas-97 ......... 69.7 |================= Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 52467 |================================================== freenas-97 ......... 41633 |======================================== synology ........... 38867 |===================================== freenas-96-mtu9000 . 53000 |=================================================== freenas-97-mtu9000 . 41700 |======================================== synology-mtu9000 ... 24767 |======================== truenas-96 ......... 46733 |============================================= truenas-97 ......... 17533 |================= Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 12.30 |========================= freenas-97 ......... 9.96 |==================== synology ........... 15.70 |=============================== freenas-96-mtu9000 . 11.60 |======================= freenas-97-mtu9000 . 11.10 |====================== synology-mtu9000 ... 24.00 |================================================ truenas-96 ......... 25.60 |=================================================== truenas-97 ......... 22.80 |============================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 3133 |========================= freenas-97 ......... 2549 |==================== synology ........... 4005 |================================ freenas-96-mtu9000 . 3042 |======================== freenas-97-mtu9000 . 2849 |======================= synology-mtu9000 ... 6154 |================================================= truenas-96 ......... 6552 |==================================================== truenas-97 ......... 5834 |============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 188.0 |============================================== freenas-97 ......... 172.0 |========================================== synology ........... 162.0 |======================================== freenas-96-mtu9000 . 209.0 |=================================================== freenas-97-mtu9000 . 148.0 |==================================== synology-mtu9000 ... 172.0 |========================================== truenas-96 ......... 186.0 |============================================= truenas-97 ......... 65.9 |================ Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 48133 |============================================== freenas-97 ......... 43600 |========================================== synology ........... 41433 |======================================== freenas-96-mtu9000 . 53367 |=================================================== freenas-97-mtu9000 . 37533 |==================================== synology-mtu9000 ... 44033 |========================================== truenas-96 ......... 47100 |============================================= truenas-97 ......... 16967 |================ Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 461 |================================================= freenas-97 ......... 442 |=============================================== synology ........... 443 |=============================================== freenas-96-mtu9000 . 497 |===================================================== freenas-97-mtu9000 . 478 |=================================================== synology-mtu9000 ... 455 |================================================= truenas-96 ......... 478 |=================================================== truenas-97 ......... 471 |================================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 118000 |============================================== freenas-97 ......... 113000 |============================================ synology ........... 113333 |============================================= freenas-96-mtu9000 . 127333 |================================================== freenas-97-mtu9000 . 122000 |================================================ synology-mtu9000 ... 116667 |============================================== truenas-96 ......... 122333 |================================================ truenas-97 ......... 120667 |=============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 453 |=================================================== freenas-97 ......... 436 |================================================= synology ........... 437 |================================================= freenas-96-mtu9000 . 464 |==================================================== freenas-97-mtu9000 . 474 |===================================================== synology-mtu9000 ... 468 |==================================================== truenas-96 ......... 473 |===================================================== truenas-97 ......... 469 |==================================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 116000 |================================================ freenas-97 ......... 111667 |============================================== synology ........... 112000 |============================================== freenas-96-mtu9000 . 118667 |================================================= freenas-97-mtu9000 . 121333 |================================================== synology-mtu9000 ... 119667 |================================================= truenas-96 ......... 121000 |================================================== truenas-97 ......... 120333 |================================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 12.3 |======================= freenas-97 ......... 11.9 |====================== synology ........... 15.9 |============================== freenas-96-mtu9000 . 13.5 |========================= freenas-97-mtu9000 . 11.0 |===================== synology-mtu9000 ... 24.7 |============================================== truenas-96 ......... 27.8 |==================================================== truenas-97 ......... 22.2 |========================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 3159 |======================= freenas-97 ......... 3047 |====================== synology ........... 4060 |============================== freenas-96-mtu9000 . 3459 |========================= freenas-97-mtu9000 . 2820 |===================== synology-mtu9000 ... 6328 |============================================== truenas-96 ......... 7107 |==================================================== truenas-97 ......... 5687 |========================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 12.3 |====================== freenas-97 ......... 11.9 |====================== synology ........... 16.3 |============================== freenas-96-mtu9000 . 13.6 |========================= freenas-97-mtu9000 . 11.1 |==================== synology-mtu9000 ... 24.2 |============================================ truenas-96 ......... 28.7 |==================================================== truenas-97 ......... 23.8 |=========================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 3141 |====================== freenas-97 ......... 3045 |====================== synology ........... 4173 |============================== freenas-96-mtu9000 . 3487 |========================= freenas-97-mtu9000 . 2838 |==================== synology-mtu9000 ... 6196 |============================================ truenas-96 ......... 7330 |==================================================== truenas-97 ......... 6075 |=========================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 12.3 |======================== freenas-97 ......... 11.8 |======================= synology ........... 15.5 |============================== freenas-96-mtu9000 . 13.0 |========================= freenas-97-mtu9000 . 11.0 |===================== synology-mtu9000 ... 24.3 |=============================================== truenas-96 ......... 27.0 |==================================================== truenas-97 ......... 23.5 |============================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 3149 |======================= freenas-97 ......... 3017 |====================== synology ........... 3962 |============================= freenas-96-mtu9000 . 3333 |========================= freenas-97-mtu9000 . 2820 |===================== synology-mtu9000 ... 6224 |============================================== truenas-96 ......... 6997 |==================================================== truenas-97 ......... 6028 |============================================= Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 25.50 |=================================================== freenas-97 ......... 21.80 |============================================ synology ........... 16.96 |================================== freenas-96-mtu9000 . 25.40 |=================================================== freenas-97-mtu9000 . 23.30 |=============================================== synology-mtu9000 ... 17.33 |=================================== truenas-96 ......... 24.20 |================================================ truenas-97 ......... 18.70 |===================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 6526 |==================================================== freenas-97 ......... 5588 |============================================= synology ........... 4324 |================================== freenas-96-mtu9000 . 6493 |==================================================== freenas-97-mtu9000 . 5953 |=============================================== synology-mtu9000 ... 4422 |=================================== truenas-96 ......... 6208 |================================================= truenas-97 ......... 4775 |====================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 13.80 |========================= freenas-97 ......... 9.96 |================== synology ........... 15.40 |============================ freenas-96-mtu9000 . 11.70 |===================== freenas-97-mtu9000 . 11.10 |==================== synology-mtu9000 ... 23.50 |=========================================== truenas-96 ......... 27.90 |=================================================== truenas-97 ......... 22.60 |========================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 3533 |========================== freenas-97 ......... 2548 |=================== synology ........... 3953 |============================= freenas-96-mtu9000 . 2988 |====================== freenas-97-mtu9000 . 2857 |===================== synology-mtu9000 ... 6023 |============================================ truenas-96 ......... 7149 |==================================================== truenas-97 ......... 5774 |========================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 25.3 |==================================================== freenas-97 ......... 24.6 |=================================================== synology ........... 19.1 |======================================= freenas-96-mtu9000 . 24.7 |=================================================== freenas-97-mtu9000 . 21.1 |=========================================== synology-mtu9000 ... 20.6 |========================================== truenas-96 ......... 24.6 |=================================================== truenas-97 ......... 21.0 |=========================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 6475 |==================================================== freenas-97 ......... 6294 |=================================================== synology ........... 4891 |======================================= freenas-96-mtu9000 . 6325 |=================================================== freenas-97-mtu9000 . 5476 |============================================ synology-mtu9000 ... 5271 |========================================== truenas-96 ......... 6316 |=================================================== truenas-97 ......... 5382 |=========================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 504 |================================================ freenas-97 ......... 530 |=================================================== synology ........... 475 |============================================= freenas-96-mtu9000 . 554 |===================================================== freenas-97-mtu9000 . 538 |=================================================== synology-mtu9000 ... 501 |================================================ truenas-96 ......... 523 |================================================== truenas-97 ......... 525 |================================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 129000 |============================================== freenas-97 ......... 135667 |================================================ synology ........... 121333 |=========================================== freenas-96-mtu9000 . 141667 |================================================== freenas-97-mtu9000 . 137667 |================================================= synology-mtu9000 ... 128333 |============================================= truenas-96 ......... 133667 |=============================================== truenas-97 ......... 134333 |=============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / MB/s > Higher Is Better freenas-96 ......... 515 |================================================== freenas-97 ......... 543 |===================================================== synology ........... 516 |================================================== freenas-96-mtu9000 . 530 |==================================================== freenas-97-mtu9000 . 515 |================================================== synology-mtu9000 ... 513 |================================================== truenas-96 ......... 541 |===================================================== truenas-97 ......... 530 |==================================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: / IOPS > Higher Is Better freenas-96 ......... 131667 |=============================================== freenas-97 ......... 138667 |================================================== synology ........... 132333 |================================================ freenas-96-mtu9000 . 136000 |================================================= freenas-97-mtu9000 . 131667 |=============================================== synology-mtu9000 ... 131333 |=============================================== truenas-96 ......... 138333 |================================================== truenas-97 ......... 135667 |=================================================