AMD EPYC Linux SSD NVMe Testing AMD EPYC 7601 32-Core testing with NVMe RAID by Michael Larabel for a future article on phoronix. Samsung 850 256GB EXT4: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: ext4 Force MP500 120GB EXT4: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: ext4 2 x 120GB Force MP500 EXT4 RAID0: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: ext4 2 x 120GB Force MP500 EXT4 RAID1: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: ext4 2 x 120GB Force MP500 F2FS RAID0: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: f2fs 2 x 120GB Force MP500 F2FS RAID1: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: f2fs Force MP500 120GB F2FS: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: f2fs Force MP500 120GB Btrfs: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: btrfs 2 x 120GB Force MP500 Btrfs RAID1: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: btrfs Force MP500 120GB Btrfs + LZO: Processor: AMD EPYC 7601 32-Core @ 2.20GHz (64 Cores), Motherboard: TYAN B8026T70AE24HR, Chipset: AMD Device 1450, Memory: 129024MB, Disk: 256GB Samsung SSD 850 + 2 x 120GB Force MP500, Graphics: ASPEED ASPEED Family, Monitor: Acer P243W, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: Ubuntu 17.04, Kernel: 4.13.0-041300-generic (x86_64), Desktop: Unity 7.5.0, Display Driver: modesetting 1.19.3, Compiler: GCC 6.3.0 20170406, File-System: btrfs SQLite 3.8.10.2 Test Target: Default Test Directory Seconds < Lower Is Better Samsung 850 256GB EXT4 ............ 39.78 |================================ Force MP500 120GB EXT4 ............ 15.70 |============= 2 x 120GB Force MP500 EXT4 RAID0 .. 15.62 |============= 2 x 120GB Force MP500 EXT4 RAID1 .. 20.40 |================ 2 x 120GB Force MP500 F2FS RAID0 .. 17.64 |============== 2 x 120GB Force MP500 F2FS RAID1 .. 36.16 |============================= Force MP500 120GB F2FS ............ 17.08 |============== Force MP500 120GB Btrfs ........... 34.57 |============================ 2 x 120GB Force MP500 Btrfs RAID1 . 35.42 |============================ Force MP500 120GB Btrfs + LZO ..... 44.75 |==================================== Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 309.40 |========== Force MP500 120GB EXT4 ............ 557.16 |=================== 2 x 120GB Force MP500 EXT4 RAID0 .. 1018.00 |================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 980.98 |================================= 2 x 120GB Force MP500 F2FS RAID0 .. 1017.47 |================================== 2 x 120GB Force MP500 F2FS RAID1 .. 698.19 |======================= Force MP500 120GB F2FS ............ 556.94 |=================== Force MP500 120GB Btrfs ........... 500.16 |================= 2 x 120GB Force MP500 Btrfs RAID1 . 493.49 |================ Force MP500 120GB Btrfs + LZO ..... 349.46 |============ Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Samsung 850 256GB EXT4 ............ 77347 |========== Force MP500 120GB EXT4 ............ 139287 |=================== 2 x 120GB Force MP500 EXT4 RAID0 .. 260576 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 245243 |================================= 2 x 120GB Force MP500 F2FS RAID0 .. 260461 |=================================== 2 x 120GB Force MP500 F2FS RAID1 .. 174544 |======================= Force MP500 120GB F2FS ............ 139230 |=================== Force MP500 120GB Btrfs ........... 125035 |================= 2 x 120GB Force MP500 Btrfs RAID1 . 123369 |================= Force MP500 120GB Btrfs + LZO ..... 87361 |============ Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 300.40 |============= Force MP500 120GB EXT4 ............ 796.60 |================================== 2 x 120GB Force MP500 EXT4 RAID0 .. 828.24 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 528.42 |====================== 2 x 120GB Force MP500 F2FS RAID0 .. 805.76 |================================== 2 x 120GB Force MP500 F2FS RAID1 .. 497.56 |===================== Force MP500 120GB F2FS ............ 786.17 |================================= Force MP500 120GB Btrfs ........... 68.93 |=== 2 x 120GB Force MP500 Btrfs RAID1 . 54.98 |== Force MP500 120GB Btrfs + LZO ..... 66.86 |=== Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Samsung 850 256GB EXT4 ............ 75096 |============= Force MP500 120GB EXT4 ............ 199148 |================================== 2 x 120GB Force MP500 EXT4 RAID0 .. 207056 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 132100 |====================== 2 x 120GB Force MP500 F2FS RAID0 .. 201436 |================================== 2 x 120GB Force MP500 F2FS RAID1 .. 124387 |===================== Force MP500 120GB F2FS ............ 196538 |================================= Force MP500 120GB Btrfs ........... 17228 |=== 2 x 120GB Force MP500 Btrfs RAID1 . 13741 |== Force MP500 120GB Btrfs + LZO ..... 16711 |=== Flexible IO Tester 2.1.13 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 358.27 |============= Force MP500 120GB EXT4 ............ 514.06 |================== 2 x 120GB Force MP500 EXT4 RAID0 .. 973.96 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 535.98 |=================== 2 x 120GB Force MP500 F2FS RAID0 .. 973.77 |=================================== 2 x 120GB Force MP500 F2FS RAID1 .. 515.09 |=================== Force MP500 120GB F2FS ............ 515.35 |=================== Force MP500 120GB Btrfs ........... 517.88 |=================== 2 x 120GB Force MP500 Btrfs RAID1 . 494.80 |================== Force MP500 120GB Btrfs + LZO ..... 512.88 |================== Flexible IO Tester 2.1.13 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Samsung 850 256GB EXT4 ............ 89565 |============= Force MP500 120GB EXT4 ............ 128512 |================== 2 x 120GB Force MP500 EXT4 RAID0 .. 243485 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 133991 |=================== 2 x 120GB Force MP500 F2FS RAID0 .. 243440 |=================================== 2 x 120GB Force MP500 F2FS RAID1 .. 128769 |=================== Force MP500 120GB F2FS ............ 128834 |=================== Force MP500 120GB Btrfs ........... 129467 |=================== 2 x 120GB Force MP500 Btrfs RAID1 . 123696 |================== Force MP500 120GB Btrfs + LZO ..... 128217 |================== Flexible IO Tester 2.1.13 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 364.82 |============= Force MP500 120GB EXT4 ............ 804.79 |============================= 2 x 120GB Force MP500 EXT4 RAID0 .. 955.38 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 541.95 |==================== 2 x 120GB Force MP500 F2FS RAID0 .. 916.09 |================================== 2 x 120GB Force MP500 F2FS RAID1 .. 496.89 |================== Force MP500 120GB F2FS ............ 808.23 |============================== Force MP500 120GB Btrfs ........... 71.41 |=== 2 x 120GB Force MP500 Btrfs RAID1 . 60.30 |== Force MP500 120GB Btrfs + LZO ..... 73.18 |=== Flexible IO Tester 2.1.13 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Samsung 850 256GB EXT4 ............ 91202 |============= Force MP500 120GB EXT4 ............ 201194 |============================= 2 x 120GB Force MP500 EXT4 RAID0 .. 238840 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 135485 |==================== 2 x 120GB Force MP500 F2FS RAID0 .. 229019 |================================== 2 x 120GB Force MP500 F2FS RAID1 .. 124218 |================== Force MP500 120GB F2FS ............ 202053 |============================== Force MP500 120GB Btrfs ........... 17849 |=== 2 x 120GB Force MP500 Btrfs RAID1 . 15071 |== Force MP500 120GB Btrfs + LZO ..... 18293 |=== BlogBench 1.0 Test: Read Final Score > Higher Is Better Samsung 850 256GB EXT4 ............ 1450523 |=============================== Force MP500 120GB EXT4 ............ 1375043 |============================== 2 x 120GB Force MP500 EXT4 RAID0 .. 1407723 |============================== 2 x 120GB Force MP500 EXT4 RAID1 .. 1347984 |============================= 2 x 120GB Force MP500 F2FS RAID0 .. 1580173 |================================== 2 x 120GB Force MP500 F2FS RAID1 .. 1581648 |================================== Force MP500 120GB F2FS ............ 1564221 |================================== Force MP500 120GB Btrfs ........... 1498682 |================================ 2 x 120GB Force MP500 Btrfs RAID1 . 1498541 |================================ Force MP500 120GB Btrfs + LZO ..... 1479450 |================================ BlogBench 1.0 Test: Write Final Score > Higher Is Better Samsung 850 256GB EXT4 ............ 25704 |================================= Force MP500 120GB EXT4 ............ 26003 |================================= 2 x 120GB Force MP500 EXT4 RAID0 .. 28178 |==================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 27287 |=================================== 2 x 120GB Force MP500 F2FS RAID0 .. 9002 |============ 2 x 120GB Force MP500 F2FS RAID1 .. 9333 |============ Force MP500 120GB F2FS ............ 9263 |============ Force MP500 120GB Btrfs ........... 5746 |======= 2 x 120GB Force MP500 Btrfs RAID1 . 5523 |======= Force MP500 120GB Btrfs + LZO ..... 5661 |======= Dbench 4.0 Client Count: 1 MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 126.55 |========= Force MP500 120GB EXT4 ............ 265.59 |==================== 2 x 120GB Force MP500 EXT4 RAID0 .. 285.98 |===================== 2 x 120GB Force MP500 EXT4 RAID1 .. 187.69 |============== 2 x 120GB Force MP500 F2FS RAID0 .. 400.45 |============================== 2 x 120GB Force MP500 F2FS RAID1 .. 376.07 |============================ Force MP500 120GB F2FS ............ 467.65 |=================================== Force MP500 120GB Btrfs ........... 176.35 |============= 2 x 120GB Force MP500 Btrfs RAID1 . 162.40 |============ Force MP500 120GB Btrfs + LZO ..... 181.55 |============== Dbench 4.0 Client Count: 6 MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 372.00 |======= Force MP500 120GB EXT4 ............ 681.91 |============= 2 x 120GB Force MP500 EXT4 RAID0 .. 793.33 |=============== 2 x 120GB Force MP500 EXT4 RAID1 .. 551.93 |========== 2 x 120GB Force MP500 F2FS RAID0 .. 1720.12 |================================ 2 x 120GB Force MP500 F2FS RAID1 .. 1622.22 |============================== Force MP500 120GB F2FS ............ 1839.76 |================================== Force MP500 120GB Btrfs ........... 536.04 |========== 2 x 120GB Force MP500 Btrfs RAID1 . 528.54 |========== Force MP500 120GB Btrfs + LZO ..... 554.59 |========== Threaded I/O Tester 20170503 Test: Write - Size Per Thread: 32MB - Thread Count: 4 MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 2.91 |===== Force MP500 120GB EXT4 ............ 9.40 |================= 2 x 120GB Force MP500 EXT4 RAID0 .. 9.37 |================= 2 x 120GB Force MP500 EXT4 RAID1 .. 4.26 |======== 2 x 120GB Force MP500 F2FS RAID0 .. 19.58 |=================================== 2 x 120GB Force MP500 F2FS RAID1 .. 18.49 |================================= Force MP500 120GB F2FS ............ 19.95 |==================================== Force MP500 120GB Btrfs ........... 9.04 |================ 2 x 120GB Force MP500 Btrfs RAID1 . 8.65 |================ Force MP500 120GB Btrfs + LZO ..... 7.75 |============== Threaded I/O Tester 20170503 Test: Write - Size Per Thread: 32MB - Thread Count: 8 MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 4.91 |===== Force MP500 120GB EXT4 ............ 18.08 |================= 2 x 120GB Force MP500 EXT4 RAID0 .. 17.71 |================= 2 x 120GB Force MP500 EXT4 RAID1 .. 8.53 |======== 2 x 120GB Force MP500 F2FS RAID0 .. 36.78 |=================================== 2 x 120GB Force MP500 F2FS RAID1 .. 34.95 |================================== Force MP500 120GB F2FS ............ 37.32 |==================================== Force MP500 120GB Btrfs ........... 12.45 |============ 2 x 120GB Force MP500 Btrfs RAID1 . 11.75 |=========== Force MP500 120GB Btrfs + LZO ..... 12.11 |============ Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better Samsung 850 256GB EXT4 ............ 389.22 |============================= Force MP500 120GB EXT4 ............ 399.56 |============================== 2 x 120GB Force MP500 EXT4 RAID0 .. 398.60 |============================= 2 x 120GB Force MP500 EXT4 RAID1 .. 396.82 |============================= 2 x 120GB Force MP500 F2FS RAID0 .. 473.54 |=================================== 2 x 120GB Force MP500 F2FS RAID1 .. 471.21 |=================================== Force MP500 120GB F2FS ............ 466.32 |================================== Force MP500 120GB Btrfs ........... 133.83 |========== 2 x 120GB Force MP500 Btrfs RAID1 . 128.00 |========= Force MP500 120GB Btrfs + LZO ..... 144.26 |=========== PostMark 1.51 Disk Transaction Performance TPS > Higher Is Better Samsung 850 256GB EXT4 ............ 5597 |=============================== Force MP500 120GB EXT4 ............ 5681 |=============================== 2 x 120GB Force MP500 EXT4 RAID0 .. 5639 |=============================== 2 x 120GB Force MP500 EXT4 RAID1 .. 5476 |============================== 2 x 120GB Force MP500 F2FS RAID0 .. 6697 |===================================== 2 x 120GB Force MP500 F2FS RAID1 .. 6756 |===================================== Force MP500 120GB F2FS ............ 6756 |===================================== Force MP500 120GB Btrfs ........... 4749 |========================== 2 x 120GB Force MP500 Btrfs RAID1 . 4901 |=========================== Force MP500 120GB Btrfs + LZO ..... 4777 |========================== Timed LLVM Compilation 4.0.1 Time To Compile Seconds < Lower Is Better Force MP500 120GB EXT4 ........... 173.51 |=================================== 2 x 120GB Force MP500 EXT4 RAID0 . 172.06 |=================================== 2 x 120GB Force MP500 EXT4 RAID1 . 176.00 |==================================== 2 x 120GB Force MP500 F2FS RAID0 . 177.49 |==================================== 2 x 120GB Force MP500 F2FS RAID1 . 174.71 |=================================== Force MP500 120GB F2FS ........... 171.99 |=================================== Force MP500 120GB Btrfs + LZO .... 172.43 |=================================== Timed Linux Kernel Compilation 4.9 Time To Compile Seconds < Lower Is Better Force MP500 120GB EXT4 ............ 37.50 |=================================== 2 x 120GB Force MP500 EXT4 RAID0 .. 37.74 |==================================== 2 x 120GB Force MP500 EXT4 RAID1 .. 37.73 |=================================== 2 x 120GB Force MP500 F2FS RAID0 .. 37.60 |=================================== 2 x 120GB Force MP500 F2FS RAID1 .. 38.27 |==================================== Force MP500 120GB F2FS ............ 37.48 |=================================== Force MP500 120GB Btrfs ........... 31.10 |============================= 2 x 120GB Force MP500 Btrfs RAID1 . 31.15 |============================= Force MP500 120GB Btrfs + LZO ..... 37.47 |===================================