Samsung Quad NVMe SSD RAID Btrfs Tests Btrfs NVMe RAID Linux benchmarks by Michael Larabel for a future article on Phoronix.com. Single Disk: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 2-Disk RAID0: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 2-Disk RAID1: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID0: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID1: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 240GB TOSHIBA-RC100 + 4 x Samsung SSD 970 EVO 250GB, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID5: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID6: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID10: Processor: AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS), Chipset: AMD Family 17h, Memory: 4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR, Disk: 4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100, Graphics: NV132 11264MB, Audio: Realtek ALC1220, Monitor: ASUS PB278, Network: Intel I211 Gigabit Connection + Intel Device 2526 OS: Ubuntu 18.04, Kernel: 4.18.1-041801-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, OpenGL: 4.3 Mesa 18.0.5, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 2560x1440 SQLite 3.22 Timed SQLite Insertions Seconds < Lower Is Better Single Disk ... 87.95 |============================================= 2-Disk RAID0 .. 91.50 |=============================================== 2-Disk RAID1 .. 93.39 |================================================ 4-Disk RAID0 .. 96.63 |================================================== 4-Disk RAID1 .. 94.98 |================================================= 4-Disk RAID5 .. 104.48 |====================================================== 4-Disk RAID6 .. 106.72 |======================================================= 4-Disk RAID10 . 99.89 |=================================================== Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 2950 |============================ 2-Disk RAID0 .. 1634 |================ 2-Disk RAID1 .. 3402 |================================= 4-Disk RAID0 .. 3040 |============================= 4-Disk RAID1 .. 5951 |========================================================= 4-Disk RAID5 .. 1858 |================== 4-Disk RAID6 .. 1178 |=========== 4-Disk RAID10 . 1636 |================ Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 406 |=========================================== 2-Disk RAID0 .. 521 |======================================================= 2-Disk RAID1 .. 407 |=========================================== 4-Disk RAID0 .. 494 |==================================================== 4-Disk RAID1 .. 532 |========================================================= 4-Disk RAID5 .. 515 |======================================================= 4-Disk RAID6 .. 525 |======================================================== 4-Disk RAID10 . 546 |========================================================== Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Single Disk ... 104000 |========================================= 2-Disk RAID0 .. 133444 |==================================================== 2-Disk RAID1 .. 104000 |========================================= 4-Disk RAID0 .. 126500 |================================================== 4-Disk RAID1 .. 136333 |====================================================== 4-Disk RAID5 .. 131667 |==================================================== 4-Disk RAID6 .. 134500 |===================================================== 4-Disk RAID10 . 140000 |======================================================= Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 429 |================ 2-Disk RAID0 .. 844 |=============================== 2-Disk RAID1 .. 452 |================= 4-Disk RAID0 .. 1557 |========================================================= 4-Disk RAID1 .. 595 |====================== 4-Disk RAID5 .. 1127 |========================================= 4-Disk RAID6 .. 791 |============================= 4-Disk RAID10 . 837 |=============================== Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 185.00 |======================================================= 2-Disk RAID0 .. 145.00 |=========================================== 2-Disk RAID1 .. 134.00 |======================================== 4-Disk RAID0 .. 97.64 |============================= 4-Disk RAID1 .. 98.26 |============================= 4-Disk RAID5 .. 94.92 |============================ 4-Disk RAID6 .. 100.07 |============================== 4-Disk RAID10 . 95.90 |============================= Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Single Disk ... 47456 |======================================================== 2-Disk RAID0 .. 36900 |============================================ 2-Disk RAID1 .. 34222 |======================================== 4-Disk RAID0 .. 24878 |============================= 4-Disk RAID1 .. 24900 |============================= 4-Disk RAID5 .. 24300 |============================= 4-Disk RAID6 .. 25600 |============================== 4-Disk RAID10 . 24533 |============================= Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 565 |=========================================== 2-Disk RAID0 .. 740 |========================================================= 2-Disk RAID1 .. 560 |=========================================== 4-Disk RAID0 .. 754 |========================================================== 4-Disk RAID1 .. 598 |============================================== 4-Disk RAID5 .. 741 |========================================================= 4-Disk RAID6 .. 734 |======================================================== 4-Disk RAID10 . 742 |========================================================= Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 502 |====================================================== 2-Disk RAID0 .. 504 |======================================================= 2-Disk RAID1 .. 484 |==================================================== 4-Disk RAID0 .. 514 |======================================================== 4-Disk RAID1 .. 491 |===================================================== 4-Disk RAID5 .. 501 |====================================================== 4-Disk RAID6 .. 496 |====================================================== 4-Disk RAID10 . 536 |========================================================== Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Single Disk ... 128444 |==================================================== 2-Disk RAID0 .. 129000 |==================================================== 2-Disk RAID1 .. 124000 |================================================== 4-Disk RAID0 .. 131667 |===================================================== 4-Disk RAID1 .. 125667 |================================================== 4-Disk RAID5 .. 128333 |==================================================== 4-Disk RAID6 .. 127000 |=================================================== 4-Disk RAID10 . 137000 |======================================================= Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 359 |============= 2-Disk RAID0 .. 843 |=============================== 2-Disk RAID1 .. 376 |============== 4-Disk RAID0 .. 1561 |========================================================= 4-Disk RAID1 .. 722 |========================== 4-Disk RAID5 .. 1168 |=========================================== 4-Disk RAID6 .. 805 |============================= 4-Disk RAID10 . 714 |========================== Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better Single Disk ... 143.00 |======================================================= 2-Disk RAID0 .. 132.00 |=================================================== 2-Disk RAID1 .. 129.00 |================================================== 4-Disk RAID0 .. 106.86 |========================================= 4-Disk RAID1 .. 92.84 |==================================== 4-Disk RAID5 .. 96.91 |===================================== 4-Disk RAID6 .. 101.46 |======================================= 4-Disk RAID10 . 93.08 |==================================== Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better Single Disk ... 36700 |======================================================== 2-Disk RAID0 .. 33533 |=================================================== 2-Disk RAID1 .. 32933 |================================================== 4-Disk RAID0 .. 27356 |========================================== 4-Disk RAID1 .. 23756 |==================================== 4-Disk RAID5 .. 24825 |====================================== 4-Disk RAID6 .. 25958 |======================================== 4-Disk RAID10 . 23800 |==================================== FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better Single Disk ... 246.00 |======================================================= 2-Disk RAID0 .. 240.83 |====================================================== 2-Disk RAID1 .. 212.83 |================================================ 4-Disk RAID0 .. 230.27 |=================================================== 4-Disk RAID1 .. 215.78 |================================================ 4-Disk RAID5 .. 197.63 |============================================ 4-Disk RAID6 .. 200.22 |============================================= 4-Disk RAID10 . 234.33 |==================================================== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better Single Disk ... 190.21 |================== 2-Disk RAID0 .. 279.77 |=========================== 2-Disk RAID1 .. 175.60 |================= 4-Disk RAID0 .. 579.90 |======================================================= 4-Disk RAID1 .. 360.84 |================================== 4-Disk RAID5 .. 481.40 |============================================== 4-Disk RAID6 .. 296.65 |============================ 4-Disk RAID10 . 297.67 |============================ FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better Single Disk ... 115.92 |========================== 2-Disk RAID0 .. 223.57 |=================================================== 2-Disk RAID1 .. 99.04 |====================== 4-Disk RAID0 .. 242.57 |======================================================= 4-Disk RAID1 .. 225.93 |=================================================== 4-Disk RAID5 .. 202.13 |============================================== 4-Disk RAID6 .. 126.41 |============================= 4-Disk RAID10 . 201.83 |============================================== BlogBench 1.0 Test: Write Final Score > Higher Is Better Single Disk ... 7469 |================================================== 2-Disk RAID0 .. 8008 |====================================================== 2-Disk RAID1 .. 7378 |================================================= 4-Disk RAID0 .. 8178 |======================================================= 4-Disk RAID1 .. 7892 |===================================================== 4-Disk RAID5 .. 8298 |======================================================= 4-Disk RAID6 .. 8529 |========================================================= 4-Disk RAID10 . 7845 |==================================================== Dbench 4.0 Client Count: 48 MB/s > Higher Is Better Single Disk ... 158.65 |============================================== 2-Disk RAID0 .. 179.15 |==================================================== 2-Disk RAID1 .. 182.29 |===================================================== 4-Disk RAID0 .. 183.05 |====================================================== 4-Disk RAID1 .. 180.72 |===================================================== 4-Disk RAID5 .. 182.19 |===================================================== 4-Disk RAID6 .. 187.97 |======================================================= 4-Disk RAID10 . 178.00 |==================================================== Threaded I/O Tester 20170503 Test: Write - Size Per Thread: 256MB - Thread Count: 16 MB/s > Higher Is Better Single Disk ... 12.58 |======================================================== 2-Disk RAID0 .. 12.68 |======================================================== 2-Disk RAID1 .. 12.33 |====================================================== 4-Disk RAID0 .. 12.31 |====================================================== 4-Disk RAID1 .. 12.06 |===================================================== 4-Disk RAID5 .. 11.74 |==================================================== 4-Disk RAID6 .. 11.45 |=================================================== 4-Disk RAID10 . 12.08 |===================================================== Threaded I/O Tester 20170503 Test: Random Write - Size Per Thread: 256MB - Thread Count: 16 MB/s > Higher Is Better Single Disk ... 771.27 |======================================================= 2-Disk RAID0 .. 756.03 |====================================================== 2-Disk RAID1 .. 723.87 |==================================================== 4-Disk RAID0 .. 731.01 |==================================================== 4-Disk RAID1 .. 726.92 |==================================================== 4-Disk RAID5 .. 675.97 |================================================ 4-Disk RAID6 .. 675.86 |================================================ 4-Disk RAID10 . 702.44 |================================================== Compile Bench 0.6 Test: Compile MB/s > Higher Is Better Single Disk ... 2259.51 |============================================ 2-Disk RAID0 .. 2764.92 |====================================================== 2-Disk RAID1 .. 2559.08 |================================================== 4-Disk RAID0 .. 2648.28 |==================================================== 4-Disk RAID1 .. 2654.19 |==================================================== 4-Disk RAID5 .. 2522.73 |================================================= 4-Disk RAID6 .. 2495.97 |================================================= 4-Disk RAID10 . 2645.82 |==================================================== Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better Single Disk ... 257.30 |======================================== 2-Disk RAID0 .. 294.62 |============================================== 2-Disk RAID1 .. 255.22 |======================================== 4-Disk RAID0 .. 351.99 |======================================================= 4-Disk RAID1 .. 286.20 |============================================= 4-Disk RAID5 .. 342.34 |===================================================== 4-Disk RAID6 .. 324.47 |=================================================== 4-Disk RAID10 . 282.00 |============================================ Timed Linux Kernel Compilation 4.13 Time To Compile Seconds < Lower Is Better Single Disk ... 45.85 |======================================================== 2-Disk RAID0 .. 46.02 |======================================================== 2-Disk RAID1 .. 45.63 |======================================================= 4-Disk RAID0 .. 45.96 |======================================================== 4-Disk RAID1 .. 45.94 |======================================================== 4-Disk RAID5 .. 46.01 |======================================================== 4-Disk RAID6 .. 46.18 |======================================================== 4-Disk RAID10 . 45.99 |======================================================== Timed LLVM Compilation 6.0.1 Time To Compile Seconds < Lower Is Better Single Disk ... 310.01 |==================================================== 2-Disk RAID0 .. 309.48 |==================================================== 2-Disk RAID1 .. 308.62 |==================================================== 4-Disk RAID0 .. 317.85 |====================================================== 4-Disk RAID1 .. 316.11 |===================================================== 4-Disk RAID5 .. 320.22 |====================================================== 4-Disk RAID6 .. 311.54 |===================================================== 4-Disk RAID10 . 326.11 |======================================================= PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write TPS > Higher Is Better Single Disk ... 6439.57 |====================================================== 2-Disk RAID0 .. 6172.69 |==================================================== 2-Disk RAID1 .. 6109.87 |=================================================== 4-Disk RAID0 .. 5750.22 |================================================ 4-Disk RAID1 .. 5695.54 |================================================ 4-Disk RAID5 .. 5080.61 |=========================================== 4-Disk RAID6 .. 5108.94 |=========================================== 4-Disk RAID10 . 5838.73 |=================================================