Intel Optane 900p RAID Linux File-System Benchmarks Intel Optane 900p benchmarks with various file-systems on Ubuntu Linux and RAID arrays. Benchmarks by Michael Larabel for a future article.. EXT4 Samsung 970 EVO 500GB: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: ext4, Screen Resolution: 3840x2160 EXT4 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: ext4, Screen Resolution: 3840x2160 XFS 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: xfs, Screen Resolution: 3840x2160 Btrfs 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: btrfs, Screen Resolution: 3840x2160 F2FS 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: f2fs, Screen Resolution: 3840x2160 EXT4 RAID0 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: ext4, Screen Resolution: 3840x2160 XFS RAID0 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: Samsung SSD 970 EVO 500GB + 2 x 280GB INTEL SSDPED1D280GA, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: xfs, Screen Resolution: 3840x2160 F2FS RAID0 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: f2fs, Screen Resolution: 3840x2160 EXT4 RAID1 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: ext4, Screen Resolution: 3840x2160 XFS RAID1 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: xfs, Screen Resolution: 3840x2160 F2FS RAID1 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: f2fs, Screen Resolution: 3840x2160 Btrfs RAID0 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: btrfs, Screen Resolution: 3840x2160 Btrfs RAID1 Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: btrfs, Screen Resolution: 3840x2160 ZFS 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: Samsung SSD 970 EVO 500GB + 2 x 280GB INTEL SSDPED1D280GA, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: zfs, Screen Resolution: 3840x2160 ZFS RAIDZ Dual 900p: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1701 BIOS), Chipset: AMD 17h, Memory: 4 x 8192 MB DDR4-3200MT/s F4-3200C14-8GFX, Disk: 2 x 280GB INTEL SSDPED1D280GA + Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 19.04, Kernel: 5.2.0-999-generic (x86_64) 20190605, Desktop: GNOME Shell 3.32.0, Display Server: X Server, OpenGL: 4.5 Mesa 19.0.2 (LLVM 8.0.0), Compiler: GCC 8.3.0, File-System: zfs, Screen Resolution: 3840x2160 Application Start-up Time 3.4.0 Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test Directory sec < Lower Is Better EXT4 Samsung 970 EVO 500GB . 0.53 |=================================== EXT4 900p .................. 0.52 |================================== XFS 900p ................... 0.53 |=================================== Btrfs 900p ................. 0.67 |============================================ F2FS 900p .................. 0.36 |======================== EXT4 RAID0 Dual 900p ....... 0.46 |============================== XFS RAID0 Dual 900p ........ 0.46 |============================== F2FS RAID0 Dual 900p ....... 0.28 |================== EXT4 RAID1 Dual 900p ....... 0.21 |============== XFS RAID1 Dual 900p ........ 0.21 |============== F2FS RAID1 Dual 900p ....... 0.21 |============== Btrfs RAID0 Dual 900p ...... 0.31 |==================== Btrfs RAID1 Dual 900p ...... 0.30 |==================== ZFS 900p ................... 0.15 |========== ZFS RAIDZ Dual 900p ........ 0.14 |========= Application Start-up Time 3.4.0 Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test Directory sec < Lower Is Better EXT4 Samsung 970 EVO 500GB . 1.00 |============================================ EXT4 900p .................. 0.64 |============================ XFS 900p ................... 0.72 |================================ Btrfs 900p ................. 0.38 |================= F2FS 900p .................. 0.40 |================== EXT4 RAID0 Dual 900p ....... 0.48 |===================== XFS RAID0 Dual 900p ........ 0.65 |============================= F2FS RAID0 Dual 900p ....... 0.29 |============= EXT4 RAID1 Dual 900p ....... 0.59 |========================== XFS RAID1 Dual 900p ........ 0.43 |=================== F2FS RAID1 Dual 900p ....... 0.26 |=========== Btrfs RAID0 Dual 900p ...... 0.37 |================ Btrfs RAID1 Dual 900p ...... 0.30 |============= ZFS 900p ................... 0.20 |========= ZFS RAIDZ Dual 900p ........ 0.17 |======= Application Start-up Time 3.4.0 Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test Directory sec < Lower Is Better EXT4 Samsung 970 EVO 500GB . 2.14 |========================================== EXT4 900p .................. 1.99 |======================================= XFS 900p ................... 2.00 |======================================= Btrfs 900p ................. 1.44 |============================ F2FS 900p .................. 1.03 |==================== EXT4 RAID0 Dual 900p ....... 1.94 |====================================== XFS RAID0 Dual 900p ........ 2.23 |============================================ F2FS RAID0 Dual 900p ....... 1.06 |===================== EXT4 RAID1 Dual 900p ....... 0.71 |============== XFS RAID1 Dual 900p ........ 0.71 |============== F2FS RAID1 Dual 900p ....... 0.53 |========== Btrfs RAID0 Dual 900p ...... 0.96 |=================== Btrfs RAID1 Dual 900p ...... 0.82 |================ ZFS 900p ................... 0.32 |====== ZFS RAIDZ Dual 900p ........ 0.26 |===== Application Start-up Time 3.4.0 Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory sec < Lower Is Better EXT4 Samsung 970 EVO 500GB . 1.78 |============================================ EXT4 900p .................. 1.35 |================================= XFS 900p ................... 1.34 |================================= Btrfs 900p ................. 0.66 |================ F2FS 900p .................. 0.72 |================== EXT4 RAID0 Dual 900p ....... 1.33 |================================= XFS RAID0 Dual 900p ........ 1.21 |============================== F2FS RAID0 Dual 900p ....... 0.60 |=============== EXT4 RAID1 Dual 900p ....... 0.60 |=============== XFS RAID1 Dual 900p ........ 0.60 |=============== F2FS RAID1 Dual 900p ....... 0.41 |========== Btrfs RAID0 Dual 900p ...... 0.64 |================ Btrfs RAID1 Dual 900p ...... 0.53 |============= ZFS 900p ................... 0.26 |====== ZFS RAIDZ Dual 900p ........ 0.22 |===== Application Start-up Time 3.4.0 Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test Directory sec < Lower Is Better EXT4 Samsung 970 EVO 500GB . 4.32 |============================================ EXT4 900p .................. 3.10 |================================ XFS 900p ................... 2.97 |============================== Btrfs 900p ................. 1.07 |=========== F2FS 900p .................. 1.04 |=========== EXT4 RAID0 Dual 900p ....... 2.13 |====================== XFS RAID0 Dual 900p ........ 2.25 |======================= F2FS RAID0 Dual 900p ....... 0.72 |======= EXT4 RAID1 Dual 900p ....... 2.06 |===================== XFS RAID1 Dual 900p ........ 1.59 |================ F2FS RAID1 Dual 900p ....... 0.48 |===== Btrfs RAID0 Dual 900p ...... 1.03 |========== Btrfs RAID1 Dual 900p ...... 0.80 |======== ZFS 900p ................... 0.34 |=== ZFS RAIDZ Dual 900p ........ 0.29 |=== Application Start-up Time 3.4.0 Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory sec < Lower Is Better EXT4 Samsung 970 EVO 500GB . 3.12 |============================================ EXT4 900p .................. 1.68 |======================== XFS 900p ................... 1.71 |======================== Btrfs 900p ................. 0.66 |========= F2FS 900p .................. 0.68 |========== EXT4 RAID0 Dual 900p ....... 1.42 |==================== XFS RAID0 Dual 900p ........ 1.42 |==================== F2FS RAID0 Dual 900p ....... 0.55 |======== EXT4 RAID1 Dual 900p ....... 1.49 |===================== XFS RAID1 Dual 900p ........ 1.18 |================= F2FS RAID1 Dual 900p ....... 0.47 |======= Btrfs RAID0 Dual 900p ...... 0.72 |========== Btrfs RAID1 Dual 900p ...... 0.54 |======== ZFS 900p ................... 0.33 |===== ZFS RAIDZ Dual 900p ........ 0.22 |=== Compile Bench 0.6 Test: Compile MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 1689.00 |========================= EXT4 900p .................. 1972.00 |============================= XFS 900p ................... 2683.00 |======================================== Btrfs 900p ................. 2534.00 |====================================== F2FS 900p .................. 2466.00 |===================================== EXT4 RAID0 Dual 900p ....... 2009.00 |============================== XFS RAID0 Dual 900p ........ 2757.00 |========================================= F2FS RAID0 Dual 900p ....... 2573.00 |====================================== EXT4 RAID1 Dual 900p ....... 1978.00 |============================= XFS RAID1 Dual 900p ........ 2741.00 |========================================= F2FS RAID1 Dual 900p ....... 2226.00 |================================= Btrfs RAID0 Dual 900p ...... 2434.00 |==================================== Btrfs RAID1 Dual 900p ...... 2427.32 |==================================== ZFS 900p ................... 1420.74 |===================== ZFS RAIDZ Dual 900p ........ 1322.00 |==================== Compile Bench 0.6 Test: Read Compiled Tree MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 1385.00 |================================= EXT4 900p .................. 1580.00 |====================================== XFS 900p ................... 1504.00 |==================================== Btrfs 900p ................. 1404.00 |================================== F2FS 900p .................. 1692.00 |======================================== EXT4 RAID0 Dual 900p ....... 1540.00 |===================================== XFS RAID0 Dual 900p ........ 1523.00 |==================================== F2FS RAID0 Dual 900p ....... 1713.00 |========================================= EXT4 RAID1 Dual 900p ....... 1580.00 |====================================== XFS RAID1 Dual 900p ........ 1479.00 |=================================== F2FS RAID1 Dual 900p ....... 1675.00 |======================================== Btrfs RAID0 Dual 900p ...... 1485.00 |==================================== Btrfs RAID1 Dual 900p ...... 1451.73 |=================================== ZFS 900p ................... 678.86 |================ ZFS RAIDZ Dual 900p ........ 669.59 |================ Dbench 4.0 Client Count: 12 MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 314.00 |== EXT4 900p .................. 4409.00 |=========================== XFS 900p ................... 5906.00 |==================================== Btrfs 900p ................. 1870.00 |=========== F2FS 900p .................. 6818.00 |========================================= EXT4 RAID0 Dual 900p ....... 4357.00 |========================== XFS RAID0 Dual 900p ........ 6020.00 |==================================== F2FS RAID0 Dual 900p ....... 6691.00 |======================================== EXT4 RAID1 Dual 900p ....... 3972.00 |======================== XFS RAID1 Dual 900p ........ 5562.00 |================================= F2FS RAID1 Dual 900p ....... 6570.00 |======================================== Btrfs RAID0 Dual 900p ...... 2240.00 |============= Btrfs RAID1 Dual 900p ...... 1380.25 |======== ZFS 900p ................... 600.70 |==== ZFS RAIDZ Dual 900p ........ 607.66 |==== Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 3365 |============================ EXT4 900p .................. 2613 |====================== XFS 900p ................... 2613 |====================== Btrfs 900p ................. 2610 |====================== F2FS 900p .................. 2613 |====================== EXT4 RAID0 Dual 900p ....... 5208 |============================================ XFS RAID0 Dual 900p ........ 5210 |============================================ F2FS RAID0 Dual 900p ....... 5176 |============================================ EXT4 RAID1 Dual 900p ....... 5218 |============================================ XFS RAID1 Dual 900p ........ 5218 |============================================ F2FS RAID1 Dual 900p ....... 5220 |============================================ Btrfs RAID0 Dual 900p ...... 5176 |============================================ Btrfs RAID1 Dual 900p ...... 2610 |====================== ZFS 900p ................... 4404 |===================================== ZFS RAIDZ Dual 900p ........ 4593 |======================================= Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 751 |============================== EXT4 900p .................. 1106 |============================================ XFS 900p ................... 1050 |========================================== Btrfs 900p ................. 557 |====================== F2FS 900p .................. 1063 |========================================== EXT4 RAID0 Dual 900p ....... 1052 |========================================== XFS RAID0 Dual 900p ........ 1028 |========================================= F2FS RAID0 Dual 900p ....... 1007 |======================================== EXT4 RAID1 Dual 900p ....... 953 |====================================== XFS RAID1 Dual 900p ........ 944 |====================================== F2FS RAID1 Dual 900p ....... 924 |===================================== Btrfs RAID0 Dual 900p ...... 542 |====================== Btrfs RAID1 Dual 900p ...... 540 |===================== ZFS 900p ................... 234 |========= ZFS RAIDZ Dual 900p ........ 205 |======== Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better EXT4 Samsung 970 EVO 500GB . 192333 |============================= EXT4 900p .................. 283000 |========================================== XFS 900p ................... 269000 |======================================== Btrfs 900p ................. 142533 |===================== F2FS 900p .................. 272000 |======================================== EXT4 RAID0 Dual 900p ....... 269400 |======================================== XFS RAID0 Dual 900p ........ 263000 |======================================= F2FS RAID0 Dual 900p ....... 257667 |====================================== EXT4 RAID1 Dual 900p ....... 243867 |==================================== XFS RAID1 Dual 900p ........ 241667 |==================================== F2FS RAID1 Dual 900p ....... 236333 |=================================== Btrfs RAID0 Dual 900p ...... 138636 |===================== Btrfs RAID1 Dual 900p ...... 138333 |===================== ZFS 900p ................... 59733 |========= ZFS RAIDZ Dual 900p ........ 52467 |======== Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 2369 |======================== EXT4 900p .................. 2159 |====================== XFS 900p ................... 2161 |====================== Btrfs 900p ................. 2145 |====================== F2FS 900p .................. 2160 |====================== EXT4 RAID0 Dual 900p ....... 4319 |============================================ XFS RAID0 Dual 900p ........ 4317 |============================================ F2FS RAID0 Dual 900p ....... 4322 |============================================ EXT4 RAID1 Dual 900p ....... 2163 |====================== XFS RAID1 Dual 900p ........ 2164 |====================== F2FS RAID1 Dual 900p ....... 2163 |====================== Btrfs RAID0 Dual 900p ...... 4259 |=========================================== Btrfs RAID1 Dual 900p ...... 2120 |====================== ZFS 900p ................... 3963 |======================================== ZFS RAIDZ Dual 900p ........ 1649 |================= Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 1030 |========= EXT4 900p .................. 2615 |====================== XFS 900p ................... 2614 |====================== Btrfs 900p ................. 2610 |====================== F2FS 900p .................. 2614 |====================== EXT4 RAID0 Dual 900p ....... 5219 |============================================ XFS RAID0 Dual 900p ........ 5224 |============================================ F2FS RAID0 Dual 900p ....... 5172 |============================================ EXT4 RAID1 Dual 900p ....... 2975 |========================= XFS RAID1 Dual 900p ........ 5221 |============================================ F2FS RAID1 Dual 900p ....... 5226 |============================================ Btrfs RAID0 Dual 900p ...... 5206 |============================================ Btrfs RAID1 Dual 900p ...... 2610 |====================== ZFS 900p ................... 4420 |===================================== ZFS RAIDZ Dual 900p ........ 4435 |===================================== Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 955 |=================================== EXT4 900p .................. 1135 |========================================== XFS 900p ................... 1155 |=========================================== Btrfs 900p ................. 572 |===================== F2FS 900p .................. 1192 |============================================ EXT4 RAID0 Dual 900p ....... 1072 |======================================== XFS RAID0 Dual 900p ........ 1055 |======================================= F2FS RAID0 Dual 900p ....... 1033 |====================================== EXT4 RAID1 Dual 900p ....... 992 |===================================== XFS RAID1 Dual 900p ........ 1008 |===================================== F2FS RAID1 Dual 900p ....... 983 |==================================== Btrfs RAID0 Dual 900p ...... 558 |===================== Btrfs RAID1 Dual 900p ...... 560 |===================== ZFS 900p ................... 1184 |============================================ ZFS RAIDZ Dual 900p ........ 1168 |=========================================== Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better EXT4 Samsung 970 EVO 500GB . 244667 |================================== EXT4 900p .................. 290333 |======================================== XFS 900p ................... 295867 |========================================= Btrfs 900p ................. 146333 |==================== F2FS 900p .................. 304933 |========================================== EXT4 RAID0 Dual 900p ....... 274000 |====================================== XFS RAID0 Dual 900p ........ 270000 |===================================== F2FS RAID0 Dual 900p ....... 264667 |==================================== EXT4 RAID1 Dual 900p ....... 254333 |=================================== XFS RAID1 Dual 900p ........ 258000 |==================================== F2FS RAID1 Dual 900p ....... 251615 |=================================== Btrfs RAID0 Dual 900p ...... 143000 |==================== Btrfs RAID1 Dual 900p ...... 143333 |==================== ZFS 900p ................... 303333 |========================================== ZFS RAIDZ Dual 900p ........ 299333 |========================================= Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 2397 |======================== EXT4 900p .................. 2159 |====================== XFS 900p ................... 2162 |====================== Btrfs 900p ................. 2171 |====================== F2FS 900p .................. 2161 |====================== EXT4 RAID0 Dual 900p ....... 4318 |============================================ XFS RAID0 Dual 900p ........ 4318 |============================================ F2FS RAID0 Dual 900p ....... 4324 |============================================ EXT4 RAID1 Dual 900p ....... 2163 |====================== XFS RAID1 Dual 900p ........ 2164 |====================== F2FS RAID1 Dual 900p ....... 2162 |====================== Btrfs RAID0 Dual 900p ...... 4310 |============================================ Btrfs RAID1 Dual 900p ...... 2156 |====================== ZFS 900p ................... 3802 |======================================= ZFS RAIDZ Dual 900p ........ 1347 |============== FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 236.00 |========= EXT4 900p .................. 698.00 |============================ XFS 900p ................... 881.00 |=================================== Btrfs 900p ................. 744.00 |============================== F2FS 900p .................. 790.00 |=============================== EXT4 RAID0 Dual 900p ....... 819.00 |================================ XFS RAID0 Dual 900p ........ 948.00 |====================================== F2FS RAID0 Dual 900p ....... 1034.00 |========================================= EXT4 RAID1 Dual 900p ....... 628.00 |========================= XFS RAID1 Dual 900p ........ 849.00 |================================== F2FS RAID1 Dual 900p ....... 742.00 |============================= Btrfs RAID0 Dual 900p ...... 932.00 |===================================== Btrfs RAID1 Dual 900p ...... 809.37 |================================ ZFS 900p ................... 630.27 |========================= ZFS RAIDZ Dual 900p ........ 498.51 |==================== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 265.00 |===== XFS 900p ................... 1515.00 |========================== Btrfs 900p ................. 1449.00 |========================= F2FS 900p .................. 1390.00 |======================== EXT4 RAID0 Dual 900p ....... 1628.00 |============================ XFS RAID0 Dual 900p ........ 2403.00 |========================================= F2FS RAID0 Dual 900p ....... 1789.00 |=============================== EXT4 RAID1 Dual 900p ....... 1198.00 |==================== XFS RAID1 Dual 900p ........ 1408.00 |======================== F2FS RAID1 Dual 900p ....... 1001.00 |================= Btrfs RAID0 Dual 900p ...... 2241.00 |====================================== Btrfs RAID1 Dual 900p ...... 1541.43 |========================== ZFS 900p ................... 865.30 |=============== ZFS RAIDZ Dual 900p ........ 736.53 |============= FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better EXT4 Samsung 970 EVO 500GB . 136.00 |====== EXT4 900p .................. 698.00 |============================ XFS 900p ................... 886.00 |==================================== Btrfs 900p ................. 661.00 |=========================== F2FS 900p .................. 822.00 |================================== EXT4 RAID0 Dual 900p ....... 860.00 |=================================== XFS RAID0 Dual 900p ........ 958.00 |======================================= F2FS RAID0 Dual 900p ....... 1005.00 |========================================= EXT4 RAID1 Dual 900p ....... 673.00 |=========================== XFS RAID1 Dual 900p ........ 855.00 |=================================== F2FS RAID1 Dual 900p ....... 733.00 |============================== Btrfs RAID0 Dual 900p ...... 839.00 |================================== Btrfs RAID1 Dual 900p ...... 745.30 |============================== ZFS 900p ................... 595.93 |======================== ZFS RAIDZ Dual 900p ........ 482.13 |==================== PostgreSQL pgbench 10.3 Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only TPS > Higher Is Better EXT4 Samsung 970 EVO 500GB . 114035.00 |============= EXT4 900p .................. 254428.00 |============================= XFS 900p ................... 257480.00 |============================= Btrfs 900p ................. 215389.00 |======================== F2FS 900p .................. 240253.00 |=========================== EXT4 RAID0 Dual 900p ....... 338263.00 |====================================== XFS RAID0 Dual 900p ........ 345281.00 |======================================= F2FS RAID0 Dual 900p ....... 340825.00 |====================================== EXT4 RAID1 Dual 900p ....... 336115.00 |====================================== XFS RAID1 Dual 900p ........ 338486.00 |====================================== F2FS RAID1 Dual 900p ....... 315833.00 |==================================== Btrfs RAID0 Dual 900p ...... 235722.00 |=========================== Btrfs RAID1 Dual 900p ...... 235903.91 |=========================== ZFS 900p ................... 9529.10 |= ZFS RAIDZ Dual 900p ........ 15472.39 |== PostgreSQL pgbench 10.3 Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write TPS > Higher Is Better EXT4 Samsung 970 EVO 500GB . 5114.00 |====== EXT4 900p .................. 28983.00 |=================================== XFS 900p ................... 31481.00 |====================================== Btrfs 900p ................. 9686.00 |============ F2FS 900p .................. 20938.00 |========================= EXT4 RAID0 Dual 900p ....... 32193.00 |====================================== XFS RAID0 Dual 900p ........ 33546.00 |======================================== F2FS RAID0 Dual 900p ....... 21284.00 |========================= EXT4 RAID1 Dual 900p ....... 25976.00 |=============================== XFS RAID1 Dual 900p ........ 27146.00 |================================ F2FS RAID1 Dual 900p ....... 18367.00 |====================== Btrfs RAID0 Dual 900p ...... 9816.00 |============ Btrfs RAID1 Dual 900p ...... 9760.41 |============ ZFS 900p ................... 3491.09 |==== ZFS RAIDZ Dual 900p ........ 4171.43 |===== PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write TPS > Higher Is Better EXT4 Samsung 970 EVO 500GB . 5262.00 |===== EXT4 900p .................. 44923.00 |====================================== XFS 900p ................... 43293.00 |===================================== Btrfs 900p ................. 20088.00 |================= F2FS 900p .................. 41657.00 |==================================== EXT4 RAID0 Dual 900p ....... 46700.00 |======================================== XFS RAID0 Dual 900p ........ 45375.00 |======================================= F2FS RAID0 Dual 900p ....... 42485.00 |==================================== EXT4 RAID1 Dual 900p ....... 41769.00 |==================================== XFS RAID1 Dual 900p ........ 40063.00 |================================== F2FS RAID1 Dual 900p ....... 37059.00 |================================ Btrfs RAID0 Dual 900p ...... 20621.00 |================== Btrfs RAID1 Dual 900p ...... 19777.76 |================= ZFS 900p ................... 19394.73 |================= ZFS RAIDZ Dual 900p ........ 17949.98 |=============== SQLite 3.22 Timed SQLite Insertions Seconds < Lower Is Better EXT4 Samsung 970 EVO 500GB . 35.67 |=========================================== EXT4 900p .................. 2.06 |== Btrfs 900p ................. 6.69 |======== F2FS 900p .................. 2.02 |== EXT4 RAID0 Dual 900p ....... 2.25 |=== F2FS RAID0 Dual 900p ....... 2.15 |=== EXT4 RAID1 Dual 900p ....... 2.54 |=== XFS RAID1 Dual 900p ........ 2.28 |=== F2FS RAID1 Dual 900p ....... 2.79 |=== Btrfs RAID0 Dual 900p ...... 6.73 |======== Btrfs RAID1 Dual 900p ...... 7.09 |========= ZFS 900p ................... 5.64 |======= ZFS RAIDZ Dual 900p ........ 5.92 |=======