Samsung 960 EVO Linux RAID Benchmarks

Samsung 960 EVO RAID0 and RAID1 dual drive Btrfs XFS EXT4 F2FS Linux RAID performance benchmarks on 4.16 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1911219-AS-1803273FO69.

Samsung 960 EVO Linux RAID BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid1Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)ASUS PRIME X299-A (1004 BIOS)Intel Sky Lake-E DMI3 Registers4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16256GB INTEL SSDPEKKW256G8 + Samsung SSD 960 EVO 500GBNV136 6144MBRealtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.16.0-999-generic (x86_64) 20180324GNOME Shell 3.28.0X Server 1.19.64.3 Mesa 18.0.0-rc5GCC 7.3.0btrfs3840x2160ext4f2fsxfs256GB INTEL SSDPEKKW256G8 + 2 x Samsung SSD 960 EVO 500GBbtrfsext4f2fsxfsbtrfsext4f2fsxfsIntel Core i9-9900X @ 4.50GHz (10 Cores / 20 Threads)ASUS WS X299 PRO_SE (1201 BIOS)4 x 16384 MB DDR4-3200MT/s Corsair CMK32GX4M2D3200C162 x 1000GB Samsung SSD 970 EVO Plus 1TB + 31GB UltraASPEEDL1970HQ2 x Intel I210CloudLinux 7.73.10.0-962.3.2.lve1.5.26.7.el7.x86_64 (x86_64)GCC 4.8.5 201506231280x10241000GB Samsung SSD 970 EVO Plus 1TBVS2481920x1080OpenBenchmarking.orgCompiler Details- Single: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Raid1 XFS STOM: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic- XFS STOM - Degraded Raid1: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=genericDisk Details- Single: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Single: EXT4: NONE / data=ordered,relatime,rw- Single: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Single: XFS: NONE / attr2,inode64,noquota,relatime,rw- RAID0: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- RAID0: EXT4: NONE / data=ordered,relatime,rw,stripe=256 / raid0 nvme2n1[1] nvme1n1[0]- RAID0: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 nvme2n1[1] nvme1n1[0]- RAID0: XFS: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid0 nvme2n1[1] nvme1n1[0]- RAID1: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- RAID1: EXT4: NONE / data=ordered,relatime,rw / raid1 nvme2n1[1] nvme1n1[0]- RAID1: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 nvme1n1[1] nvme2n1[0]- RAID1: XFS: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme1n1[0] nvme2n1[1]- Raid1 XFS STOM: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme0n1p4[0] nvme1n1p4[1]- XFS STOM - Degraded Raid1: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme0n1p4[1]Processor Details- Single: Btrfs: Scaling Governor: intel_pstate powersave- Single: EXT4: Scaling Governor: intel_pstate powersave- Single: F2FS: Scaling Governor: intel_pstate powersave- Single: XFS: Scaling Governor: intel_pstate powersave- RAID0: Btrfs: Scaling Governor: intel_pstate powersave- RAID0: EXT4: Scaling Governor: intel_pstate powersave- RAID0: F2FS: Scaling Governor: intel_pstate powersave- RAID0: XFS: Scaling Governor: intel_pstate powersave- RAID1: Btrfs: Scaling Governor: intel_pstate powersave- RAID1: EXT4: Scaling Governor: intel_pstate powersave- RAID1: F2FS: Scaling Governor: intel_pstate powersave- RAID1: XFS: Scaling Governor: intel_pstate powersave- Raid1 XFS STOM: Scaling Governor: intel_pstate performance- XFS STOM - Degraded Raid1: Scaling Governor: intel_pstate performancePython Details- Single: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- Single: EXT4: Python 2.7.14+ + Python 3.6.5rc1- Single: F2FS: Python 2.7.14+ + Python 3.6.5rc1- Single: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID0: EXT4: Python 2.7.14+ + Python 3.6.5rc1- RAID0: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID1: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID1: EXT4: Python 2.7.14+ + Python 3.6.5rc1- RAID1: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID1: XFS: Python 2.7.14+ + Python 3.6.5rc1- Raid1 XFS STOM: Python 2.7.5 + Python 3.6.8- XFS STOM - Degraded Raid1: Python 2.7.5 + Python 3.6.8Security Details- Single: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- Raid1 XFS STOM: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: Retpoline on Skylake+ IBPB- XFS STOM - Degraded Raid1: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: Retpoline on Skylake+ IBPB

Samsung 960 EVO Linux RAID Benchmarkssqlite: Timed SQLite Insertionsfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writedbench: 12iozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performancecompilebench: Compilecompilebench: Initial Createunpack-linux: linux-4.15.tar.xzcompress-gzip: Linux Source Tree Archiving To .tar.gzpgbench: Mostly RAM - Normal Load - Read Onlypgbench: Mostly RAM - Normal Load - Read Writeosbench: Create FilesSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid1111.581146505942631160.83222.05139.905401310.90729.25737.611753.94285.695.7434.97108580.714303.4527.1145.111171158627231826173.57229.80104.0027330353.52678.26670.161205.48638.185.2034.96112451.345280.7312.6543.241146155229091763295.53258.47179.757444136.23595.87388.041309.50641.505.5934.42112571.023457.0620.4244.051152156428721780184.90208.80104.436292333.76862.94860.451399.49520.236.0434.5493888.755526.9635.54110.452159155121761581164.90446.53110.525337340.842179.581872.373011.17328.095.7033.99201194.533533.8527.1950.902747336957453642177.67356.27122.9848714374.021358.801311.082159.13660.815.3734.91207376.846254.5612.5443.282319334923213598326.50416.85220.928643139.931354.881256.902455.17706.095.6233.61206821.755967.5121.1045.142402336951803643195.50426.57191.872862281.472369.792360.192973.84543.816.6433.75218391.416555.0744.03113.2511277271105712164.97247.07108.525380471.801625.991568.282007.22268.375.7135.24204955.625184.9527.83165.9216986052802612116.02143.3346.8214078299.23290.98535.621036.53627.875.4535.87209072.693409.4212.7047.552357157645461822282.70272.98164.038307123.79563.51336.531265.95494.115.7234.38216444.713039.7921.0947.522305157045481821173.73214.2299.775316143.931085.611499.261815.14518.786.4934.26226603.675436.9949.3133.6831421491314214907693483.621047.53989.032573.78362.375.8937.96158021.553156.5832.6731372952312029536205480.681394.161288.902541.85362.216.0037.93114386.683844.21OpenBenchmarking.org

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid14080120160200SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.77, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3111.5845.1143.2444.05110.4550.9043.2845.14113.25165.9247.5547.5233.6832.671. (CC) gcc options: -O2 -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid17001400210028003500SE +/- 0.33, N = 3SE +/- 291.88, N = 6SE +/- 2.31, N = 3SE +/- 10.87, N = 3SE +/- 1.33, N = 3SE +/- 0.88, N = 3114611711146115221592747231924021127169823572305314231371. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid17001400210028003500SE +/- 59.31, N = 6SE +/- 3.71, N = 3SE +/- 0.88, N = 3SE +/- 4.04, N = 3SE +/- 178.74, N = 6SE +/- 1.45, N = 3SE +/- 0.88, N = 3SE +/- 2.08, N = 3SE +/- 88.05, N = 6SE +/- 1.15, N = 3SE +/- 3.53, N = 3SE +/- 1.67, N = 3SE +/- 0.33, N = 3505158615521564155133693349336972760515761570149129521. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid112002400360048006000SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 1.76, N = 3SE +/- 0.33, N = 3SE +/- 7.69, N = 3SE +/- 5.36, N = 394227232909287221765745232151801105280245464548314231201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid18001600240032004000SE +/- 7.51, N = 3SE +/- 0.58, N = 3SE +/- 1.86, N = 3SE +/- 1.20, N = 3SE +/- 226.33, N = 6SE +/- 3.06, N = 3SE +/- 2.91, N = 3SE +/- 1.20, N = 3SE +/- 93.04, N = 6SE +/- 5.17, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3631182617631780158136423598364371261218221821149029531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FSXFS70140210280350SE +/- 0.52, N = 3SE +/- 1.62, N = 3SE +/- 0.53, N = 3SE +/- 0.38, N = 3SE +/- 2.30, N = 3SE +/- 1.59, N = 3SE +/- 1.77, N = 3SE +/- 1.25, N = 3SE +/- 0.19, N = 3SE +/- 15.94, N = 6SE +/- 0.95, N = 3SE +/- 0.63, N = 3160.83173.57295.53184.90164.90177.67326.50195.50164.97116.02282.70173.731. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FSXFS100200300400500SE +/- 13.06, N = 6SE +/- 22.41, N = 6SE +/- 17.62, N = 6SE +/- 8.47, N = 6SE +/- 62.72, N = 6SE +/- 64.94, N = 6SE +/- 84.68, N = 6SE +/- 3.54, N = 3SE +/- 35.15, N = 6SE +/- 1.75, N = 3SE +/- 57.28, N = 6SE +/- 27.22, N = 6222.05229.80258.47208.80446.53356.27416.85426.57247.07143.33272.98214.221. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FSXFS50100150200250SE +/- 6.90, N = 6SE +/- 8.87, N = 6SE +/- 16.19, N = 6SE +/- 7.34, N = 6SE +/- 11.85, N = 6SE +/- 12.91, N = 6SE +/- 28.10, N = 6SE +/- 0.54, N = 3SE +/- 8.51, N = 6SE +/- 6.58, N = 6SE +/- 15.78, N = 6SE +/- 7.22, N = 6139.90104.00179.75104.43110.52122.98220.92191.87108.5246.82164.0399.771. (CC) gcc options: -static

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid110K20K30K40K50KSE +/- 12.41, N = 3SE +/- 1288.79, N = 6SE +/- 709.05, N = 6SE +/- 31.78, N = 3SE +/- 37.47, N = 3SE +/- 262.80, N = 3SE +/- 133.68, N = 4SE +/- 306.61, N = 6SE +/- 46.46, N = 3SE +/- 184.39, N = 3SE +/- 690.66, N = 6SE +/- 90.65, N = 3SE +/- 61.41, N = 3SE +/- 66.27, N = 7540127330744462925337487148643286253801407883075316769362051. (CC) gcc options: -O2 -pthread

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12Single: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid1100200300400500SE +/- 2.88, N = 3SE +/- 3.12, N = 3SE +/- 0.74, N = 3SE +/- 21.09, N = 6SE +/- 1.94, N = 3SE +/- 3.95, N = 3SE +/- 0.09, N = 3SE +/- 13.23, N = 6SE +/- 1.17, N = 3SE +/- 1.44, N = 3SE +/- 1.17, N = 3SE +/- 4.17, N = 6SE +/- 9.36, N = 9SE +/- 5.23, N = 9310.90353.52136.23333.76340.84374.02139.93281.47471.80299.23123.79143.93483.62480.681. (CC) gcc options: -lpopt -O2

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid15001000150020002500SE +/- 33.51, N = 6SE +/- 42.34, N = 6SE +/- 44.79, N = 6SE +/- 8.56, N = 3SE +/- 391.13, N = 6SE +/- 137.83, N = 6SE +/- 177.96, N = 6SE +/- 192.93, N = 6SE +/- 14.72, N = 3SE +/- 68.00, N = 6SE +/- 66.37, N = 6SE +/- 214.99, N = 6SE +/- 14.08, N = 4SE +/- 32.86, N = 15729.25678.26595.87862.942179.581358.801354.882369.791625.99290.98563.511085.611047.531394.161. (CC) gcc options: -O3

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid15001000150020002500SE +/- 44.62, N = 6SE +/- 41.99, N = 6SE +/- 75.22, N = 6SE +/- 4.43, N = 3SE +/- 5.51, N = 3SE +/- 101.51, N = 6SE +/- 87.51, N = 6SE +/- 36.42, N = 3SE +/- 8.75, N = 3SE +/- 23.19, N = 6SE +/- 52.07, N = 6SE +/- 15.99, N = 3SE +/- 4.84, N = 3SE +/- 9.83, N = 3737.61670.16388.04860.451872.371311.081256.902360.191568.28535.62336.531499.26989.031288.901. (CC) gcc options: -O3

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid16001200180024003000SE +/- 55.85, N = 6SE +/- 57.92, N = 6SE +/- 16.67, N = 3SE +/- 50.02, N = 6SE +/- 44.00, N = 3SE +/- 61.58, N = 6SE +/- 210.26, N = 6SE +/- 95.92, N = 6SE +/- 134.93, N = 6SE +/- 70.69, N = 6SE +/- 16.55, N = 3SE +/- 120.63, N = 6SE +/- 39.42, N = 3SE +/- 27.07, N = 31753.941205.481309.501399.493011.172159.132455.172973.842007.221036.531265.951815.142573.782541.85

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid1150300450600750SE +/- 7.15, N = 3SE +/- 9.29, N = 3SE +/- 35.40, N = 3SE +/- 4.60, N = 3SE +/- 10.30, N = 3SE +/- 3.32, N = 3SE +/- 4.53, N = 3SE +/- 2.83, N = 3SE +/- 1.71, N = 3SE +/- 8.70, N = 3SE +/- 20.47, N = 3SE +/- 1.88, N = 3SE +/- 5.71, N = 3SE +/- 0.38, N = 3285.69638.18641.50520.23328.09660.81706.09543.81268.37627.87494.11518.78362.37362.21

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid1246810SE +/- 0.03, N = 4SE +/- 0.01, N = 4SE +/- 0.04, N = 4SE +/- 0.15, N = 8SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.15, N = 8SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.16, N = 8SE +/- 0.05, N = 4SE +/- 0.09, N = 45.745.205.596.045.705.375.626.645.715.455.726.495.896.00

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid1918273645SE +/- 0.47, N = 3SE +/- 0.09, N = 3SE +/- 0.50, N = 5SE +/- 0.12, N = 3SE +/- 0.47, N = 6SE +/- 0.12, N = 3SE +/- 0.41, N = 3SE +/- 0.53, N = 3SE +/- 0.58, N = 4SE +/- 0.54, N = 3SE +/- 0.53, N = 4SE +/- 0.51, N = 4SE +/- 0.02, N = 3SE +/- 0.08, N = 334.9734.9634.4234.5433.9934.9133.6133.7535.2435.8734.3834.2637.9637.93

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read OnlySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid150K100K150K200K250KSE +/- 62.04, N = 3SE +/- 133.14, N = 3SE +/- 257.54, N = 3108580.71112451.34112571.0293888.75201194.53207376.84206821.75218391.41204955.62209072.69216444.71226603.67158021.55114386.681. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSRaid1 XFS STOMXFS STOM - Degraded Raid114002800420056007000SE +/- 95.10, N = 4SE +/- 74.54, N = 9SE +/- 49.69, N = 94303.455280.733457.065526.963533.856254.565967.516555.075184.953409.423039.795436.993156.583844.211. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

OSBench

Test: Create Files

SingleRAID0RAID1OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesBtrfsEXT4F2FSXFS1122334455SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 1.45, N = 6SE +/- 2.58, N = 6SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 1.52, N = 6SE +/- 4.57, N = 6SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 1.55, N = 6SE +/- 5.88, N = 627.1112.6520.4235.5427.1912.5421.1044.0327.8312.7021.0949.311. (CC) gcc options:


Phoronix Test Suite v10.8.4