Samsung 960 EVO Linux RAID Benchmarks

Samsung 960 EVO RAID0 and RAID1 dual drive Btrfs XFS EXT4 F2FS Linux RAID performance benchmarks on 4.16 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1811282-RA-1803273FO45.

Samsung 960 EVO Linux RAID BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionSystem LayerSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bbIntel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)ASUS PRIME X299-A (1004 BIOS)Intel Sky Lake-E DMI3 Registers4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16256GB INTEL SSDPEKKW256G8 + Samsung SSD 960 EVO 500GBNV136 6144MBRealtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.16.0-999-generic (x86_64) 20180324GNOME Shell 3.28.0X Server 1.19.64.3 Mesa 18.0.0-rc5GCC 7.3.0btrfs3840x2160ext4f2fsxfs256GB INTEL SSDPEKKW256G8 + 2 x Samsung SSD 960 EVO 500GBbtrfsext4f2fsxfsbtrfsext4f2fsxfs4 x Intel Xeon E5-2667 v2 @ 3.30GHz (8 Cores)Intel 440BX (6.00 BIOS)Intel 440BX/ZX/DX2 x 16384 MB DRAM21GB Virtual disk + 512GB M4-CT512M4SSD2 + 3 x 750GB GB0750C4414 + 750GB Seagate ST3750640AS + 4001GB Western Digital WD4002FYYZ-0 + 2000GB Western Digital WD2000F9YZ-0 + 2000GB Hitachi HDS72302 + 1000GB SAMSUNG HD103SJ + 1000GB Western Digital WD1002FBYS-0 + 2 x Samsung SSD 970 PRO 512GBVMware SVGA IIVMware VMXNET3Debian 9.64.9.0-8-amd64 (x86_64)GCC 6.3.0 20170516ext41176x885VMwareOpenBenchmarking.orgCompiler Details- Single: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- raid10-ext4-bb: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -vDisk Details- Single: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Single: EXT4: NONE / data=ordered,relatime,rw- Single: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Single: XFS: NONE / attr2,inode64,noquota,relatime,rw- RAID0: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- RAID0: EXT4: NONE / data=ordered,relatime,rw,stripe=256 / raid0 nvme2n1[1] nvme1n1[0]- RAID0: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 nvme2n1[1] nvme1n1[0]- RAID0: XFS: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid0 nvme2n1[1] nvme1n1[0]- RAID1: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- RAID1: EXT4: NONE / data=ordered,relatime,rw / raid1 nvme2n1[1] nvme1n1[0]- RAID1: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 nvme1n1[1] nvme2n1[0]- RAID1: XFS: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme1n1[0] nvme2n1[1]- raid10-ext4-bb: none / data=ordered,errors=remount-ro,relatime,rwProcessor Details- Single: Btrfs, Single: EXT4, Single: F2FS, Single: XFS, RAID0: Btrfs, RAID0: EXT4, RAID0: F2FS, RAID0: XFS, RAID1: Btrfs, RAID1: EXT4, RAID1: F2FS, RAID1: XFS: Scaling Governor: intel_pstate powersavePython Details- Single: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- Single: EXT4: Python 2.7.14+ + Python 3.6.5rc1- Single: F2FS: Python 2.7.14+ + Python 3.6.5rc1- Single: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID0: EXT4: Python 2.7.14+ + Python 3.6.5rc1- RAID0: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID1: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID1: EXT4: Python 2.7.14+ + Python 3.6.5rc1- RAID1: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID1: XFS: Python 2.7.14+ + Python 3.6.5rc1- raid10-ext4-bb: Python 2.7.13 + Python 3.5.3Security Details- Single: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- raid10-ext4-bb: KPTI + __user pointer sanitization + Full generic retpoline + PTE Inversion

Samsung 960 EVO Linux RAID Benchmarkssqlite: Timed SQLite Insertionsfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writedbench: 12iozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performancecompilebench: Compilecompilebench: Initial Createunpack-linux: linux-4.15.tar.xzcompress-gzip: Linux Source Tree Archiving To .tar.gzpgbench: Mostly RAM - Normal Load - Read Onlypgbench: Mostly RAM - Normal Load - Read Writeosbench: Create FilesSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb111.581146505942631160.83222.05139.90540131172973817542865.7434.97108581430327.1145.111171158627231826173.57229.80104.002733035467867012056385.2034.96112451528112.6543.241146155229091763295.53258.47179.75744413659638813106425.5934.42112571345720.4244.051152156428721780184.90208.80104.43629233486386013995206.0434.5493889552735.54110.452159155121761581164.90446.53110.5253373412180187230113285.7033.99201195353427.1950.902747336957453642177.67356.27122.98487143741359131121596615.3734.91207377625512.5443.282319334923213598326.50416.85220.9286431401355125724557065.6233.61206822596821.1045.142402336951803643195.50426.57191.8728622812370236029745446.6433.75218391655544.03113.2511277271105712164.97247.07108.5253804721626156820072685.7135.24204956518527.83165.9216986052802612116.02143.3346.821407829929153610376285.4535.87209073340912.7047.552357157645461822282.70272.98164.03830712456433712664945.7234.38216445304021.0947.522305157045481821173.73214.2299.7753161441086149918155196.4934.26226604543749.3147.426034222359262228100495891407113214252756.4439.5658950386022.78OpenBenchmarking.org

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb4080120160200SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.77, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 3111.5845.1143.2444.05110.4550.9043.2845.14113.25165.9247.5547.5247.42-lz1. (CC) gcc options: -O2 -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb13002600390052006500SE +/- 0.33, N = 3SE +/- 291.88, N = 6SE +/- 2.31, N = 3SE +/- 10.87, N = 3SE +/- 49.93, N = 31146117111461152215927472319240211271698235723056034-lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb7001400210028003500SE +/- 59.31, N = 6SE +/- 3.71, N = 3SE +/- 0.88, N = 3SE +/- 4.04, N = 3SE +/- 178.74, N = 6SE +/- 1.45, N = 3SE +/- 0.88, N = 3SE +/- 2.08, N = 3SE +/- 88.05, N = 6SE +/- 1.15, N = 3SE +/- 3.53, N = 3SE +/- 1.67, N = 3SE +/- 0.58, N = 35051586155215641551336933493369727605157615702223-lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb13002600390052006500SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 1.76, N = 3SE +/- 0.33, N = 3SE +/- 7.69, N = 3SE +/- 20.53, N = 3942272329092872217657452321518011052802454645485926-lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb8001600240032004000SE +/- 7.51, N = 3SE +/- 0.58, N = 3SE +/- 1.86, N = 3SE +/- 1.20, N = 3SE +/- 226.33, N = 6SE +/- 3.06, N = 3SE +/- 2.91, N = 3SE +/- 1.20, N = 3SE +/- 93.04, N = 6SE +/- 5.17, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 36311826176317801581364235983643712612182218212228-lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FSXFS70140210280350SE +/- 0.52, N = 3SE +/- 1.62, N = 3SE +/- 0.53, N = 3SE +/- 0.38, N = 3SE +/- 2.30, N = 3SE +/- 1.59, N = 3SE +/- 1.77, N = 3SE +/- 1.25, N = 3SE +/- 0.19, N = 3SE +/- 15.94, N = 6SE +/- 0.95, N = 3SE +/- 0.63, N = 3160.83173.57295.53184.90164.90177.67326.50195.50164.97116.02282.70173.731. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FSXFS100200300400500SE +/- 13.06, N = 6SE +/- 22.41, N = 6SE +/- 17.62, N = 6SE +/- 8.47, N = 6SE +/- 62.72, N = 6SE +/- 64.94, N = 6SE +/- 84.68, N = 6SE +/- 3.54, N = 3SE +/- 35.15, N = 6SE +/- 1.75, N = 3SE +/- 57.28, N = 6SE +/- 27.22, N = 6222.05229.80258.47208.80446.53356.27416.85426.57247.07143.33272.98214.221. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FSXFS50100150200250SE +/- 6.90, N = 6SE +/- 8.87, N = 6SE +/- 16.19, N = 6SE +/- 7.34, N = 6SE +/- 11.85, N = 6SE +/- 12.91, N = 6SE +/- 28.10, N = 6SE +/- 0.54, N = 3SE +/- 8.51, N = 6SE +/- 6.58, N = 6SE +/- 15.78, N = 6SE +/- 7.22, N = 6139.90104.00179.75104.43110.52122.98220.92191.87108.5246.82164.0399.771. (CC) gcc options: -static

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb10K20K30K40K50KSE +/- 12.41, N = 3SE +/- 1288.79, N = 6SE +/- 709.05, N = 6SE +/- 31.78, N = 3SE +/- 37.47, N = 3SE +/- 262.80, N = 3SE +/- 133.68, N = 4SE +/- 306.61, N = 6SE +/- 46.46, N = 3SE +/- 184.39, N = 3SE +/- 690.66, N = 6SE +/- 90.65, N = 3SE +/- 13.98, N = 3540127330744462925337487148643286253801407883075316100491. (CC) gcc options: -O2 -pthread

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12Single: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb130260390520650SE +/- 2.88, N = 3SE +/- 3.12, N = 3SE +/- 0.74, N = 3SE +/- 21.09, N = 6SE +/- 1.94, N = 3SE +/- 3.95, N = 3SE +/- 0.09, N = 3SE +/- 13.23, N = 6SE +/- 1.17, N = 3SE +/- 1.44, N = 3SE +/- 1.17, N = 3SE +/- 4.17, N = 6SE +/- 1.45, N = 33113541363343413741402814722991241445891. (CC) gcc options: -lpopt -O2

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb5001000150020002500SE +/- 33.51, N = 6SE +/- 42.34, N = 6SE +/- 44.79, N = 6SE +/- 8.56, N = 3SE +/- 391.13, N = 6SE +/- 137.83, N = 6SE +/- 177.96, N = 6SE +/- 192.93, N = 6SE +/- 14.72, N = 3SE +/- 68.00, N = 6SE +/- 66.37, N = 6SE +/- 214.99, N = 6SE +/- 19.42, N = 672967859686321801359135523701626291564108614071. (CC) gcc options: -O3

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb5001000150020002500SE +/- 44.62, N = 6SE +/- 41.99, N = 6SE +/- 75.22, N = 6SE +/- 4.43, N = 3SE +/- 5.51, N = 3SE +/- 101.51, N = 6SE +/- 87.51, N = 6SE +/- 36.42, N = 3SE +/- 8.75, N = 3SE +/- 23.19, N = 6SE +/- 52.07, N = 6SE +/- 15.99, N = 3SE +/- 14.69, N = 773867038886018721311125723601568536337149911321. (CC) gcc options: -O3

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb6001200180024003000SE +/- 55.85, N = 6SE +/- 57.92, N = 6SE +/- 16.67, N = 3SE +/- 50.02, N = 6SE +/- 44.00, N = 3SE +/- 61.58, N = 6SE +/- 210.26, N = 6SE +/- 95.92, N = 6SE +/- 134.93, N = 6SE +/- 70.69, N = 6SE +/- 16.55, N = 3SE +/- 120.63, N = 6SE +/- 16.81, N = 31754120513101399301121592455297420071037126618151425

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb150300450600750SE +/- 7.15, N = 3SE +/- 9.29, N = 3SE +/- 35.40, N = 3SE +/- 4.60, N = 3SE +/- 10.30, N = 3SE +/- 3.32, N = 3SE +/- 4.53, N = 3SE +/- 2.83, N = 3SE +/- 1.71, N = 3SE +/- 8.70, N = 3SE +/- 20.47, N = 3SE +/- 1.88, N = 3SE +/- 2.70, N = 3286638642520328661706544268628494519275

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb246810SE +/- 0.03, N = 4SE +/- 0.01, N = 4SE +/- 0.04, N = 4SE +/- 0.15, N = 8SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.15, N = 8SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.16, N = 8SE +/- 0.03, N = 45.745.205.596.045.705.375.626.645.715.455.726.496.44

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb918273645SE +/- 0.47, N = 3SE +/- 0.09, N = 3SE +/- 0.50, N = 5SE +/- 0.12, N = 3SE +/- 0.47, N = 6SE +/- 0.12, N = 3SE +/- 0.41, N = 3SE +/- 0.53, N = 3SE +/- 0.58, N = 4SE +/- 0.54, N = 3SE +/- 0.53, N = 4SE +/- 0.51, N = 4SE +/- 0.26, N = 334.9734.9634.4234.5433.9934.9133.6133.7535.2435.8734.3834.2639.56

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read OnlySingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb50K100K150K200K250KSE +/- 62.04, N = 3SE +/- 141.88, N = 310858111245111257193889201195207377206822218391204956209073216445226604589501. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb14002800420056007000SE +/- 95.10, N = 4SE +/- 8.97, N = 343035281345755273534625559686555518534093040543738601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFSraid10-ext4-bb1122334455SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 1.45, N = 6SE +/- 2.58, N = 6SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 1.52, N = 6SE +/- 4.57, N = 6SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 1.55, N = 6SE +/- 5.88, N = 6SE +/- 0.45, N = 327.1112.6520.4235.5427.1912.5421.1044.0327.8312.7021.0949.3122.78-lm-lm-lm-lm-lm-lm-lm-lm-lm-lm-lm1. (CC) gcc options:

Phoronix Test Suite v10.8.4