Samsung 960 EVO Linux RAID Benchmarks

Samsung 970 PRO RAID0 EXT4 performance benchmarks (optimized mount option,chunk=16k,stripe=256).

HTML result view exported from: https://openbenchmarking.org/result/1809102-FO-1809105FO87&gru&sor&rro.

Samsung 960 EVO Linux RAID BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFS2 x nvme 970 pro 512G lvm-strippedraid0 EXT4LVMSTRIPPED: EXT4RAID0: EXT4 970PRORAID0: EXT4 970PRO2RAID0: EXT4 970PRO16kRAID0: EXT4 970PRO3Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)ASUS PRIME X299-A (1004 BIOS)Intel Sky Lake-E DMI3 Registers4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16256GB INTEL SSDPEKKW256G8 + Samsung SSD 960 EVO 500GBNV136 6144MBRealtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.16.0-999-generic (x86_64) 20180324GNOME Shell 3.28.0X Server 1.19.64.3 Mesa 18.0.0-rc5GCC 7.3.0btrfs3840x2160ext4f2fsxfs256GB INTEL SSDPEKKW256G8 + 2 x Samsung SSD 960 EVO 500GBbtrfsext4f2fsxfsbtrfsext4f2fsxfs2 x Intel Xeon Silver 4108 @ 1.80GHz (16 Cores / 32 Threads)Dell 0NJK2F (1.4.8 BIOS)31744MB4000GB PERC H330 Adp + 2 x Samsung SSD 970 PRO 512GBMatrox s Matrox G200eW3Broadcom Limited NetXtreme BCM5720 Gigabit PCIeCentOS Linux 73.10.0-862.11.6.el7.x86_64 (x86_64)GCC 4.8.5 201506231024x768ext4OpenBenchmarking.orgCompiler Details- Single: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- 2 x nvme 970 pro 512G lvm-strippedraid0 EXT4: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic- LVMSTRIPPED: EXT4: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic- RAID0: EXT4 970PRO: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic- RAID0: EXT4 970PRO2: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic- RAID0: EXT4 970PRO16k: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic- RAID0: EXT4 970PRO3: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=genericDisk Details- Single: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Single: EXT4: NONE / data=ordered,relatime,rw- Single: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Single: XFS: NONE / attr2,inode64,noquota,relatime,rw- RAID0: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- RAID0: EXT4: NONE / data=ordered,relatime,rw,stripe=256 / raid0 nvme2n1[1] nvme1n1[0]- RAID0: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 nvme2n1[1] nvme1n1[0]- RAID0: XFS: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid0 nvme2n1[1] nvme1n1[0]- RAID1: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- RAID1: EXT4: NONE / data=ordered,relatime,rw / raid1 nvme2n1[1] nvme1n1[0]- RAID1: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 nvme1n1[1] nvme2n1[0]- RAID1: XFS: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme1n1[0] nvme2n1[1]- 2 x nvme 970 pro 512G lvm-strippedraid0 EXT4: NONE / attr2,inode64,logbsize=64k,noquota,relatime,rw,seclabel,sunit=128,swidth=128- LVMSTRIPPED: EXT4: NONE / attr2,inode64,logbsize=64k,noquota,relatime,rw,seclabel,sunit=128,swidth=128- RAID0: EXT4 970PRO: NONE / attr2,inode64,logbsize=64k,noquota,relatime,rw,seclabel,sunit=128,swidth=128- RAID0: EXT4 970PRO2: NONE / attr2,inode64,logbsize=64k,noquota,relatime,rw,seclabel,sunit=128,swidth=128- RAID0: EXT4 970PRO16k: NONE / attr2,inode64,logbsize=64k,noquota,relatime,rw,seclabel,sunit=128,swidth=128- RAID0: EXT4 970PRO3: NONE / attr2,inode64,logbsize=64k,noquota,relatime,rw,seclabel,sunit=128,swidth=128Processor Details- Single: Btrfs, Single: EXT4, Single: F2FS, Single: XFS, RAID0: Btrfs, RAID0: EXT4, RAID0: F2FS, RAID0: XFS, RAID1: Btrfs, RAID1: EXT4, RAID1: F2FS, RAID1: XFS: Scaling Governor: intel_pstate powersavePython Details- Single: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- Single: EXT4: Python 2.7.14+ + Python 3.6.5rc1- Single: F2FS: Python 2.7.14+ + Python 3.6.5rc1- Single: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID0: EXT4: Python 2.7.14+ + Python 3.6.5rc1- RAID0: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID1: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID1: EXT4: Python 2.7.14+ + Python 3.6.5rc1- RAID1: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID1: XFS: Python 2.7.14+ + Python 3.6.5rc1- 2 x nvme 970 pro 512G lvm-strippedraid0 EXT4: Python 2.7.5- LVMSTRIPPED: EXT4: Python 2.7.5- RAID0: EXT4 970PRO: Python 2.7.5- RAID0: EXT4 970PRO2: Python 2.7.5- RAID0: EXT4 970PRO16k: Python 2.7.5- RAID0: EXT4 970PRO3: Python 2.7.5Security Details- Single: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- 2 x nvme 970 pro 512G lvm-strippedraid0 EXT4: SELinux Protection- LVMSTRIPPED: EXT4: SELinux Protection- RAID0: EXT4 970PRO: SELinux Protection- RAID0: EXT4 970PRO2: SELinux Protection- RAID0: EXT4 970PRO16k: SELinux Protection- RAID0: EXT4 970PRO3: SELinux Protection

Samsung 960 EVO Linux RAID Benchmarksfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writefio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directorydbench: 12iozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performancecompilebench: Compilecompilebench: Initial Createpgbench: Mostly RAM - Normal Load - Read Onlypgbench: Mostly RAM - Normal Load - Read Writesqlite: Timed SQLite Insertionsunpack-linux: linux-4.15.tar.xzcompress-gzip: Linux Source Tree Archiving To .tar.gzosbench: Create FilesSingle: BtrfsSingle: EXT4Single: F2FSSingle: XFSRAID0: BtrfsRAID0: EXT4RAID0: F2FSRAID0: XFSRAID1: BtrfsRAID1: EXT4RAID1: F2FSRAID1: XFS2 x nvme 970 pro 512G lvm-strippedraid0 EXT4LVMSTRIPPED: EXT4RAID0: EXT4 970PRORAID0: EXT4 970PRO2RAID0: EXT4 970PRO16kRAID0: EXT4 970PRO3160.83222.05139.9054011146505942631310.90729.25737.611753.94285.69108580.714303.45111.585.7434.9727.11173.57229.80104.00273301171158627231826353.52678.26670.161205.48638.18112451.345280.7345.115.2034.9612.65295.53258.47179.7574441146155229091763136.23595.87388.041309.50641.50112571.023457.0643.245.5934.4220.42184.90208.80104.4362921152156428721780333.76862.94860.451399.49520.2393888.755526.9644.056.0434.5435.54164.90446.53110.5253372159155121761581340.842179.581872.373011.17328.09201194.533533.85110.455.7033.9927.19177.67356.27122.98487142747336957453642374.021358.801311.082159.13660.81207376.846254.5650.905.3734.9112.54326.50416.85220.9286432319334923213598139.931354.881256.902455.17706.09206821.755967.5143.285.6233.6121.10195.50426.57191.8728622402336951803643281.472369.792360.192973.84543.81218391.416555.0745.146.6433.7544.03164.97247.07108.52538011277271105712471.801625.991568.282007.22268.37204955.625184.95113.255.7135.2427.83116.02143.3346.821407816986052802612299.23290.98535.621036.53627.87209072.693409.42165.925.4535.8712.70282.70272.98164.0383072357157645461822123.79563.51336.531265.95494.11216444.713039.7947.555.7234.3821.09173.73214.2299.7753162305157045481821143.931085.611499.261815.14518.78226603.675436.9947.526.4934.2649.31127.70397.00128.60152195793420059104209529.701129.52938.991010.23199.8553.658.8854.34134.30408.03134.07155746697446766804455545.241192.64970.991024.11197.2250.638.7754.35132.40403.47134.67162056722447567154475546.271178.67962.601000.89201.2550.398.8354.66131.57399.07130.70161476466438865624236544.211206.67964.271016.52200.6252.888.8854.48131.33402.40131.90162236593429365974321539.741181.55956.321018.08200.3451.158.8954.69OpenBenchmarking.org

FS-Mark

Test: 1000 Files, 1MB Size

RAID1LVMSTRIPPEDRAID0SingleOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4EXT4 970PRO3EXT4 970PRO16kEXT4 970PRO2EXT4 970PROBtrfsXFSF2FS70140210280350SE +/- 15.94, N = 6SE +/- 0.19, N = 3SE +/- 0.63, N = 3SE +/- 0.95, N = 3SE +/- 0.26, N = 3SE +/- 0.50, N = 3SE +/- 0.35, N = 3SE +/- 1.17, N = 3SE +/- 0.45, N = 3SE +/- 2.30, N = 3SE +/- 1.59, N = 3SE +/- 1.25, N = 3SE +/- 1.77, N = 3SE +/- 0.52, N = 3SE +/- 1.62, N = 3SE +/- 0.38, N = 3SE +/- 0.53, N = 3116.02164.97173.73282.70127.70131.33131.57132.40134.30164.90177.67195.50326.50160.83173.57184.90295.531. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

RAID1SingleRAID0LVMSTRIPPEDOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4XFSBtrfsF2FSEXT4 970PRO16kEXT4 970PRO3EXT4 970PRO2EXT4 970PRO100200300400500SE +/- 1.75, N = 3SE +/- 27.22, N = 6SE +/- 35.15, N = 6SE +/- 57.28, N = 6SE +/- 8.47, N = 6SE +/- 13.06, N = 6SE +/- 22.41, N = 6SE +/- 17.62, N = 6SE +/- 64.94, N = 6SE +/- 0.23, N = 3SE +/- 2.04, N = 3SE +/- 3.62, N = 3SE +/- 2.43, N = 3SE +/- 84.68, N = 6SE +/- 3.54, N = 3SE +/- 62.72, N = 6SE +/- 1.55, N = 3143.33214.22247.07272.98208.80222.05229.80258.47356.27399.07402.40403.47408.03416.85426.57446.53397.001. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

RAID1SingleRAID0LVMSTRIPPEDOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4XFSBtrfsEXT4 970PRO16kEXT4 970PRO3EXT4 970PROEXT4 970PRO2F2FS50100150200250SE +/- 6.58, N = 6SE +/- 7.22, N = 6SE +/- 8.51, N = 6SE +/- 15.78, N = 6SE +/- 8.87, N = 6SE +/- 7.34, N = 6SE +/- 6.90, N = 6SE +/- 16.19, N = 6SE +/- 11.85, N = 6SE +/- 12.91, N = 6SE +/- 1.01, N = 3SE +/- 0.15, N = 3SE +/- 0.43, N = 3SE +/- 0.32, N = 3SE +/- 0.54, N = 3SE +/- 28.10, N = 6SE +/- 0.38, N = 346.8299.77108.52164.03104.00104.43139.90179.75110.52122.98130.70131.90134.07134.67191.87220.92128.601. (CC) gcc options: -static

BlogBench

Test: Write

RAID0RAID1SingleLVMSTRIPPEDOpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteXFSBtrfsF2FSEXT4EXT4 970PROEXT4 970PRO16kEXT4 970PRO2EXT4 970PRO310K20K30K40K50KSE +/- 306.61, N = 6SE +/- 37.47, N = 3SE +/- 133.68, N = 4SE +/- 208.58, N = 6SE +/- 233.67, N = 5SE +/- 271.67, N = 6SE +/- 251.66, N = 4SE +/- 262.80, N = 3SE +/- 90.65, N = 3SE +/- 46.46, N = 3SE +/- 690.66, N = 6SE +/- 184.39, N = 3SE +/- 12.41, N = 3SE +/- 31.78, N = 3SE +/- 709.05, N = 6SE +/- 1288.79, N = 6SE +/- 261.42, N = 428625337864315574161471620516223487145316538083071407854016292744427330152191. (CC) gcc options: -O2 -pthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

RAID1SingleRAID0LVMSTRIPPEDOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsF2FSXFSEXT4EXT4 970PRO16kEXT4 970PRO3EXT4 970PROEXT4 970PRO214002800420056007000SE +/- 2.31, N = 3SE +/- 10.87, N = 3SE +/- 0.33, N = 3SE +/- 291.88, N = 6SE +/- 19.70, N = 3SE +/- 38.77, N = 3SE +/- 15.67, N = 3SE +/- 6.51, N = 3SE +/- 87.66, N = 3112716982305235711461146115211712159231924022747646665936697672257931. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID1RAID0LVMSTRIPPEDOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFSEXT4 970PRO3EXT4 970PRO16kEXT4 970PROEXT4 970PRO210002000300040005000SE +/- 59.31, N = 6SE +/- 0.88, N = 3SE +/- 4.04, N = 3SE +/- 3.71, N = 3SE +/- 1.15, N = 3SE +/- 88.05, N = 6SE +/- 1.67, N = 3SE +/- 3.53, N = 3SE +/- 178.74, N = 6SE +/- 0.88, N = 3SE +/- 1.45, N = 3SE +/- 2.08, N = 3SE +/- 84.31, N = 3SE +/- 37.68, N = 3SE +/- 5.57, N = 3SE +/- 0.58, N = 3SE +/- 10.41, N = 3505155215641586605727157015761551334933693369429343884467447542001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID1RAID0LVMSTRIPPEDOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsF2FSEXT4XFSEXT4 970PRO16kEXT4 970PRO3EXT4 970PROEXT4 970PRO214002800420056007000SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 7.69, N = 3SE +/- 0.33, N = 3SE +/- 1.76, N = 3SE +/- 1.15, N = 3SE +/- 49.52, N = 3SE +/- 24.94, N = 3SE +/- 25.41, N = 3SE +/- 6.23, N = 3SE +/- 46.56, N = 394227232872290911052802454645482176232151805745656265976680671559101. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

RAID1SingleRAID0LVMSTRIPPEDOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4BtrfsF2FSXFSEXT4 970PRO16kEXT4 970PRO3EXT4 970PROEXT4 970PRO210002000300040005000SE +/- 5.17, N = 3SE +/- 93.04, N = 6SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 7.51, N = 3SE +/- 1.86, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 226.33, N = 6SE +/- 2.91, N = 3SE +/- 3.06, N = 3SE +/- 1.20, N = 3SE +/- 35.23, N = 3SE +/- 85.41, N = 3SE +/- 2.65, N = 3SE +/- 0.58, N = 3SE +/- 14.50, N = 3612712182118226311763178018261581359836423643423643214455447542091. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Dbench

Client Count: 12

RAID1SingleRAID0LVMSTRIPPEDOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12F2FSXFSEXT4BtrfsEXT4 970PRO3EXT4 970PRO16kEXT4 970PROEXT4 970PRO2120240360480600SE +/- 1.17, N = 3SE +/- 4.17, N = 6SE +/- 1.44, N = 3SE +/- 1.17, N = 3SE +/- 0.74, N = 3SE +/- 2.88, N = 3SE +/- 21.09, N = 6SE +/- 3.12, N = 3SE +/- 0.09, N = 3SE +/- 13.23, N = 6SE +/- 1.94, N = 3SE +/- 3.95, N = 3SE +/- 2.62, N = 3SE +/- 1.13, N = 3SE +/- 1.30, N = 3SE +/- 1.68, N = 3SE +/- 1.60, N = 3123.79143.93299.23471.80136.23310.90333.76353.52139.93281.47340.84374.02539.74544.21545.24546.27529.701. (CC) gcc options: -lpopt -O2

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

RAID1SingleLVMSTRIPPEDRAID0OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceEXT4F2FSBtrfsXFSEXT4 970PRO2EXT4 970PRO3EXT4 970PROEXT4 970PRO16k5001000150020002500SE +/- 68.00, N = 6SE +/- 66.37, N = 6SE +/- 214.99, N = 6SE +/- 14.72, N = 3SE +/- 44.79, N = 6SE +/- 42.34, N = 6SE +/- 33.51, N = 6SE +/- 8.56, N = 3SE +/- 33.15, N = 6SE +/- 36.65, N = 6SE +/- 33.96, N = 6SE +/- 34.19, N = 6SE +/- 30.13, N = 6SE +/- 177.96, N = 6SE +/- 137.83, N = 6SE +/- 391.13, N = 6SE +/- 192.93, N = 6290.98563.511085.611625.99595.87678.26729.25862.941129.521178.671181.551192.641206.671354.881358.802179.582369.791. (CC) gcc options: -O3

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

RAID1SingleLVMSTRIPPEDRAID0OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceF2FSEXT4BtrfsXFSEXT4 970PRO3EXT4 970PRO2EXT4 970PRO16kEXT4 970PRO5001000150020002500SE +/- 52.07, N = 6SE +/- 23.19, N = 6SE +/- 15.99, N = 3SE +/- 8.75, N = 3SE +/- 75.22, N = 6SE +/- 41.99, N = 6SE +/- 44.62, N = 6SE +/- 4.43, N = 3SE +/- 14.50, N = 4SE +/- 3.73, N = 3SE +/- 3.64, N = 3SE +/- 3.07, N = 3SE +/- 3.27, N = 3SE +/- 87.51, N = 6SE +/- 101.51, N = 6SE +/- 5.51, N = 3SE +/- 36.42, N = 3336.53535.621499.261568.28388.04670.16737.61860.45938.99956.32962.60964.27970.991256.901311.081872.372360.191. (CC) gcc options: -O3

Compile Bench

Test: Compile

RAID0LVMSTRIPPEDRAID1SingleOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileEXT4 970PRO2EXT4EXT4 970PRO16kEXT4 970PRO3EXT4 970PROF2FSXFSBtrfs6001200180024003000SE +/- 3.68, N = 3SE +/- 2.23, N = 3SE +/- 11.29, N = 3SE +/- 4.13, N = 3SE +/- 61.58, N = 6SE +/- 210.26, N = 6SE +/- 95.92, N = 6SE +/- 44.00, N = 3SE +/- 8.20, N = 3SE +/- 70.69, N = 6SE +/- 16.55, N = 3SE +/- 120.63, N = 6SE +/- 134.93, N = 6SE +/- 57.92, N = 6SE +/- 16.67, N = 3SE +/- 50.02, N = 6SE +/- 55.85, N = 61000.891016.521018.081024.112159.132455.172973.843011.171010.231036.531265.951815.142007.221205.481309.501399.491753.94

Compile Bench

Test: Initial Create

RAID0LVMSTRIPPEDRAID1SingleOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4 970PROEXT4EXT4 970PRO3EXT4 970PRO16kEXT4 970PRO2BtrfsF2FSXFS150300450600750SE +/- 1.64, N = 3SE +/- 1.15, N = 3SE +/- 1.73, N = 3SE +/- 0.80, N = 3SE +/- 10.30, N = 3SE +/- 2.83, N = 3SE +/- 3.32, N = 3SE +/- 4.53, N = 3SE +/- 0.77, N = 3SE +/- 1.71, N = 3SE +/- 20.47, N = 3SE +/- 1.88, N = 3SE +/- 8.70, N = 3SE +/- 7.15, N = 3SE +/- 4.60, N = 3SE +/- 9.29, N = 3SE +/- 35.40, N = 3197.22200.34200.62201.25328.09543.81660.81706.09199.85268.37494.11518.78627.87285.69520.23638.18641.50

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only

SingleRAID0RAID1OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read OnlyXFSBtrfsEXT4F2FS50K100K150K200K250KSE +/- 62.04, N = 393888.75108580.71112451.34112571.02201194.53206821.75207376.84218391.41204955.62209072.69216444.71226603.671. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

RAID1SingleRAID0OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteF2FSEXT4BtrfsXFS14002800420056007000SE +/- 95.10, N = 43039.793409.425184.955436.993457.064303.455280.735526.963533.855967.516254.566555.071. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

SQLite

Timed SQLite Insertions

RAID1SingleRAID0LVMSTRIPPEDOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsEXT4BtrfsEXT4 970PRO16kEXT4 970PRO3EXT4 970PROEXT4 970PRO2F2FSXFS4080120160200SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.25, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.77, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3165.92113.2547.5547.52111.5845.1144.0543.24110.4552.8851.1550.9050.6350.3945.1443.2853.651. (CC) gcc options: -O2 -ldl -lpthread

Unpacking The Linux Kernel

linux-4.15.tar.xz

RAID0LVMSTRIPPEDRAID1SingleOpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzEXT4 970PRO3EXT4 970PRO16kEXT4EXT4 970PRO2EXT4 970PROXFSBtrfsF2FS246810SE +/- 0.08, N = 4SE +/- 0.08, N = 4SE +/- 0.06, N = 4SE +/- 0.09, N = 4SE +/- 0.15, N = 8SE +/- 0.05, N = 4SE +/- 0.04, N = 4SE +/- 0.07, N = 4SE +/- 0.07, N = 4SE +/- 0.16, N = 8SE +/- 0.02, N = 4SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.15, N = 8SE +/- 0.03, N = 4SE +/- 0.04, N = 4SE +/- 0.01, N = 48.898.888.838.776.645.705.625.378.886.495.725.715.456.045.745.595.20

Gzip Compression

Linux Source Tree Archiving To .tar.gz

RAID0LVMSTRIPPEDRAID1SingleOpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzEXT4 970PRO3EXT4 970PRO2EXT4 970PRO16kEXT4 970PROEXT4BtrfsXFSF2FS1224364860SE +/- 0.13, N = 3SE +/- 0.20, N = 3SE +/- 0.18, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.47, N = 6SE +/- 0.53, N = 3SE +/- 0.41, N = 3SE +/- 0.12, N = 3SE +/- 0.54, N = 3SE +/- 0.58, N = 4SE +/- 0.53, N = 4SE +/- 0.51, N = 4SE +/- 0.47, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.50, N = 554.6954.6654.4854.3534.9133.9933.7533.6154.3435.8735.2434.3834.2634.9734.9634.5434.42

OSBench

Test: Create Files

RAID1RAID0SingleOpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesXFSBtrfsF2FSEXT41122334455SE +/- 5.88, N = 6SE +/- 0.36, N = 3SE +/- 1.55, N = 6SE +/- 0.04, N = 3SE +/- 4.57, N = 6SE +/- 0.16, N = 3SE +/- 1.52, N = 6SE +/- 0.02, N = 3SE +/- 2.58, N = 6SE +/- 0.19, N = 3SE +/- 1.45, N = 6SE +/- 0.04, N = 349.3127.8321.0912.7044.0327.1921.1012.5435.5427.1120.4212.651. (CC) gcc options:

Phoronix Test Suite v10.8.5