Samsung 960 EVO Linux RAID Benchmarks

ministack-3x_nvme-btrfs-raid0

HTML result view exported from: https://openbenchmarking.org/result/2004303-NI-1803273FO46&rdt&gru.

Samsung 960 EVO Linux RAID BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionDisplay DriverSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid0Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)ASUS PRIME X299-A (1004 BIOS)Intel Sky Lake-E DMI3 Registers4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16256GB INTEL SSDPEKKW256G8 + Samsung SSD 960 EVO 500GBNV136 6144MBRealtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.16.0-999-generic (x86_64) 20180324GNOME Shell 3.28.0X Server 1.19.64.3 Mesa 18.0.0-rc5GCC 7.3.0f2fs3840x2160ext4btrfsxfs256GB INTEL SSDPEKKW256G8 + 2 x Samsung SSD 960 EVO 500GBbtrfsext4xfsf2fsxfsext4Intel Xeon Silver 4210 (10 Cores / 20 Threads)Dell 04WYPY (2.2.11 BIOS)4 x 32 GB DDR4-2666MT/s 36ASF4G72PZ-2G6D13 x 2048GB Sabrent + 1000GB HUS722T1TALA600 + 250GB SanDisk SDSSDH32 + 16GB IDSDMllvmpipe 125GB2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA + 4 x Intel 82571EB/82571GBFedora 325.6.6-300.fc32.x86_64 (x86_64)GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 10.0.0 256 bits)GCC 10.0.1 20200328btrfs3840x1080OpenBenchmarking.orgCompiler Details- Single: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Single: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID1: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- RAID0: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- ministack-3x_nvme-btrfs-raid0: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driverDisk Details- Single: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Single: EXT4: NONE / data=ordered,relatime,rw- Single: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Single: XFS: NONE / attr2,inode64,noquota,relatime,rw- RAID0: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- RAID1: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- RAID1: EXT4: NONE / data=ordered,relatime,rw / raid1 nvme2n1[1] nvme1n1[0]- RAID1: XFS: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme1n1[0] nvme2n1[1]- RAID1: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 nvme1n1[1] nvme2n1[0]- RAID0: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 nvme2n1[1] nvme1n1[0]- RAID0: XFS: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid0 nvme2n1[1] nvme1n1[0]- RAID0: EXT4: NONE / data=ordered,relatime,rw,stripe=256 / raid0 nvme2n1[1] nvme1n1[0]- ministack-3x_nvme-btrfs-raid0: NONE / relatime,rw,seclabel,space_cache,ssd,subvol=/,subvolid=5 / RAID0Processor Details- Single: F2FS: Scaling Governor: intel_pstate powersave- Single: EXT4: Scaling Governor: intel_pstate powersave- Single: Btrfs: Scaling Governor: intel_pstate powersave- Single: XFS: Scaling Governor: intel_pstate powersave- RAID0: Btrfs: Scaling Governor: intel_pstate powersave- RAID1: Btrfs: Scaling Governor: intel_pstate powersave- RAID1: EXT4: Scaling Governor: intel_pstate powersave- RAID1: XFS: Scaling Governor: intel_pstate powersave- RAID1: F2FS: Scaling Governor: intel_pstate powersave- RAID0: F2FS: Scaling Governor: intel_pstate powersave- RAID0: XFS: Scaling Governor: intel_pstate powersave- RAID0: EXT4: Scaling Governor: intel_pstate powersave- ministack-3x_nvme-btrfs-raid0: CPU Microcode: 0x500002cPython Details- Single: F2FS: Python 2.7.14+ + Python 3.6.5rc1- Single: EXT4: Python 2.7.14+ + Python 3.6.5rc1- Single: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- Single: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID1: Btrfs: Python 2.7.14+ + Python 3.6.5rc1- RAID1: EXT4: Python 2.7.14+ + Python 3.6.5rc1- RAID1: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID1: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: F2FS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: XFS: Python 2.7.14+ + Python 3.6.5rc1- RAID0: EXT4: Python 2.7.14+ + Python 3.6.5rc1- ministack-3x_nvme-btrfs-raid0: Python 3.8.2Security Details- Single: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- Single: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID1: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection- RAID0: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection- ministack-3x_nvme-btrfs-raid0: SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Samsung 960 EVO Linux RAID Benchmarksfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writefio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directorydbench: 12iozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performancecompilebench: Compilecompilebench: Initial Createpgbench: Mostly RAM - Normal Load - Read Onlypgbench: Mostly RAM - Normal Load - Read Writesqlite: Timed SQLite Insertionsunpack-linux: linux-4.15.tar.xzcompress-gzip: Linux Source Tree Archiving To .tar.gzosbench: Create FilesSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid0295.53258.47179.7574441146155229091763136.23595.87388.041309.50641.50112571.023457.0643.245.5934.4220.42173.57229.80104.00273301171158627231826353.52678.26670.161205.48638.18112451.345280.7345.115.2034.9612.65160.83222.05139.9054011146505942631310.90729.25737.611753.94285.69108580.714303.45111.585.7434.9727.11184.90208.80104.4362921152156428721780333.76862.94860.451399.49520.2393888.755526.9644.056.0434.5435.54164.90446.53110.5253372159155121761581340.842179.581872.373011.17328.09201194.533533.85110.455.7033.9927.19164.97247.07108.52538011277271105712471.801625.991568.282007.22268.37204955.625184.95113.255.7135.2427.83116.02143.3346.821407816986052802612299.23290.98535.621036.53627.87209072.693409.42165.925.4535.8712.70173.73214.2299.7753162305157045481821143.931085.611499.261815.14518.78226603.675436.9947.526.4934.2649.31282.70272.98164.0383072357157645461822123.79563.51336.531265.95494.11216444.713039.7947.555.7234.3821.09326.50416.85220.9286432319334923213598139.931354.881256.902455.17706.09206821.755967.5143.285.6233.6121.10195.50426.57191.8728622402336951803643281.472369.792360.192973.84543.81218391.416555.0745.146.6433.7544.03177.67356.27122.98487142747336957453642374.021358.801311.082159.13660.81207376.846254.5650.905.3734.9112.548899247.836110914.0491892218.60419278.5847.88751.39742.124425OpenBenchmarking.org

FS-Mark

Test: 1000 Files, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeF2FSEXT4BtrfsXFS70140210280350SE +/- 0.53, N = 3SE +/- 1.62, N = 3SE +/- 0.52, N = 3SE +/- 0.38, N = 3SE +/- 2.30, N = 3SE +/- 1.77, N = 3SE +/- 1.25, N = 3SE +/- 1.59, N = 3SE +/- 0.19, N = 3SE +/- 15.94, N = 6SE +/- 0.63, N = 3SE +/- 0.95, N = 3295.53173.57160.83184.90164.90326.50195.50177.67164.97116.02173.73282.701. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsF2FSEXT4BtrfsXFS100200300400500SE +/- 17.62, N = 6SE +/- 22.41, N = 6SE +/- 13.06, N = 6SE +/- 8.47, N = 6SE +/- 62.72, N = 6SE +/- 84.68, N = 6SE +/- 3.54, N = 3SE +/- 64.94, N = 6SE +/- 35.15, N = 6SE +/- 1.75, N = 3SE +/- 27.22, N = 6SE +/- 57.28, N = 6258.47229.80222.05208.80446.53416.85426.57356.27247.07143.33214.22272.981. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeF2FSEXT4BtrfsXFS50100150200250SE +/- 16.19, N = 6SE +/- 8.87, N = 6SE +/- 6.90, N = 6SE +/- 7.34, N = 6SE +/- 11.85, N = 6SE +/- 28.10, N = 6SE +/- 0.54, N = 3SE +/- 12.91, N = 6SE +/- 8.51, N = 6SE +/- 6.58, N = 6SE +/- 7.22, N = 6SE +/- 15.78, N = 6179.75104.00139.90104.43110.52220.92191.87122.98108.5246.8299.77164.031. (CC) gcc options: -static

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid010K20K30K40K50KSE +/- 709.05, N = 6SE +/- 1288.79, N = 6SE +/- 12.41, N = 3SE +/- 31.78, N = 3SE +/- 37.47, N = 3SE +/- 46.46, N = 3SE +/- 184.39, N = 3SE +/- 90.65, N = 3SE +/- 690.66, N = 6SE +/- 133.68, N = 4SE +/- 306.61, N = 6SE +/- 262.80, N = 3SE +/- 130.80, N = 974442733054016292533753801407853168307864328624871488991. (CC) gcc options: -O2 -pthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS6001200180024003000SE +/- 0.33, N = 3SE +/- 291.88, N = 6SE +/- 2.31, N = 3SE +/- 10.87, N = 31146117111461152215923192402274711271698230523571. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS7001400210028003500SE +/- 0.88, N = 3SE +/- 3.71, N = 3SE +/- 59.31, N = 6SE +/- 4.04, N = 3SE +/- 178.74, N = 6SE +/- 0.88, N = 3SE +/- 2.08, N = 3SE +/- 1.45, N = 3SE +/- 88.05, N = 6SE +/- 1.15, N = 3SE +/- 1.67, N = 3SE +/- 3.53, N = 31552158650515641551334933693369727605157015761. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS12002400360048006000SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 1.76, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 7.69, N = 3290927239422872217623215180574511052802454845461. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS8001600240032004000SE +/- 1.86, N = 3SE +/- 0.58, N = 3SE +/- 7.51, N = 3SE +/- 1.20, N = 3SE +/- 226.33, N = 6SE +/- 2.91, N = 3SE +/- 1.20, N = 3SE +/- 3.06, N = 3SE +/- 93.04, N = 6SE +/- 5.17, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 31763182663117801581359836433642712612182118221. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12Single: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid0100200300400500SE +/- 0.74, N = 3SE +/- 3.12, N = 3SE +/- 2.88, N = 3SE +/- 21.09, N = 6SE +/- 1.94, N = 3SE +/- 1.17, N = 3SE +/- 1.44, N = 3SE +/- 4.17, N = 6SE +/- 1.17, N = 3SE +/- 0.09, N = 3SE +/- 13.23, N = 6SE +/- 3.95, N = 3SE +/- 1.61, N = 3136.23353.52310.90333.76340.84471.80299.23143.93123.79139.93281.47374.02247.841. (CC) gcc options: -lpopt -O2

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceF2FSEXT4BtrfsXFS5001000150020002500SE +/- 44.79, N = 6SE +/- 42.34, N = 6SE +/- 33.51, N = 6SE +/- 8.56, N = 3SE +/- 391.13, N = 6SE +/- 177.96, N = 6SE +/- 192.93, N = 6SE +/- 137.83, N = 6SE +/- 14.72, N = 3SE +/- 68.00, N = 6SE +/- 214.99, N = 6SE +/- 66.37, N = 6595.87678.26729.25862.942179.581354.882369.791358.801625.99290.981085.61563.511. (CC) gcc options: -O3

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceF2FSEXT4BtrfsXFS5001000150020002500SE +/- 75.22, N = 6SE +/- 41.99, N = 6SE +/- 44.62, N = 6SE +/- 4.43, N = 3SE +/- 5.51, N = 3SE +/- 87.51, N = 6SE +/- 36.42, N = 3SE +/- 101.51, N = 6SE +/- 8.75, N = 3SE +/- 23.19, N = 6SE +/- 15.99, N = 3SE +/- 52.07, N = 6388.04670.16737.61860.451872.371256.902360.191311.081568.28535.621499.26336.531. (CC) gcc options: -O3

Compile Bench

Test: Compile

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileF2FSEXT4BtrfsXFS6001200180024003000SE +/- 16.67, N = 3SE +/- 57.92, N = 6SE +/- 55.85, N = 6SE +/- 50.02, N = 6SE +/- 44.00, N = 3SE +/- 210.26, N = 6SE +/- 95.92, N = 6SE +/- 61.58, N = 6SE +/- 134.93, N = 6SE +/- 70.69, N = 6SE +/- 120.63, N = 6SE +/- 16.55, N = 31309.501205.481753.941399.493011.172455.172973.842159.132007.221036.531815.141265.95

Compile Bench

Test: Initial Create

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FSEXT4BtrfsXFS150300450600750SE +/- 35.40, N = 3SE +/- 9.29, N = 3SE +/- 7.15, N = 3SE +/- 4.60, N = 3SE +/- 10.30, N = 3SE +/- 4.53, N = 3SE +/- 2.83, N = 3SE +/- 3.32, N = 3SE +/- 1.71, N = 3SE +/- 8.70, N = 3SE +/- 1.88, N = 3SE +/- 20.47, N = 3641.50638.18285.69520.23328.09706.09543.81660.81268.37627.87518.78494.11

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read OnlySingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid050K100K150K200K250KSE +/- 62.04, N = 3SE +/- 1110.13, N = 3112571.02112451.34108580.7193888.75201194.53204955.62209072.69226603.67216444.71206821.75218391.41207376.84110914.051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid014002800420056007000SE +/- 95.10, N = 4SE +/- 148.90, N = 33457.065280.734303.455526.963533.855184.953409.425436.993039.795967.516555.076254.562218.601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid04080120160200SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.30, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.36, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.83, N = 343.2445.11111.5844.05110.45113.25165.9247.5247.5543.2845.1450.9078.581. (CC) gcc options: -O2 -ldl -lpthread

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid0246810SE +/- 0.037, N = 4SE +/- 0.008, N = 4SE +/- 0.026, N = 4SE +/- 0.150, N = 8SE +/- 0.050, N = 4SE +/- 0.039, N = 4SE +/- 0.009, N = 4SE +/- 0.162, N = 8SE +/- 0.017, N = 4SE +/- 0.040, N = 4SE +/- 0.150, N = 8SE +/- 0.067, N = 4SE +/- 0.009, N = 45.5905.2005.7406.0405.7005.7105.4506.4905.7205.6206.6405.3707.887

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid01224364860SE +/- 0.50, N = 5SE +/- 0.09, N = 3SE +/- 0.47, N = 3SE +/- 0.12, N = 3SE +/- 0.47, N = 6SE +/- 0.58, N = 4SE +/- 0.54, N = 3SE +/- 0.51, N = 4SE +/- 0.53, N = 4SE +/- 0.41, N = 3SE +/- 0.53, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 334.4234.9634.9734.5433.9935.2435.8734.2634.3833.6133.7534.9151.40

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesSingle: F2FSSingle: EXT4Single: BtrfsSingle: XFSRAID0: BtrfsRAID1: BtrfsRAID1: EXT4RAID1: XFSRAID1: F2FSRAID0: F2FSRAID0: XFSRAID0: EXT4ministack-3x_nvme-btrfs-raid01122334455SE +/- 1.45, N = 6SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 2.58, N = 6SE +/- 0.16, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 5.88, N = 6SE +/- 1.55, N = 6SE +/- 1.52, N = 6SE +/- 4.57, N = 6SE +/- 0.02, N = 3SE +/- 0.44, N = 320.4212.6527.1135.5427.1927.8312.7049.3121.0921.1044.0312.5442.12-lm-lm-lm-lm-lm-lm-lm-lm-lm-lm-lm1. (CC) gcc options:

Phoronix Test Suite v10.8.4