Samsung 960 EVO Linux RAID Benchmarks Samsung 960 EVO RAID0 and RAID1 dual drive Btrfs XFS EXT4 F2FS Linux RAID performance benchmarks on 4.16 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1811282-RA-1803273FO45&sor .
Samsung 960 EVO Linux RAID Benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution System Layer Single: Btrfs Single: EXT4 Single: F2FS Single: XFS RAID0: Btrfs RAID0: EXT4 RAID0: F2FS RAID0: XFS RAID1: Btrfs RAID1: EXT4 RAID1: F2FS RAID1: XFS raid10-ext4-bb Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads) ASUS PRIME X299-A (1004 BIOS) Intel Sky Lake-E DMI3 Registers 4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16 256GB INTEL SSDPEKKW256G8 + Samsung SSD 960 EVO 500GB NV136 6144MB Realtek ALC1220 Acer B286HK Intel Connection Ubuntu 18.04 4.16.0-999-generic (x86_64) 20180324 GNOME Shell 3.28.0 X Server 1.19.6 4.3 Mesa 18.0.0-rc5 GCC 7.3.0 btrfs 3840x2160 ext4 f2fs xfs 256GB INTEL SSDPEKKW256G8 + 2 x Samsung SSD 960 EVO 500GB btrfs ext4 f2fs xfs btrfs ext4 f2fs xfs 4 x Intel Xeon E5-2667 v2 @ 3.30GHz (8 Cores) Intel 440BX (6.00 BIOS) Intel 440BX/ZX/DX 2 x 16384 MB DRAM 21GB Virtual disk + 512GB M4-CT512M4SSD2 + 3 x 750GB GB0750C4414 + 750GB Seagate ST3750640AS + 4001GB Western Digital WD4002FYYZ-0 + 2000GB Western Digital WD2000F9YZ-0 + 2000GB Hitachi HDS72302 + 1000GB SAMSUNG HD103SJ + 1000GB Western Digital WD1002FBYS-0 + 2 x Samsung SSD 970 PRO 512GB VMware SVGA II VMware VMXNET3 Debian 9.6 4.9.0-8-amd64 (x86_64) GCC 6.3.0 20170516 ext4 1176x885 VMware OpenBenchmarking.org Compiler Details - Single: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Single: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Single: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Single: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID0: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID0: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID0: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID0: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID1: Btrfs: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID1: EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID1: F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - RAID1: XFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - raid10-ext4-bb: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v Disk Details - Single: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 - Single: EXT4: NONE / data=ordered,relatime,rw - Single: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - Single: XFS: NONE / attr2,inode64,noquota,relatime,rw - RAID0: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0 - RAID0: EXT4: NONE / data=ordered,relatime,rw,stripe=256 / raid0 nvme2n1[1] nvme1n1[0] - RAID0: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 nvme2n1[1] nvme1n1[0] - RAID0: XFS: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid0 nvme2n1[1] nvme1n1[0] - RAID1: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1 - RAID1: EXT4: NONE / data=ordered,relatime,rw / raid1 nvme2n1[1] nvme1n1[0] - RAID1: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 nvme1n1[1] nvme2n1[0] - RAID1: XFS: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme1n1[0] nvme2n1[1] - raid10-ext4-bb: none / data=ordered,errors=remount-ro,relatime,rw Processor Details - Single: Btrfs, Single: EXT4, Single: F2FS, Single: XFS, RAID0: Btrfs, RAID0: EXT4, RAID0: F2FS, RAID0: XFS, RAID1: Btrfs, RAID1: EXT4, RAID1: F2FS, RAID1: XFS: Scaling Governor: intel_pstate powersave Python Details - Single: Btrfs: Python 2.7.14+ + Python 3.6.5rc1 - Single: EXT4: Python 2.7.14+ + Python 3.6.5rc1 - Single: F2FS: Python 2.7.14+ + Python 3.6.5rc1 - Single: XFS: Python 2.7.14+ + Python 3.6.5rc1 - RAID0: Btrfs: Python 2.7.14+ + Python 3.6.5rc1 - RAID0: EXT4: Python 2.7.14+ + Python 3.6.5rc1 - RAID0: F2FS: Python 2.7.14+ + Python 3.6.5rc1 - RAID0: XFS: Python 2.7.14+ + Python 3.6.5rc1 - RAID1: Btrfs: Python 2.7.14+ + Python 3.6.5rc1 - RAID1: EXT4: Python 2.7.14+ + Python 3.6.5rc1 - RAID1: F2FS: Python 2.7.14+ + Python 3.6.5rc1 - RAID1: XFS: Python 2.7.14+ + Python 3.6.5rc1 - raid10-ext4-bb: Python 2.7.13 + Python 3.5.3 Security Details - Single: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection - Single: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection - Single: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection - Single: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID0: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID0: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID0: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID0: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID1: Btrfs: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID1: EXT4: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID1: F2FS: KPTI + __user pointer sanitization + Full generic retpoline Protection - RAID1: XFS: KPTI + __user pointer sanitization + Full generic retpoline Protection - raid10-ext4-bb: KPTI + __user pointer sanitization + Full generic retpoline + PTE Inversion
Samsung 960 EVO Linux RAID Benchmarks sqlite: Timed SQLite Insertions fio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directory fs-mark: 1000 Files, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size blogbench: Write dbench: 12 iozone: 1MB - 8GB - Write Performance iozone: 4Kb - 8GB - Write Performance compilebench: Compile compilebench: Initial Create unpack-linux: linux-4.15.tar.xz compress-gzip: Linux Source Tree Archiving To .tar.gz pgbench: Mostly RAM - Normal Load - Read Only pgbench: Mostly RAM - Normal Load - Read Write osbench: Create Files Single: Btrfs Single: EXT4 Single: F2FS Single: XFS RAID0: Btrfs RAID0: EXT4 RAID0: F2FS RAID0: XFS RAID1: Btrfs RAID1: EXT4 RAID1: F2FS RAID1: XFS raid10-ext4-bb 111.58 1146 505 942 631 160.83 222.05 139.90 5401 311 729 738 1754 286 5.74 34.97 108581 4303 27.11 45.11 1171 1586 2723 1826 173.57 229.80 104.00 27330 354 678 670 1205 638 5.20 34.96 112451 5281 12.65 43.24 1146 1552 2909 1763 295.53 258.47 179.75 7444 136 596 388 1310 642 5.59 34.42 112571 3457 20.42 44.05 1152 1564 2872 1780 184.90 208.80 104.43 6292 334 863 860 1399 520 6.04 34.54 93889 5527 35.54 110.45 2159 1551 2176 1581 164.90 446.53 110.52 5337 341 2180 1872 3011 328 5.70 33.99 201195 3534 27.19 50.90 2747 3369 5745 3642 177.67 356.27 122.98 48714 374 1359 1311 2159 661 5.37 34.91 207377 6255 12.54 43.28 2319 3349 2321 3598 326.50 416.85 220.92 8643 140 1355 1257 2455 706 5.62 33.61 206822 5968 21.10 45.14 2402 3369 5180 3643 195.50 426.57 191.87 2862 281 2370 2360 2974 544 6.64 33.75 218391 6555 44.03 113.25 1127 727 1105 712 164.97 247.07 108.52 5380 472 1626 1568 2007 268 5.71 35.24 204956 5185 27.83 165.92 1698 605 2802 612 116.02 143.33 46.82 14078 299 291 536 1037 628 5.45 35.87 209073 3409 12.70 47.55 2357 1576 4546 1822 282.70 272.98 164.03 8307 124 564 337 1266 494 5.72 34.38 216445 3040 21.09 47.52 2305 1570 4548 1821 173.73 214.22 99.77 5316 144 1086 1499 1815 519 6.49 34.26 226604 5437 49.31 47.42 6034 2223 5926 2228 10049 589 1407 1132 1425 275 6.44 39.56 58950 3860 22.78 OpenBenchmarking.org
SQLite Timed SQLite Insertions OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.22 Timed SQLite Insertions Single: F2FS RAID0: F2FS Single: XFS Single: EXT4 RAID0: XFS raid10-ext4-bb RAID1: XFS RAID1: F2FS RAID0: EXT4 RAID0: Btrfs Single: Btrfs RAID1: Btrfs RAID1: EXT4 40 80 120 160 200 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.25, N = 3 SE +/- 0.24, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.36, N = 3 SE +/- 0.77, N = 3 SE +/- 0.08, N = 3 SE +/- 0.30, N = 3 SE +/- 0.05, N = 3 SE +/- 0.26, N = 3 43.24 43.28 44.05 45.11 45.14 47.42 47.52 47.55 50.90 110.45 111.58 113.25 165.92 -lz 1. (CC) gcc options: -O2 -ldl -lpthread
Flexible IO Tester Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory raid10-ext4-bb RAID0: EXT4 RAID0: XFS RAID1: F2FS RAID0: F2FS RAID1: XFS RAID0: Btrfs RAID1: EXT4 Single: EXT4 Single: XFS Single: F2FS Single: Btrfs RAID1: Btrfs 1300 2600 3900 5200 6500 SE +/- 49.93, N = 3 SE +/- 291.88, N = 6 SE +/- 10.87, N = 3 SE +/- 2.31, N = 3 SE +/- 0.33, N = 3 6034 2747 2402 2357 2319 2305 2159 1698 1171 1152 1146 1146 1127 -lz 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
Flexible IO Tester Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory RAID0: XFS RAID0: EXT4 RAID0: F2FS raid10-ext4-bb Single: EXT4 RAID1: F2FS RAID1: XFS Single: XFS Single: F2FS RAID0: Btrfs RAID1: Btrfs RAID1: EXT4 Single: Btrfs 700 1400 2100 2800 3500 SE +/- 2.08, N = 3 SE +/- 1.45, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 3.71, N = 3 SE +/- 3.53, N = 3 SE +/- 1.67, N = 3 SE +/- 4.04, N = 3 SE +/- 0.88, N = 3 SE +/- 178.74, N = 6 SE +/- 88.05, N = 6 SE +/- 1.15, N = 3 SE +/- 59.31, N = 6 3369 3369 3349 2223 1586 1576 1570 1564 1552 1551 727 605 505 -lz 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory raid10-ext4-bb RAID0: EXT4 RAID0: XFS RAID1: XFS RAID1: F2FS Single: F2FS Single: XFS RAID1: EXT4 Single: EXT4 RAID0: F2FS RAID0: Btrfs RAID1: Btrfs Single: Btrfs 1300 2600 3900 5200 6500 SE +/- 20.53, N = 3 SE +/- 1.15, N = 3 SE +/- 1.76, N = 3 SE +/- 0.58, N = 3 SE +/- 7.69, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 5926 5745 5180 4548 4546 2909 2872 2802 2723 2321 2176 1105 942 -lz 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory RAID0: XFS RAID0: EXT4 RAID0: F2FS raid10-ext4-bb Single: EXT4 RAID1: F2FS RAID1: XFS Single: XFS Single: F2FS RAID0: Btrfs RAID1: Btrfs Single: Btrfs RAID1: EXT4 800 1600 2400 3200 4000 SE +/- 1.20, N = 3 SE +/- 3.06, N = 3 SE +/- 2.91, N = 3 SE +/- 1.20, N = 3 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 0.67, N = 3 SE +/- 1.20, N = 3 SE +/- 1.86, N = 3 SE +/- 226.33, N = 6 SE +/- 93.04, N = 6 SE +/- 7.51, N = 3 SE +/- 5.17, N = 3 3643 3642 3598 2228 1826 1822 1821 1780 1763 1581 712 631 612 -lz 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
FS-Mark Test: 1000 Files, 1MB Size RAID0 Single RAID1 OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size F2FS XFS EXT4 Btrfs 70 140 210 280 350 SE +/- 1.77, N = 3 SE +/- 1.25, N = 3 SE +/- 1.59, N = 3 SE +/- 2.30, N = 3 SE +/- 0.53, N = 3 SE +/- 0.38, N = 3 SE +/- 1.62, N = 3 SE +/- 0.52, N = 3 SE +/- 0.95, N = 3 SE +/- 0.63, N = 3 SE +/- 0.19, N = 3 SE +/- 15.94, N = 6 326.50 195.50 177.67 164.90 295.53 184.90 173.57 160.83 282.70 173.73 164.97 116.02 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads RAID0 RAID1 Single OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Btrfs XFS F2FS EXT4 100 200 300 400 500 SE +/- 62.72, N = 6 SE +/- 3.54, N = 3 SE +/- 84.68, N = 6 SE +/- 64.94, N = 6 SE +/- 57.28, N = 6 SE +/- 35.15, N = 6 SE +/- 27.22, N = 6 SE +/- 1.75, N = 3 SE +/- 17.62, N = 6 SE +/- 22.41, N = 6 SE +/- 13.06, N = 6 SE +/- 8.47, N = 6 446.53 426.57 416.85 356.27 272.98 247.07 214.22 143.33 258.47 229.80 222.05 208.80 1. (CC) gcc options: -static
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size RAID0 Single RAID1 OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size F2FS XFS Btrfs EXT4 50 100 150 200 250 SE +/- 28.10, N = 6 SE +/- 0.54, N = 3 SE +/- 12.91, N = 6 SE +/- 11.85, N = 6 SE +/- 16.19, N = 6 SE +/- 6.90, N = 6 SE +/- 7.34, N = 6 SE +/- 8.87, N = 6 SE +/- 15.78, N = 6 SE +/- 8.51, N = 6 SE +/- 7.22, N = 6 SE +/- 6.58, N = 6 220.92 191.87 122.98 110.52 179.75 139.90 104.43 104.00 164.03 108.52 99.77 46.82 1. (CC) gcc options: -static
BlogBench Test: Write OpenBenchmarking.org Final Score, More Is Better BlogBench 1.0 Test: Write RAID0: EXT4 Single: EXT4 RAID1: EXT4 raid10-ext4-bb RAID0: F2FS RAID1: F2FS Single: F2FS Single: XFS Single: Btrfs RAID1: Btrfs RAID0: Btrfs RAID1: XFS RAID0: XFS 10K 20K 30K 40K 50K SE +/- 262.80, N = 3 SE +/- 1288.79, N = 6 SE +/- 184.39, N = 3 SE +/- 13.98, N = 3 SE +/- 133.68, N = 4 SE +/- 690.66, N = 6 SE +/- 709.05, N = 6 SE +/- 31.78, N = 3 SE +/- 12.41, N = 3 SE +/- 46.46, N = 3 SE +/- 37.47, N = 3 SE +/- 90.65, N = 3 SE +/- 306.61, N = 6 48714 27330 14078 10049 8643 8307 7444 6292 5401 5380 5337 5316 2862 1. (CC) gcc options: -O2 -pthread
Dbench Client Count: 12 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 12 raid10-ext4-bb RAID1: Btrfs RAID0: EXT4 Single: EXT4 RAID0: Btrfs Single: XFS Single: Btrfs RAID1: EXT4 RAID0: XFS RAID1: XFS RAID0: F2FS Single: F2FS RAID1: F2FS 130 260 390 520 650 SE +/- 1.45, N = 3 SE +/- 1.17, N = 3 SE +/- 3.95, N = 3 SE +/- 3.12, N = 3 SE +/- 1.94, N = 3 SE +/- 21.09, N = 6 SE +/- 2.88, N = 3 SE +/- 1.44, N = 3 SE +/- 13.23, N = 6 SE +/- 4.17, N = 6 SE +/- 0.09, N = 3 SE +/- 0.74, N = 3 SE +/- 1.17, N = 3 589 472 374 354 341 334 311 299 281 144 140 136 124 1. (CC) gcc options: -lpopt -O2
IOzone Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance RAID0: XFS RAID0: Btrfs RAID1: Btrfs raid10-ext4-bb RAID0: EXT4 RAID0: F2FS RAID1: XFS Single: XFS Single: Btrfs Single: EXT4 Single: F2FS RAID1: F2FS RAID1: EXT4 500 1000 1500 2000 2500 SE +/- 192.93, N = 6 SE +/- 391.13, N = 6 SE +/- 14.72, N = 3 SE +/- 19.42, N = 6 SE +/- 137.83, N = 6 SE +/- 177.96, N = 6 SE +/- 214.99, N = 6 SE +/- 8.56, N = 3 SE +/- 33.51, N = 6 SE +/- 42.34, N = 6 SE +/- 44.79, N = 6 SE +/- 66.37, N = 6 SE +/- 68.00, N = 6 2370 2180 1626 1407 1359 1355 1086 863 729 678 596 564 291 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance RAID0: XFS RAID0: Btrfs RAID1: Btrfs RAID1: XFS RAID0: EXT4 RAID0: F2FS raid10-ext4-bb Single: XFS Single: Btrfs Single: EXT4 RAID1: EXT4 Single: F2FS RAID1: F2FS 500 1000 1500 2000 2500 SE +/- 36.42, N = 3 SE +/- 5.51, N = 3 SE +/- 8.75, N = 3 SE +/- 15.99, N = 3 SE +/- 101.51, N = 6 SE +/- 87.51, N = 6 SE +/- 14.69, N = 7 SE +/- 4.43, N = 3 SE +/- 44.62, N = 6 SE +/- 41.99, N = 6 SE +/- 23.19, N = 6 SE +/- 75.22, N = 6 SE +/- 52.07, N = 6 2360 1872 1568 1499 1311 1257 1132 860 738 670 536 388 337 1. (CC) gcc options: -O3
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile RAID0: Btrfs RAID0: XFS RAID0: F2FS RAID0: EXT4 RAID1: Btrfs RAID1: XFS Single: Btrfs raid10-ext4-bb Single: XFS Single: F2FS RAID1: F2FS Single: EXT4 RAID1: EXT4 600 1200 1800 2400 3000 SE +/- 44.00, N = 3 SE +/- 95.92, N = 6 SE +/- 210.26, N = 6 SE +/- 61.58, N = 6 SE +/- 134.93, N = 6 SE +/- 120.63, N = 6 SE +/- 55.85, N = 6 SE +/- 16.81, N = 3 SE +/- 50.02, N = 6 SE +/- 16.67, N = 3 SE +/- 16.55, N = 3 SE +/- 57.92, N = 6 SE +/- 70.69, N = 6 3011 2974 2455 2159 2007 1815 1754 1425 1399 1310 1266 1205 1037
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create RAID0: F2FS RAID0: EXT4 Single: F2FS Single: EXT4 RAID1: EXT4 RAID0: XFS Single: XFS RAID1: XFS RAID1: F2FS RAID0: Btrfs Single: Btrfs raid10-ext4-bb RAID1: Btrfs 150 300 450 600 750 SE +/- 4.53, N = 3 SE +/- 3.32, N = 3 SE +/- 35.40, N = 3 SE +/- 9.29, N = 3 SE +/- 8.70, N = 3 SE +/- 2.83, N = 3 SE +/- 4.60, N = 3 SE +/- 1.88, N = 3 SE +/- 20.47, N = 3 SE +/- 10.30, N = 3 SE +/- 7.15, N = 3 SE +/- 2.70, N = 3 SE +/- 1.71, N = 3 706 661 642 638 628 544 520 519 494 328 286 275 268
Unpacking The Linux Kernel linux-4.15.tar.xz OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-4.15.tar.xz Single: EXT4 RAID0: EXT4 RAID1: EXT4 Single: F2FS RAID0: F2FS RAID0: Btrfs RAID1: Btrfs RAID1: F2FS Single: Btrfs Single: XFS raid10-ext4-bb RAID1: XFS RAID0: XFS 2 4 6 8 10 SE +/- 0.01, N = 4 SE +/- 0.07, N = 4 SE +/- 0.01, N = 4 SE +/- 0.04, N = 4 SE +/- 0.04, N = 4 SE +/- 0.05, N = 4 SE +/- 0.04, N = 4 SE +/- 0.02, N = 4 SE +/- 0.03, N = 4 SE +/- 0.15, N = 8 SE +/- 0.03, N = 4 SE +/- 0.16, N = 8 SE +/- 0.15, N = 8 5.20 5.37 5.45 5.59 5.62 5.70 5.71 5.72 5.74 6.04 6.44 6.49 6.64
Gzip Compression Linux Source Tree Archiving To .tar.gz OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression Linux Source Tree Archiving To .tar.gz RAID0: F2FS RAID0: XFS RAID0: Btrfs RAID1: XFS RAID1: F2FS Single: F2FS Single: XFS RAID0: EXT4 Single: EXT4 Single: Btrfs RAID1: Btrfs RAID1: EXT4 raid10-ext4-bb 9 18 27 36 45 SE +/- 0.41, N = 3 SE +/- 0.53, N = 3 SE +/- 0.47, N = 6 SE +/- 0.51, N = 4 SE +/- 0.53, N = 4 SE +/- 0.50, N = 5 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.47, N = 3 SE +/- 0.58, N = 4 SE +/- 0.54, N = 3 SE +/- 0.26, N = 3 33.61 33.75 33.99 34.26 34.38 34.42 34.54 34.91 34.96 34.97 35.24 35.87 39.56
PostgreSQL pgbench Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only RAID1: XFS RAID0: XFS RAID1: F2FS RAID1: EXT4 RAID0: EXT4 RAID0: F2FS RAID1: Btrfs RAID0: Btrfs Single: F2FS Single: EXT4 Single: Btrfs Single: XFS raid10-ext4-bb 50K 100K 150K 200K 250K SE +/- 62.04, N = 3 SE +/- 141.88, N = 3 226604 218391 216445 209073 207377 206822 204956 201195 112571 112451 108581 93889 58950 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
PostgreSQL pgbench Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write RAID0: XFS RAID0: EXT4 RAID0: F2FS Single: XFS RAID1: XFS Single: EXT4 RAID1: Btrfs Single: Btrfs raid10-ext4-bb RAID0: Btrfs Single: F2FS RAID1: EXT4 RAID1: F2FS 1400 2800 4200 5600 7000 SE +/- 8.97, N = 3 SE +/- 95.10, N = 4 6555 6255 5968 5527 5437 5281 5185 4303 3860 3534 3457 3409 3040 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
OSBench Test: Create Files OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Files RAID0: EXT4 Single: EXT4 RAID1: EXT4 Single: F2FS RAID1: F2FS RAID0: F2FS raid10-ext4-bb Single: Btrfs RAID0: Btrfs RAID1: Btrfs Single: XFS RAID0: XFS RAID1: XFS 11 22 33 44 55 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 1.45, N = 6 SE +/- 1.55, N = 6 SE +/- 1.52, N = 6 SE +/- 0.45, N = 3 SE +/- 0.19, N = 3 SE +/- 0.16, N = 3 SE +/- 0.36, N = 3 SE +/- 2.58, N = 6 SE +/- 4.57, N = 6 SE +/- 5.88, N = 6 12.54 12.65 12.70 20.42 21.09 21.10 22.78 27.11 27.19 27.83 35.54 44.03 49.31 -lm -lm -lm -lm -lm -lm -lm -lm -lm -lm -lm 1. (CC) gcc options:
Phoronix Test Suite v10.8.4