Samsung Quad NVMe SSD RAID Btrfs EXT4 XFS 4-Disk Linux Benchmarks

Btrfs, XFS, EXT4 4-disk NVMe RAID Linux benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1808205-RA-SAMSUNGQU86&grs&sro.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionBtrfsEXT4XFS Single Disk 4-Disk RAID0 4-Disk RAID1 4-Disk RAID5 4-Disk RAID6 4-Disk RAID10 Single Disk 4-Disk RAID0 4-Disk RAID1 4-Disk RAID5 4-Disk RAID6 4-Disk RAID10 Single Disk 4-Disk RAID0 4-Disk RAID1 4-Disk RAID5 4-Disk RAID6 4-Disk RAID10AMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads)MSI MEG X399 CREATION (MS-7B92) v1.0 (1.10 BIOS)AMD Family 17h4 x 8192 MB DDR4-1600MT/s F4-3200C14-8GTZR4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100NV132 11264MBRealtek ALC1220ASUS PB278Intel I211 Gigabit Connection + Intel Device 2526Ubuntu 18.044.18.1-041801-generic (x86_64)GNOME Shell 3.28.2X Server 1.19.64.3 Mesa 18.0.5GCC 7.3.0btrfs2560x1440240GB TOSHIBA-RC100 + 4 x Samsung SSD 970 EVO 250GB4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100ext4240GB TOSHIBA-RC100 + 4 x Samsung SSD 970 EVO 250GB4 x Samsung SSD 970 EVO 250GB + 240GB TOSHIBA-RC100xfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -vDisk Details- Btrfs: Single Disk: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Btrfs: 4-Disk RAID0: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- Btrfs: 4-Disk RAID1: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- Btrfs: 4-Disk RAID5: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID5- Btrfs: 4-Disk RAID6: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID6- Btrfs: 4-Disk RAID10: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- EXT4: Single Disk: NONE / relatime,rw- EXT4: 4-Disk RAID0: NONE / relatime,rw,stripe=512 / raid0 nvme4n1[3] nvme3n1[2] nvme2n1[1] nvme0n1[0]- EXT4: 4-Disk RAID1: NONE / relatime,rw / raid1 nvme4n1[3] nvme3n1[2] nvme2n1[1] nvme1n1[0]- EXT4: 4-Disk RAID5: NONE / relatime,rw,stripe=384 / raid5 nvme4n1[4] nvme0n1[2] nvme2n1[1] nvme1n1[0]- EXT4: 4-Disk RAID6: NONE / relatime,rw,stripe=256 / raid6 nvme4n1[3] nvme0n1[2] nvme3n1[1] nvme1n1[0]- EXT4: 4-Disk RAID10: NONE / relatime,rw,stripe=256 / raid10 nvme2n1[3] nvme0n1[2] nvme3n1[1] nvme1n1[0]- XFS: Single Disk: NONE / attr2,inode64,noquota,relatime,rw- XFS: 4-Disk RAID0: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=4096 / raid0 nvme0n1[2] nvme4n1[0] nvme1n1[3] nvme3n1[1]- XFS: 4-Disk RAID1: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme2n1[3] nvme0n1[2] nvme3n1[1] nvme1n1[0]- XFS: 4-Disk RAID5: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=3072 / raid5 nvme2n1[4] nvme0n1[2] nvme3n1[1] nvme1n1[0]- XFS: 4-Disk RAID6: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid6 nvme4n1[3] nvme0n1[2] nvme3n1[1] nvme1n1[0]- XFS: 4-Disk RAID10: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid10 nvme2n1[3] nvme0n1[2] nvme3n1[1] nvme1n1[0]Processor Details- Btrfs: Single Disk: Scaling Governor: acpi-cpufreq performance- Btrfs: 4-Disk RAID0: Scaling Governor: acpi-cpufreq performance- Btrfs: 4-Disk RAID1: Scaling Governor: acpi-cpufreq performance- Btrfs: 4-Disk RAID5: Scaling Governor: acpi-cpufreq performance- Btrfs: 4-Disk RAID6: Scaling Governor: acpi-cpufreq performance- Btrfs: 4-Disk RAID10: Scaling Governor: acpi-cpufreq performance- EXT4: Single Disk: Scaling Governor: acpi-cpufreq performance- EXT4: 4-Disk RAID0: Scaling Governor: acpi-cpufreq performance- EXT4: 4-Disk RAID1: Scaling Governor: acpi-cpufreq performance- EXT4: 4-Disk RAID5: Scaling Governor: acpi-cpufreq performance- EXT4: 4-Disk RAID6: Scaling Governor: acpi-cpufreq performance- EXT4: 4-Disk RAID10: Scaling Governor: acpi-cpufreq performance- XFS: Single Disk: Scaling Governor: acpi-cpufreq performance- XFS: 4-Disk RAID0: Scaling Governor: acpi-cpufreq performance- XFS: 4-Disk RAID1: Scaling Governor: acpi-cpufreq ondemand- XFS: 4-Disk RAID5: Scaling Governor: acpi-cpufreq performance- XFS: 4-Disk RAID6: Scaling Governor: acpi-cpufreq performance- XFS: 4-Disk RAID10: Scaling Governor: acpi-cpufreq performancePython Details- Python 2.7.15rc1 + Python 3.6.5Security Details- __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp Protection

sqlite: Timed SQLite Insertionspgbench: Buffer Test - Normal Load - Read Writefio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directorycompilebench: Initial Createfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directorybuild-llvm: Time To Compileblogbench: Writefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test DirectoryBtrfsEXT4XFS Single Disk 4-Disk RAID0 4-Disk RAID1 4-Disk RAID5 4-Disk RAID6 4-Disk RAID10 Single Disk 4-Disk RAID0 4-Disk RAID1 4-Disk RAID5 4-Disk RAID6 4-Disk RAID10 Single Disk 4-Disk RAID0 4-Disk RAID1 4-Disk RAID5 4-Disk RAID6 4-Disk RAID1087.956439.572950565406257.30185310.017469115.92190.21246.0035942996.635750.223040754494351.9997.64317.858178242.57579.90230.271561155794.985695.545951598532286.2098.26316.117892225.93360.84215.78722595104.485080.611858741515342.3494.92320.228298202.13481.40197.6311681127106.725108.941178734525324.47100.07311.548529126.41296.65200.2280579199.895838.731636742546282.0095.90326.117845201.83297.67234.3371483737.184529.772944557410509.911034312.141137151.50164.04235.671464146438.3514178.01312122361053518.96971309.4059966221.70628.80248.2358575861254.723762.29631951496.32418314.021416641.4658.44128.5814071461147.136855.3628472229965517.62324320.421241053.97151.73159.3316711123220.864774.75319922091003507.69322322.50851046.4392.36172.971427139343.988138.8946191528900527.37605319.0842006100.51224.61212.402928280437.189760.222933558424407.53766317.66663595.73203.23234.101465146536.7419179.77311622351033421.41746322.177875257.10560.47258.6358615864274.073411.48632717398.68378309.70259042.0262.13167.9614331153173.677243.5813022227652431.41226.23309.85435492.11113.47168.64169296073.7410370.5935462231963420.45225327.626432165.97136.40122.881384139142.4116975.7715721097818422.16525312.987015124.94231.71230.4529282926OpenBenchmarking.org

SQLite

Timed SQLite Insertions

BtrfsEXT4XFSOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite Insertions4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk60120180240300SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.61, N = 3SE +/- 1.02, N = 3SE +/- 0.22, N = 3SE +/- 0.34, N = 3SE +/- 44.93, N = 6SE +/- 0.49, N = 3SE +/- 24.74, N = 9SE +/- 61.44, N = 9SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 3.40, N = 3SE +/- 0.18, N = 3SE +/- 2.86, N = 3SE +/- 0.74, N = 3SE +/- 0.03, N = 396.6394.9899.89104.48106.7287.9538.35254.7243.98147.13220.8637.1836.74274.0742.41173.6773.7437.181. (CC) gcc options: -O2 -lz -ldl -lpthread

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

BtrfsEXT4XFSOpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read Write4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk4K8K12K16K20KSE +/- 76.10, N = 9SE +/- 61.63, N = 3SE +/- 40.83, N = 3SE +/- 23.00, N = 3SE +/- 30.04, N = 3SE +/- 108.69, N = 4SE +/- 36.92, N = 3SE +/- 113.55, N = 12SE +/- 132.14, N = 4SE +/- 103.93, N = 5SE +/- 67.03, N = 12SE +/- 113.42, N = 12SE +/- 151.20, N = 3SE +/- 94.69, N = 12SE +/- 34.14, N = 3SE +/- 118.72, N = 3SE +/- 137.28, N = 3SE +/- 793.61, N = 95750.225695.545838.735080.615108.946439.5714178.013762.298138.896855.364774.754529.7719179.773411.4816975.777243.5810370.599760.221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk13002600390052006500SE +/- 0.67, N = 3SE +/- 4.10, N = 3SE +/- 30.03, N = 12SE +/- 8.00, N = 3SE +/- 45.06, N = 3SE +/- 93.22, N = 12SE +/- 40.44, N = 6SE +/- 300.67, N = 9SE +/- 8.00, N = 3SE +/- 31.27, N = 12SE +/- 24.06, N = 3SE +/- 55.70, N = 12SE +/- 13.28, N = 330405951163618581178295031214619284731992944311615721302354629331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk5001000150020002500SE +/- 7.36, N = 3SE +/- 0.33, N = 3SE +/- 10.27, N = 3SE +/- 7.20, N = 12SE +/- 12.81, N = 3SE +/- 1.33, N = 3SE +/- 0.33, N = 3SE +/- 72.07, N = 12SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 8.88, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3754598742741734565223663115282229220955722356321097222722315581. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk2004006008001000SE +/- 6.75, N = 6SE +/- 4.48, N = 3SE +/- 4.91, N = 3SE +/- 6.19, N = 12SE +/- 8.90, N = 4SE +/- 17.80, N = 3SE +/- 8.41, N = 3SE +/- 12.95, N = 12SE +/- 10.81, N = 3SE +/- 2.00, N = 3SE +/- 5.84, N = 3SE +/- 64.94, N = 9SE +/- 12.57, N = 3SE +/- 7.69, N = 12SE +/- 10.81, N = 34945325465155254061053951900965100341010337178186529634241. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk60K120K180K240K300KSE +/- 1765.41, N = 6SE +/- 1201.85, N = 3SE +/- 1154.70, N = 3SE +/- 1639.17, N = 12SE +/- 2362.91, N = 4SE +/- 4484.54, N = 3SE +/- 2403.70, N = 3SE +/- 3289.39, N = 12SE +/- 2728.45, N = 3SE +/- 333.33, N = 3SE +/- 1666.67, N = 3SE +/- 16582.29, N = 9SE +/- 2962.73, N = 3SE +/- 1984.79, N = 12SE +/- 2848.00, N = 31265001363331400001316671345001040002693332433332302502473332566671050002643331836672093331670002466671090001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Test: Initial Create

BtrfsEXT4XFSOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Create4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk110220330440550SE +/- 4.17, N = 3SE +/- 0.79, N = 3SE +/- 3.82, N = 3SE +/- 3.07, N = 3SE +/- 4.37, N = 3SE +/- 6.72, N = 3SE +/- 6.95, N = 3SE +/- 4.37, N = 3SE +/- 6.25, N = 3SE +/- 2.34, N = 3SE +/- 7.46, N = 3SE +/- 4.44, N = 3SE +/- 5.74, N = 3SE +/- 4.22, N = 3SE +/- 2.17, N = 3SE +/- 7.08, N = 3SE +/- 7.19, N = 3SE +/- 2.68, N = 3351.99286.20282.00342.34324.47257.30518.96496.32527.37517.62507.69509.91421.41398.68422.16431.41420.45407.53

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk2004006008001000SE +/- 5.17, N = 9SE +/- 1.17, N = 8SE +/- 1.64, N = 3SE +/- 1.32, N = 5SE +/- 0.47, N = 3SE +/- 8.29, N = 9SE +/- 4.18, N = 3SE +/- 6.02, N = 12SE +/- 6.82, N = 12SE +/- 3.76, N = 12SE +/- 1.00, N = 3SE +/- 15.19, N = 3SE +/- 4.04, N = 3SE +/- 0.67, N = 3SE +/- 3.71, N = 3SE +/- 23.49, N = 9SE +/- 7.92, N = 9SE +/- 4.62, N = 397.6498.2695.9094.92100.07185.00971.00418.00605.00324.00322.001034.00746.00378.00525.00226.23225.00766.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk60K120K180K240K300KSE +/- 1346.06, N = 9SE +/- 350.00, N = 8SE +/- 425.57, N = 3SE +/- 330.15, N = 5SE +/- 100.00, N = 3SE +/- 2131.39, N = 9SE +/- 1201.85, N = 3SE +/- 1543.26, N = 12SE +/- 1744.40, N = 12SE +/- 959.04, N = 12SE +/- 233.33, N = 3SE +/- 3844.19, N = 3SE +/- 1000.00, N = 3SE +/- 145.30, N = 3SE +/- 881.92, N = 3SE +/- 6021.46, N = 9SE +/- 2018.39, N = 9SE +/- 1154.70, N = 324878249002453324300256004745624866710700015483382908824672643331910009663313433357922576001960001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Timed LLVM Compilation

Time To Compile

BtrfsEXT4XFSOpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 6.0.1Time To Compile4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk70140210280350317.85316.11326.11320.22311.54310.01309.40314.02319.08320.42322.50312.14322.17309.70312.98309.85327.62317.66

BlogBench

Test: Write

BtrfsEXT4XFSOpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Write4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk13K26K39K52K65KSE +/- 18.62, N = 3SE +/- 165.49, N = 3SE +/- 21.94, N = 3SE +/- 58.77, N = 3SE +/- 102.03, N = 3SE +/- 107.74, N = 3SE +/- 1792.53, N = 9SE +/- 439.67, N = 9SE +/- 581.82, N = 5SE +/- 242.60, N = 9SE +/- 115.40, N = 3SE +/- 216.73, N = 3SE +/- 690.82, N = 9SE +/- 77.14, N = 9SE +/- 108.97, N = 3SE +/- 92.16, N = 9SE +/- 237.19, N = 9SE +/- 125.34, N = 9817878927845829885297469599661416642006124108510113717875259070154354643266351. (CC) gcc options: -O2 -pthread

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

BtrfsEXT4XFSOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Size4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk60120180240300SE +/- 0.47, N = 3SE +/- 0.58, N = 3SE +/- 8.29, N = 12SE +/- 0.62, N = 3SE +/- 6.44, N = 12SE +/- 4.67, N = 9SE +/- 2.74, N = 3SE +/- 2.19, N = 9SE +/- 3.17, N = 12SE +/- 0.54, N = 12SE +/- 0.69, N = 3SE +/- 2.79, N = 12SE +/- 0.23, N = 3SE +/- 0.80, N = 12SE +/- 12.64, N = 12SE +/- 8.90, N = 12SE +/- 1.50, N = 3SE +/- 3.20, N = 12242.57225.93201.83202.13126.41115.92221.7041.46100.5153.9746.4351.50257.1042.02124.9492.11165.9795.731. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

BtrfsEXT4XFSOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threads4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk140280420560700SE +/- 1.65, N = 3SE +/- 46.97, N = 9SE +/- 38.84, N = 12SE +/- 4.53, N = 3SE +/- 34.01, N = 12SE +/- 8.97, N = 9SE +/- 5.09, N = 9SE +/- 29.41, N = 12SE +/- 20.97, N = 9SE +/- 8.86, N = 9SE +/- 18.25, N = 9SE +/- 10.92, N = 3SE +/- 3.75, N = 9SE +/- 28.36, N = 12SE +/- 1.87, N = 3SE +/- 2.70, N = 3SE +/- 11.07, N = 12579.90360.84297.67481.40296.65190.21628.8058.44224.61151.7392.36164.04560.4762.13231.71113.47136.40203.231. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

BtrfsEXT4XFSOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk60120180240300SE +/- 11.85, N = 9SE +/- 8.07, N = 9SE +/- 0.74, N = 3SE +/- 5.78, N = 11SE +/- 9.26, N = 10SE +/- 0.15, N = 3SE +/- 0.99, N = 3SE +/- 19.57, N = 9SE +/- 3.48, N = 3SE +/- 1.62, N = 3SE +/- 2.28, N = 6SE +/- 0.97, N = 3SE +/- 1.55, N = 3SE +/- 2.96, N = 12SE +/- 3.58, N = 12SE +/- 2.69, N = 12SE +/- 13.76, N = 12SE +/- 1.02, N = 3230.27215.78234.33197.63200.22246.00248.23128.58212.40159.33172.97235.67258.63167.96230.45168.64122.88234.101. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk13002600390052006500SE +/- 117.83, N = 9SE +/- 85.65, N = 9SE +/- 47.78, N = 12SE +/- 113.32, N = 12SE +/- 76.21, N = 12SE +/- 25.05, N = 9SE +/- 30.78, N = 12SE +/- 1.15, N = 3SE +/- 11.84, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3SE +/- 20.47, N = 12SE +/- 1.33, N = 3SE +/- 18.48, N = 3156172271411688053595857140729281671142714645861143329281692138414651. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

BtrfsEXT4XFSOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory4-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6Single Disk13002600390052006500SE +/- 119.38, N = 9SE +/- 88.55, N = 9SE +/- 99.80, N = 12SE +/- 86.10, N = 12SE +/- 61.52, N = 12SE +/- 58.49, N = 9SE +/- 3.33, N = 3SE +/- 25.15, N = 3SE +/- 70.74, N = 10SE +/- 31.17, N = 12SE +/- 114.59, N = 12SE +/- 8.67, N = 3SE +/- 2.31, N = 315575958371127791429586114612804112313931464586411532926960139114651. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.4