Ubuntu Linux RAID 0/1/5/6/10 Disk Testing

RAID mdadm benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel with various file-systems. Benchmarks by Michael Larabel for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1411054-LI-BTRFSRAID55
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Native Btrfs: RAID 0
October 28 2014
 
Native Btrfs: RAID 1
October 28 2014
 
Native Btrfs: RAID 10
October 28 2014
 
Native Btrfs: RAID 5
October 28 2014
 
Native Btrfs: RAID 6
October 29 2014
 
mdadm Btrfs: RAID 0
October 29 2014
 
mdadm Btrfs: RAID 1
October 29 2014
 
mdadm Btrfs: RAID 10
October 29 2014
 
mdadm Btrfs: RAID 5
October 29 2014
 
mdadm Btrfs: RAID 6
October 29 2014
 
mdadm EXT4: RAID 0
October 29 2014
 
mdadm EXT4: RAID 1
October 29 2014
 
mdadm EXT4: RAID 10
October 29 2014
 
mdadm EXT4: RAID 5
October 29 2014
 
mdadm EXT4: RAID 6
October 29 2014
 
mdadm XFS: RAID 0
October 29 2014
 
mdadm XFS: RAID 1
October 29 2014
 
mdadm XFS: RAID 10
October 29 2014
 
mdadm XFS: RAID 5
October 29 2014
 
mdadm XFS: RAID 6
October 30 2014
 
mdadm F2FS: RAID 0
October 30 2014
 
mdadm F2FS: RAID 1
October 30 2014
 
mdadm F2FS: RAID 10
October 30 2014
 
mdadm F2FS: RAID 5
October 30 2014
 
mdadm F2FS: RAID 6
October 30 2014
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Ubuntu Linux RAID 0/1/5/6/10 Disk TestingOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-5960X @ 4.00GHz (16 Cores)Gigabyte X99-UD4-CFIntel Xeon E5 v3/Core16384MB4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MBIntel C610/X99SyncMasterIntel ConnectionUbuntu 14.103.18.0-031800rc1-generic (x86_64)Unity 7.3.1X Server 1.16.0radeon 7.4.03.3 Mesa 10.3.0 Gallium 0.4GCC 4.9.1btrfsext4xfsf2fs2560x1600ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemsScreen ResolutionUbuntu Linux RAID 0/1/5/6/10 Disk Testing BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Native Btrfs: RAID 0: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 1: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 10: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 5: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 6: DEADLINE / relatime,rw,space_cache,ssd- mdadm Btrfs: RAID 0: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 1: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 10: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 5: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 6: DEADLINE / relatime,rw,space_cache- mdadm EXT4: RAID 0: DEADLINE / data=ordered,relatime,rw,stripe=512- mdadm EXT4: RAID 1: DEADLINE / data=ordered,relatime,rw- mdadm EXT4: RAID 10: DEADLINE / data=ordered,relatime,rw,stripe=256- mdadm EXT4: RAID 5: DEADLINE / data=ordered,relatime,rw,stripe=384- mdadm EXT4: RAID 6: DEADLINE / data=ordered,relatime,rw,stripe=256- mdadm XFS: RAID 0: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=4096 - mdadm XFS: RAID 1: DEADLINE / attr2,inode64,noquota,relatime,rw- mdadm XFS: RAID 10: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 - mdadm XFS: RAID 5: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=3072 - mdadm XFS: RAID 6: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 - mdadm F2FS: RAID 0: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr - mdadm F2FS: RAID 1: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr - mdadm F2FS: RAID 10: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr - mdadm F2FS: RAID 5: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr - mdadm F2FS: RAID 6: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr - Scaling Governor: intel_pstate powersave- Disk Scheduler: DEADLINE. Python 2.7.8.

fio: Rand Read - Libaio - No - 16KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - 16KB - Default Test Directory - MB/sfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeiozone: 4Kb - 8GB - Write Performancecompilebench: Initial CreateNative Btrfsmdadm Btrfsmdadm EXT4mdadm XFSmdadm F2FS RAID 0 RAID 1 RAID 10 RAID 5 RAID 6 RAID 0 RAID 1 RAID 10 RAID 5 RAID 6 RAID 0 RAID 1 RAID 10 RAID 5 RAID 6 RAID 0 RAID 1 RAID 10 RAID 5 RAID 6 RAID 0 RAID 1 RAID 10 RAID 5 RAID 6758.26497.23824.97319.4141.4383.7340.731142.43206.74233.00128.00323.80130.3235.1069.0335.63584.85187.72469.10267.48450.78272.1938.3377.0738.50599.32177.54742.06248.93869.68242.5538.8779.8739.17876.77189.59653.54214.56960.89208.9638.2075.4737.73598.43195.02816.02381.45385.3439.6092.0039.431141.18178.31224.69109.22854.98109.9734.0364.0033.43280.39160.58695.44159.53843.68161.9037.8075.6036.93478.65156.97792.61214.31879.09209.6033.3764.7332.10438.55156.21909.98179.73925.05172.7230.4356.8030.63315.85151.64818.33421.37508.7338.9790.4038.731111.26325.18214.45110.32303.30115.3433.9099.5734.80302.75303.04684.95163.86199.9537.0378.1336.80585.30306.37689.39146.07957.59192.8031.1084.0731441.27316.17854.92134.18155.7832.2770.4332.00385.39320.82841.97393.49398.7442.4388.7340.731111.56264.38236.43115.51301.16115.8234.0768.9032.77303.50228.19384.53166.75214.9439.5781.7035.83588.42228.20751.77151.05197.1932.1058.1030.33580.95255.99928.27129.62154.1030.9353.8329.23473.17271.62872.84387.04419.2965.8786.5766.401100.42331.33239.73109.58299.58113.3553.5080.6353.57303.32328.79741.30177.32200.3662.8777.9761.30566.14352.47736.18149.41196.7856.3775.5052.47421.86377.77916.30131.26997.53152.5350.7367.8351.40350.84348.76OpenBenchmarking.org

Flexible IO Tester

MinAvgMaxmdadm EXT4214652855mdadm Btrfs225688910Native Btrfs233571758mdadm XFS236629928mdadm F2FS240701916OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 10RAID 6RAID 5RAID 02004006008001000
mdadm EXT4mdadm BtrfsNative Btrfsmdadm XFSmdadm F2FSOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 10RAID 6RAID 5RAID 0160320480640800Min: 213.24 / Avg: 214.45 / Max: 216.78Min: 669.28 / Avg: 684.95 / Max: 695.3Min: 676.15 / Avg: 689.39 / Max: 699.91Min: 816.05 / Avg: 818.33 / Max: 822.66Min: 835.31 / Avg: 854.92 / Max: 873.64Min: 223.63 / Avg: 224.69 / Max: 226.55Min: 681.46 / Avg: 695.44 / Max: 727.24Min: 789.38 / Avg: 792.61 / Max: 795.36Min: 809.39 / Avg: 816.02 / Max: 827.47Min: 909.19 / Avg: 909.98 / Max: 910.49Min: 231.79 / Avg: 233 / Max: 234.61Min: 444.11 / Avg: 469.1 / Max: 509.6Min: 519 / Avg: 653.54 / Max: 876.56Min: 627.99 / Avg: 742.06 / Max: 932.18Min: 676.41 / Avg: 758.26 / Max: 819.23Min: 236.25 / Avg: 236.43 / Max: 236.62Min: 384.35 / Avg: 384.53 / Max: 384.63Min: 750.56 / Avg: 751.77 / Max: 754.05Min: 839.41 / Avg: 841.97 / Max: 844.1Min: 921.72 / Avg: 928.27 / Max: 935.28Min: 239.5 / Avg: 239.73 / Max: 240.01Min: 726.18 / Avg: 736.18 / Max: 753.96Min: 740.86 / Avg: 741.3 / Max: 741.63Min: 871.66 / Avg: 872.84 / Max: 873.91Min: 915.33 / Avg: 916.3 / Max: 917.691. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

MinAvgMaxmdadm Btrfs109.2208.8381.5mdadm F2FS109.6190.9387.0mdadm EXT4110.3195.2421.4mdadm XFS115.5191.3393.5Native Btrfs128.0271.2497.2OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 6RAID 5RAID 10RAID 0130260390520650
mdadm Btrfsmdadm F2FSmdadm EXT4mdadm XFSNative BtrfsOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 6RAID 5RAID 10RAID 090180270360450Min: 105.21 / Avg: 109.22 / Max: 111.45Min: 156.08 / Avg: 159.53 / Max: 163.48Min: 178.06 / Avg: 179.73 / Max: 182.12Min: 212.25 / Avg: 214.31 / Max: 216.21Min: 376.52 / Avg: 381.45 / Max: 386.46Min: 101.17 / Avg: 109.58 / Max: 116.5Min: 128.1 / Avg: 131.26 / Max: 134.79Min: 148.89 / Avg: 149.41 / Max: 149.82Min: 175.41 / Avg: 177.32 / Max: 180.09Min: 358.91 / Avg: 387.04 / Max: 405.07Min: 107.54 / Avg: 110.32 / Max: 113.36Min: 129.19 / Avg: 134.18 / Max: 138.12Min: 144.95 / Avg: 146.07 / Max: 147.42Min: 162.76 / Avg: 163.86 / Max: 165.88Min: 379.54 / Avg: 421.37 / Max: 437.08Min: 114.51 / Avg: 115.51 / Max: 116.52Min: 127.35 / Avg: 129.62 / Max: 133.39Min: 150.84 / Avg: 151.05 / Max: 151.4Min: 162.99 / Avg: 166.75 / Max: 170.61Min: 389 / Avg: 393.49 / Max: 397.33Min: 127.42 / Avg: 128 / Max: 128.73Min: 208.13 / Avg: 214.56 / Max: 228.12Min: 242.92 / Avg: 248.93 / Max: 265.01Min: 263.46 / Avg: 267.48 / Max: 271.53Min: 441.36 / Avg: 497.23 / Max: 530.751. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

MinAvgMaxmdadm F2FS300649998mdadm XFS301301301mdadm EXT4303630958Native Btrfs324686961mdadm Btrfs844876925OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 10RAID 0RAID 5RAID 62004006008001000
mdadm F2FSmdadm XFSmdadm EXT4Native Btrfsmdadm BtrfsOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 10RAID 0RAID 5RAID 62004006008001000Min: 299.21 / Avg: 299.58 / Max: 299.94Min: 997.06 / Avg: 997.53 / Max: 998Min: 300.99 / Avg: 301.16 / Max: 301.37Min: 302.6 / Avg: 303.3 / Max: 304Min: 951.06 / Avg: 957.59 / Max: 963.33Min: 322.66 / Avg: 323.8 / Max: 325.71Min: 448.04 / Avg: 450.78 / Max: 453.08Min: 760.69 / Avg: 824.97 / Max: 902.14Min: 789.02 / Avg: 869.68 / Max: 999.59Min: 949.67 / Avg: 960.89 / Max: 977.75Min: 818.11 / Avg: 843.68 / Max: 904.63Min: 839.77 / Avg: 854.98 / Max: 864.21Min: 822.86 / Avg: 879.09 / Max: 924.23Min: 918.2 / Avg: 925.05 / Max: 932.711. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

MinAvgMaxmdadm Btrfs110.0207.9385.3mdadm F2FS113.4216.5419.3mdadm EXT4115.3234.5508.7mdadm XFS115.8216.2398.7Native Btrfs130.3234.7319.4OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 6RAID 10RAID 5RAID 0130260390520650
mdadm Btrfsmdadm F2FSmdadm EXT4mdadm XFSNative BtrfsOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 1RAID 6RAID 10RAID 5RAID 090180270360450Min: 107.54 / Avg: 109.97 / Max: 111.79Min: 160.42 / Avg: 161.9 / Max: 163.86Min: 171.19 / Avg: 172.72 / Max: 175.52Min: 208.63 / Avg: 209.6 / Max: 210.46Min: 380.89 / Avg: 385.34 / Max: 389.36Min: 109.61 / Avg: 113.35 / Max: 116.61Min: 149.87 / Avg: 152.53 / Max: 154.41Min: 194.36 / Avg: 196.78 / Max: 198.51Min: 199.98 / Avg: 200.36 / Max: 200.93Min: 410.15 / Avg: 419.29 / Max: 427.01Min: 113.5 / Avg: 115.34 / Max: 118.55Min: 154.21 / Avg: 155.78 / Max: 157.2Min: 192.13 / Avg: 192.8 / Max: 193.53Min: 198.18 / Avg: 199.95 / Max: 201.42Min: 502.4 / Avg: 508.73 / Max: 515.95Min: 114.36 / Avg: 115.82 / Max: 118.39Min: 153.57 / Avg: 154.1 / Max: 154.65Min: 196.6 / Avg: 197.19 / Max: 197.63Min: 201.55 / Avg: 214.94 / Max: 232.13Min: 396.64 / Avg: 398.74 / Max: 402.02Min: 121.03 / Avg: 130.32 / Max: 136.85Min: 207.38 / Avg: 208.96 / Max: 211.35Min: 241.76 / Avg: 242.55 / Max: 243.13Min: 271.08 / Avg: 272.19 / Max: 273.97Min: 314.69 / Avg: 319.41 / Max: 326.971. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

MinAvgMaxmdadm Btrfs30.435.039.6mdadm XFS30.935.842.4mdadm EXT431.134.739.0Native Btrfs35.138.441.4mdadm F2FS50.757.965.9OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeRAID 6RAID 5RAID 1RAID 10RAID 020406080100
mdadm Btrfsmdadm XFSmdadm EXT4Native Btrfsmdadm F2FSOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeRAID 6RAID 5RAID 1RAID 10RAID 01326395265Min: 29.9 / Avg: 30.43 / Max: 31.1Min: 33.1 / Avg: 33.37 / Max: 33.5Min: 33.8 / Avg: 34.03 / Max: 34.4Min: 37.4 / Avg: 37.8 / Max: 38.1Min: 39.2 / Avg: 39.6 / Max: 40Min: 30.7 / Avg: 30.93 / Max: 31.1Min: 31.9 / Avg: 32.1 / Max: 32.4Min: 33.9 / Avg: 34.07 / Max: 34.3Min: 39.1 / Avg: 39.57 / Max: 39.9Min: 41.1 / Avg: 42.43 / Max: 43.3Min: 31 / Avg: 31.1 / Max: 31.2Min: 32 / Avg: 32.27 / Max: 32.6Min: 33.6 / Avg: 33.9 / Max: 34.2Min: 36.6 / Avg: 37.03 / Max: 37.3Min: 38.9 / Avg: 38.97 / Max: 39Min: 35 / Avg: 35.1 / Max: 35.2Min: 38.1 / Avg: 38.2 / Max: 38.3Min: 37.8 / Avg: 38.33 / Max: 38.9Min: 38.7 / Avg: 38.87 / Max: 39.2Min: 41.1 / Avg: 41.43 / Max: 42Min: 50.3 / Avg: 50.73 / Max: 51.1Min: 52.8 / Avg: 53.5 / Max: 54Min: 54.9 / Avg: 56.37 / Max: 57.2Min: 61.8 / Avg: 62.87 / Max: 63.6Min: 65.4 / Avg: 65.87 / Max: 66.31. (CC) gcc options: -static

MinAvgMaxmdadm XFS53.870.388.7mdadm Btrfs56.870.692.0mdadm F2FS67.877.786.6Native Btrfs69.077.083.7mdadm EXT470.484.599.6OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsRAID 6RAID 5RAID 1RAID 10RAID 020406080100
mdadm XFSmdadm Btrfsmdadm F2FSNative Btrfsmdadm EXT4OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsRAID 6RAID 5RAID 1RAID 10RAID 020406080100Min: 53.4 / Avg: 53.83 / Max: 54.6Min: 57.9 / Avg: 58.1 / Max: 58.3Min: 68.2 / Avg: 68.9 / Max: 69.4Min: 81 / Avg: 81.7 / Max: 82.8Min: 87.4 / Avg: 88.73 / Max: 90.5Min: 56.5 / Avg: 56.8 / Max: 57.1Min: 63.3 / Avg: 64 / Max: 65Min: 64.5 / Avg: 64.73 / Max: 64.9Min: 75.4 / Avg: 75.6 / Max: 75.9Min: 91.8 / Avg: 92 / Max: 92.2Min: 67.3 / Avg: 67.83 / Max: 68.5Min: 75 / Avg: 75.5 / Max: 75.9Min: 77.4 / Avg: 77.97 / Max: 78.8Min: 78 / Avg: 80.63 / Max: 82.3Min: 85.6 / Avg: 86.57 / Max: 87.6Min: 68.8 / Avg: 69.03 / Max: 69.2Min: 75.2 / Avg: 75.47 / Max: 76Min: 76.8 / Avg: 77.07 / Max: 77.2Min: 79.6 / Avg: 79.87 / Max: 80Min: 83.2 / Avg: 83.73 / Max: 84.4Min: 70.4 / Avg: 70.43 / Max: 70.5Min: 76.8 / Avg: 78.13 / Max: 80.4Min: 82.6 / Avg: 84.07 / Max: 84.8Min: 90 / Avg: 90.4 / Max: 91.2Min: 96.7 / Avg: 99.57 / Max: 103.21. (CC) gcc options: -static

MinAvgMaxmdadm XFS29.233.840.7mdadm Btrfs30.634.539.4mdadm EXT431.034.738.7Native Btrfs35.638.440.7mdadm F2FS51.457.066.4OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeRAID 6RAID 5RAID 1RAID 10RAID 020406080100
mdadm XFSmdadm Btrfsmdadm EXT4Native Btrfsmdadm F2FSOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeRAID 6RAID 5RAID 1RAID 10RAID 01326395265Min: 29.1 / Avg: 29.23 / Max: 29.4Min: 30.2 / Avg: 30.33 / Max: 30.4Min: 32 / Avg: 32.77 / Max: 33.3Min: 35.7 / Avg: 35.83 / Max: 36.1Min: 40.5 / Avg: 40.73 / Max: 41.1Min: 30.5 / Avg: 30.63 / Max: 30.8Min: 31.9 / Avg: 32.1 / Max: 32.4Min: 33.4 / Avg: 33.43 / Max: 33.5Min: 36.9 / Avg: 36.93 / Max: 37Min: 39.1 / Avg: 39.43 / Max: 39.7Min: 31 / Avg: 31 / Max: 31Min: 31.9 / Avg: 32 / Max: 32.1Min: 34.7 / Avg: 34.8 / Max: 34.9Min: 36.7 / Avg: 36.8 / Max: 36.9Min: 38.7 / Avg: 38.73 / Max: 38.8Min: 35.6 / Avg: 35.63 / Max: 35.7Min: 37.6 / Avg: 37.73 / Max: 37.8Min: 38 / Avg: 38.5 / Max: 38.8Min: 38.6 / Avg: 39.17 / Max: 39.5Min: 40.7 / Avg: 40.73 / Max: 40.8Min: 50.8 / Avg: 51.4 / Max: 51.9Min: 51.9 / Avg: 52.47 / Max: 52.9Min: 53.3 / Avg: 53.57 / Max: 54.1Min: 61.2 / Avg: 61.3 / Max: 61.5Min: 65.7 / Avg: 66.4 / Max: 66.81. (CC) gcc options: -static

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

MinAvgMaxmdadm Btrfs2805311141mdadm EXT43035651111mdadm F2FS3035491100mdadm XFS3046121112Native Btrfs5857601142OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceRAID 1RAID 6RAID 5RAID 10RAID 02004006008001000
mdadm Btrfsmdadm EXT4mdadm F2FSmdadm XFSNative BtrfsOpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceRAID 1RAID 6RAID 5RAID 10RAID 02004006008001000Min: 279.95 / Avg: 280.39 / Max: 280.61Min: 313.1 / Avg: 315.85 / Max: 318.19Min: 435.87 / Avg: 438.55 / Max: 440.78Min: 470.31 / Avg: 478.65 / Max: 483.37Min: 1139.82 / Avg: 1141.18 / Max: 1142.07Min: 301.24 / Avg: 302.75 / Max: 303.61Min: 379.43 / Avg: 385.39 / Max: 390.75Min: 432.46 / Avg: 441.27 / Max: 456.93Min: 582.93 / Avg: 585.3 / Max: 587.13Min: 1110.4 / Avg: 1111.26 / Max: 1112.1Min: 299.25 / Avg: 303.32 / Max: 305.6Min: 348.79 / Avg: 350.84 / Max: 353.86Min: 418.69 / Avg: 421.86 / Max: 423.47Min: 556.55 / Avg: 566.14 / Max: 580.85Min: 1097.85 / Avg: 1100.42 / Max: 1103.04Min: 302.77 / Avg: 303.5 / Max: 303.89Min: 464.15 / Avg: 473.17 / Max: 481.5Min: 574.84 / Avg: 580.95 / Max: 589.71Min: 585.46 / Avg: 588.42 / Max: 592.24Min: 1108.49 / Avg: 1111.56 / Max: 1115.27Min: 577.61 / Avg: 584.85 / Max: 589.08Min: 598.14 / Avg: 598.43 / Max: 598.91Min: 598.67 / Avg: 599.32 / Max: 599.9Min: 876.17 / Avg: 876.77 / Max: 877.66Min: 1140.46 / Avg: 1142.43 / Max: 1144.461. (CC) gcc options: -O3

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

MinAvgMaxmdadm Btrfs151.6160.7178.3Native Btrfs177.5191.3206.7mdadm XFS228.2249.7271.6mdadm EXT4303.0314.3325.2mdadm F2FS328.8347.8377.8OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateRAID 6RAID 5RAID 10RAID 1RAID 0100200300400500
mdadm BtrfsNative Btrfsmdadm XFSmdadm EXT4mdadm F2FSOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateRAID 6RAID 5RAID 10RAID 1RAID 070140210280350Min: 135.96 / Avg: 151.64 / Max: 169.91Min: 145.21 / Avg: 156.21 / Max: 167.98Min: 145.14 / Avg: 156.97 / Max: 164.32Min: 158.81 / Avg: 160.58 / Max: 162.77Min: 173.83 / Avg: 178.31 / Max: 187.38Min: 175.93 / Avg: 177.54 / Max: 178.45Min: 169.94 / Avg: 187.72 / Max: 199.26Min: 172.56 / Avg: 189.59 / Max: 204.68Min: 190.17 / Avg: 195.02 / Max: 200.17Min: 203.24 / Avg: 206.74 / Max: 212.92Min: 227.4 / Avg: 228.19 / Max: 229.72Min: 214.08 / Avg: 228.2 / Max: 244.55Min: 228.93 / Avg: 255.99 / Max: 281.25Min: 257.92 / Avg: 264.38 / Max: 271.13Min: 269.28 / Avg: 271.62 / Max: 273.07Min: 269.61 / Avg: 303.04 / Max: 316.31Min: 292.97 / Avg: 306.37 / Max: 331.2Min: 313.57 / Avg: 316.17 / Max: 320.14Min: 296.9 / Avg: 320.82 / Max: 338.3Min: 321.58 / Avg: 325.18 / Max: 331.75Min: 226.32 / Avg: 328.79 / Max: 376.93Min: 258.39 / Avg: 331.33 / Max: 360.41Min: 345.81 / Avg: 348.76 / Max: 350.8Min: 266.68 / Avg: 352.47 / Max: 405.35Min: 348.11 / Avg: 377.77 / Max: 401.48