RAID mdadm benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel with various file-systems. Benchmarks by Michael Larabel for a future article on Phoronix.com.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 1507137-BE-1411054LI32
Ubuntu Linux RAID 0/1/5/6/10 Disk Testing,
"Flexible IO Tester 2.1.11 - Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s",
Higher Results Are Better
"Native Btrfs: RAID 0",902.142,815.412,847.296,860.381,763.878,760.686
"Native Btrfs: RAID 1",323.031,322.656,325.708
"Native Btrfs: RAID 10",453.077,451.231,448.044
"Native Btrfs: RAID 5",991.924,999.586,789.022,818.112,800.876,818.542
"Native Btrfs: RAID 6",955.237,977.747,949.672
"mdadm EXT4: RAID 1",304.002,302.598,303.289
"mdadm EXT4: RAID 5",963.331,958.369,951.058
"mdadm Btrfs: RAID 1",860.972,864.208,839.769
"mdadm Btrfs: RAID 10",904.632,842.856,841.655,826.606,818.114,828.215
"mdadm Btrfs: RAID 5",822.855,831.838,909.174,898.677,887.789,924.231
"mdadm Btrfs: RAID 6",918.196,932.711,924.239
"mdadm XFS: RAID 1",300.985,301.124,301.373
"mdadm F2FS: RAID 1",299.208,299.939,299.588
"mdadm F2FS: RAID 6",997.056,997.998
"Glusterfs-1G on XFS SSD via NFS-1G",113.351,113.063,111.641
"Glusterfs-1G on XFS SSD via NFG-1G noop",113.632,113.412,113.654
"FS-Mark 3.3 - Test: 5000 Files, 1MB Size, 4 Threads",
Higher Results Are Better
"Native Btrfs: RAID 0",84.4,83.6,83.2
"Native Btrfs: RAID 1",69.1,69.2,68.8
"Native Btrfs: RAID 10",77.2,77.2,76.8
"Native Btrfs: RAID 5",79.6,80,80
"Native Btrfs: RAID 6",76,75.2,75.2
"mdadm EXT4: RAID 0",91.2,90,90
"mdadm EXT4: RAID 1",98.8,96.7,103.2
"mdadm EXT4: RAID 10",76.8,77.2,80.4
"mdadm EXT4: RAID 5",82.6,84.8,84.8
"mdadm EXT4: RAID 6",70.5,70.4,70.4
"mdadm Btrfs: RAID 0",91.8,92,92.2
"mdadm Btrfs: RAID 1",65,63.3,63.7
"mdadm Btrfs: RAID 10",75.9,75.5,75.4
"mdadm Btrfs: RAID 5",64.9,64.5,64.8
"mdadm Btrfs: RAID 6",57.1,56.5,56.8
"mdadm XFS: RAID 0",90.5,87.4,88.3
"mdadm XFS: RAID 1",69.4,68.2,69.1
"mdadm XFS: RAID 10",82.8,81.3,81
"mdadm XFS: RAID 5",58.3,58.1,57.9
"mdadm XFS: RAID 6",54.6,53.4,53.5
"mdadm F2FS: RAID 0",86.5,85.6,87.6
"mdadm F2FS: RAID 1",78,82.3,81.6
"mdadm F2FS: RAID 10",78.8,77.4,77.7
"mdadm F2FS: RAID 5",75.9,75.6,75
"mdadm F2FS: RAID 6",68.5,67.3,67.7
"Glusterfs-1G on XFS SSD via NFS-1G",16.8,19.6,19.2,20.2,21.2,19.6
"Glusterfs-1G on XFS SSD via NFG-1G noop",13.2,15.4,14
"FS-Mark 3.3 - Test: 4000 Files, 32 Sub Dirs, 1MB Size",
Higher Results Are Better
"Native Btrfs: RAID 0",40.7,40.7,40.8
"Native Btrfs: RAID 1",35.6,35.6,35.7
"Native Btrfs: RAID 10",38.7,38,38.8
"Native Btrfs: RAID 5",39.4,39.5,38.6
"Native Btrfs: RAID 6",37.6,37.8,37.8
"mdadm EXT4: RAID 0",38.7,38.7,38.8
"mdadm EXT4: RAID 1",34.8,34.9,34.7
"mdadm EXT4: RAID 10",36.9,36.8,36.7
"mdadm EXT4: RAID 5",31,31,31
"mdadm EXT4: RAID 6",31.9,32.1,32
"mdadm Btrfs: RAID 0",39.1,39.7,39.5
"mdadm Btrfs: RAID 1",33.4,33.5,33.4
"mdadm Btrfs: RAID 10",36.9,36.9,37
"mdadm Btrfs: RAID 5",32,32.4,31.9
"mdadm Btrfs: RAID 6",30.5,30.8,30.6
"mdadm XFS: RAID 0",40.6,40.5,41.1
"mdadm XFS: RAID 1",33,33.3,32
"mdadm XFS: RAID 10",36.1,35.7,35.7
"mdadm XFS: RAID 5",30.4,30.2,30.4
"mdadm XFS: RAID 6",29.2,29.1,29.4
"mdadm F2FS: RAID 0",66.7,66.8,65.7
"mdadm F2FS: RAID 1",53.3,53.3,54.1
"mdadm F2FS: RAID 10",61.2,61.5,61.2
"mdadm F2FS: RAID 5",51.9,52.6,52.9
"mdadm F2FS: RAID 6",50.8,51.5,51.9
"Glusterfs-1G on XFS SSD via NFS-1G",16.1,16.2,12.5,14.2,14.1,15.8
"Glusterfs-1G on XFS SSD via NFG-1G noop",11.9,10.3,9.1,9.4,12,15
"FS-Mark 3.3 - Test: 1000 Files, 1MB Size",
Higher Results Are Better
"Native Btrfs: RAID 0",41.1,41.2,42
"Native Btrfs: RAID 1",35.2,35,35.1
"Native Btrfs: RAID 10",37.8,38.9,38.3
"Native Btrfs: RAID 5",38.7,39.2,38.7
"Native Btrfs: RAID 6",38.3,38.2,38.1
"mdadm EXT4: RAID 0",38.9,39,39
"mdadm EXT4: RAID 1",33.6,34.2,33.9
"mdadm EXT4: RAID 10",36.6,37.2,37.3
"mdadm EXT4: RAID 5",31,31.2,31.1
"mdadm EXT4: RAID 6",32.6,32.2,32
"mdadm Btrfs: RAID 0",39.6,39.2,40
"mdadm Btrfs: RAID 1",33.8,34.4,33.9
"mdadm Btrfs: RAID 10",38.1,37.9,37.4
"mdadm Btrfs: RAID 5",33.1,33.5,33.5
"mdadm Btrfs: RAID 6",30.3,29.9,31.1
"mdadm XFS: RAID 0",41.1,43.3,42.9
"mdadm XFS: RAID 1",34.3,33.9,34
"mdadm XFS: RAID 10",39.1,39.7,39.9
"mdadm XFS: RAID 5",31.9,32,32.4
"mdadm XFS: RAID 6",31,31.1,30.7
"mdadm F2FS: RAID 0",66.3,65.4,65.9
"mdadm F2FS: RAID 1",53.7,54,52.8
"mdadm F2FS: RAID 10",61.8,63.6,63.2
"mdadm F2FS: RAID 5",54.9,57.2,57
"mdadm F2FS: RAID 6",51.1,50.8,50.3
"Glusterfs-1G on XFS SSD via NFS-1G",16.3,16.4,8.8,10.2,8.4,10.2
"Glusterfs-1G on XFS SSD via NFG-1G noop",5.7,7.9,12.3,15,15.1,16
"Flexible IO Tester 2.1.11 - Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s",
Higher Results Are Better
"Native Btrfs: RAID 0",490.847,441.356,480.596,530.449,509.367,530.748
"Native Btrfs: RAID 1",127.421,127.849,128.734
"Native Btrfs: RAID 10",263.461,267.45,271.528
"Native Btrfs: RAID 5",250.216,265.009,245.365,242.921,244.45,245.634
"Native Btrfs: RAID 6",208.126,228.119,213.748,211.97,216.005,209.401
"mdadm EXT4: RAID 0",379.54,415.053,428.822,432.588,437.08,435.118
"mdadm EXT4: RAID 1",107.543,113.359,110.05
"mdadm EXT4: RAID 10",162.933,162.758,165.881
"mdadm EXT4: RAID 5",144.951,147.421,145.845
"mdadm EXT4: RAID 6",138.12,135.218,129.191
"mdadm Btrfs: RAID 0",381.358,386.464,376.524
"mdadm Btrfs: RAID 1",105.205,110.993,111.453
"mdadm Btrfs: RAID 10",163.479,159.024,156.082
"mdadm Btrfs: RAID 5",214.471,216.213,212.246
"mdadm Btrfs: RAID 6",182.118,178.056,179.024
"mdadm XFS: RAID 0",397.327,388.999,394.15
"mdadm XFS: RAID 1",116.519,114.51,115.493
"mdadm XFS: RAID 10",170.614,162.991,166.658
"mdadm XFS: RAID 5",150.919,150.84,151.395
"mdadm XFS: RAID 6",133.394,127.354,128.106
"mdadm F2FS: RAID 0",358.91,393.65,384.255,388.72,391.662,405.067
"mdadm F2FS: RAID 1",101.172,116.501,111.05,108.313,110.757,109.679
"mdadm F2FS: RAID 10",180.086,175.406,176.472
"mdadm F2FS: RAID 5",149.815,149.522,148.889
"mdadm F2FS: RAID 6",134.794,130.894,128.1
"Glusterfs-1G on XFS SSD via NFS-1G",12.064,13.386,13.503,14.07,14.184,13.816
"Glusterfs-1G on XFS SSD via NFG-1G noop",12.103,13.238,13.056,13.524,13.617,14.007
"Flexible IO Tester 2.1.11 - Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s",
Higher Results Are Better
"Native Btrfs: RAID 0",314.687,316.564,326.969
"Native Btrfs: RAID 1",126.427,121.03,129.898,136.311,131.38,136.849
"Native Btrfs: RAID 10",273.969,271.082,271.524
"Native Btrfs: RAID 5",241.763,242.753,243.131
"Native Btrfs: RAID 6",211.35,207.383,208.154
"mdadm EXT4: RAID 0",502.396,507.846,515.95
"mdadm EXT4: RAID 1",113.503,113.958,118.545
"mdadm EXT4: RAID 10",200.269,198.175,201.417
"mdadm EXT4: RAID 5",192.722,192.132,193.531
"mdadm EXT4: RAID 6",155.925,154.208,157.203
"mdadm Btrfs: RAID 0",385.769,380.894,389.362
"mdadm Btrfs: RAID 1",107.542,111.794,110.571
"mdadm Btrfs: RAID 10",161.423,160.422,163.859
"mdadm Btrfs: RAID 5",208.633,209.72,210.456
"mdadm Btrfs: RAID 6",171.448,175.52,171.192
"mdadm XFS: RAID 0",396.639,397.567,402.019
"mdadm XFS: RAID 1",114.355,118.389,114.726
"mdadm XFS: RAID 10",203.084,201.551,216.745,217.544,218.587,232.129
"mdadm XFS: RAID 5",197.351,197.628,196.601
"mdadm XFS: RAID 6",153.568,154.088,154.651
"mdadm F2FS: RAID 0",427.014,410.15,420.718
"mdadm F2FS: RAID 1",109.607,116.606,113.85
"mdadm F2FS: RAID 10",200.156,200.932,199.982
"mdadm F2FS: RAID 5",198.507,197.47,194.357
"mdadm F2FS: RAID 6",149.867,154.411,153.304
"Glusterfs-1G on XFS SSD via NFS-1G",20.315,21.683,22.821,23.294,23.215,22.025
"Glusterfs-1G on XFS SSD via NFG-1G noop",20.47,22.09,22.262,22.627,22.933,21.78
"IOzone 3.405 - Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance",
Higher Results Are Better
"Native Btrfs: RAID 0",1144.4560546875,1142.3935546875,1140.455078125
"Native Btrfs: RAID 1",577.6064453125,589.0830078125,587.8486328125
"Native Btrfs: RAID 10",598.6708984375,599.3994140625,599.8974609375
"Native Btrfs: RAID 5",877.6552734375,876.1708984375,876.4951171875
"Native Btrfs: RAID 6",598.1376953125,598.234375,598.90625
"mdadm EXT4: RAID 0",1112.099609375,1111.2763671875,1110.40234375
"mdadm EXT4: RAID 1",301.236328125,303.607421875,303.3916015625
"mdadm EXT4: RAID 10",585.84375,582.9306640625,587.1279296875
"mdadm EXT4: RAID 5",432.4560546875,456.931640625,434.4228515625
"mdadm EXT4: RAID 6",390.748046875,385.9990234375,379.43359375
"mdadm Btrfs: RAID 0",1139.82421875,1141.6435546875,1142.0673828125
"mdadm Btrfs: RAID 1",280.61328125,280.599609375,279.9501953125
"mdadm Btrfs: RAID 10",483.3701171875,482.27734375,470.3115234375
"mdadm Btrfs: RAID 5",435.8671875,439.0087890625,440.7822265625
"mdadm Btrfs: RAID 6",318.19140625,313.1015625,316.2626953125
"mdadm XFS: RAID 0",1115.2734375,1108.48828125,1110.9130859375
"mdadm XFS: RAID 1",303.849609375,303.890625,302.7724609375
"mdadm XFS: RAID 10",592.240234375,587.5498046875,585.4560546875
"mdadm XFS: RAID 5",578.2958984375,574.841796875,589.708984375
"mdadm XFS: RAID 6",464.1474609375,473.869140625,481.5029296875
"mdadm F2FS: RAID 0",1100.3662109375,1103.0390625,1097.8505859375
"mdadm F2FS: RAID 1",305.1015625,305.5986328125,299.248046875
"mdadm F2FS: RAID 10",561.0283203125,556.5498046875,580.8486328125
"mdadm F2FS: RAID 5",423.4716796875,423.4072265625,418.6923828125
"mdadm F2FS: RAID 6",349.859375,353.859375,348.7880859375
"Glusterfs-1G on XFS SSD via NFS-1G",27.3115234375,7.8271484375,3.76953125
"Glusterfs-1G on XFS SSD via NFG-1G noop",18.384765625,3.625,4.3076171875
"Flexible IO Tester 2.1.11 - Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s",
Higher Results Are Better
"Native Btrfs: RAID 0",718.939,775.474,818.01,819.228,741.508,676.405
"Native Btrfs: RAID 1",234.611,232.582,231.794
"Native Btrfs: RAID 10",509.596,483.869,448.696,451.11,477.223,444.113
"Native Btrfs: RAID 5",932.179,875.433,627.99,668.098,680.241,668.4
"Native Btrfs: RAID 6",876.561,855.45,518.998,526.748,577.952,565.504
"mdadm EXT4: RAID 0",822.659,816.285,816.05
"mdadm EXT4: RAID 1",216.781,213.339,213.235
"mdadm EXT4: RAID 10",695.295,690.285,669.275
"mdadm EXT4: RAID 5",699.91,692.12,676.148
"mdadm EXT4: RAID 6",873.644,855.796,835.309
"mdadm Btrfs: RAID 0",827.466,811.204,809.391
"mdadm Btrfs: RAID 1",226.546,223.626,223.895
"mdadm Btrfs: RAID 10",727.242,685.144,681.461,687.924
"mdadm Btrfs: RAID 5",795.359,793.091,789.381
"mdadm Btrfs: RAID 6",910.491,909.186,910.266
"mdadm XFS: RAID 0",839.411,842.4,844.102
"mdadm XFS: RAID 1",236.408,236.623,236.25
"mdadm XFS: RAID 10",384.349,384.612,384.633
"mdadm XFS: RAID 5",750.699,754.05,750.559
"mdadm XFS: RAID 6",921.724,927.818,935.28
"mdadm F2FS: RAID 0",871.659,872.953,873.913
"mdadm F2FS: RAID 1",239.499,239.697,240.006
"mdadm F2FS: RAID 10",741.626,740.858,741.403
"mdadm F2FS: RAID 5",726.175,728.422,753.956
"mdadm F2FS: RAID 6",915.882,917.692,915.326
"Glusterfs-1G on XFS SSD via NFS-1G",68.219,72.715,73.227,72.802
"Glusterfs-1G on XFS SSD via NFG-1G noop",57.418,70.678,73.113,73.454,73.599,73.026
"Compile Bench 0.6 - Test: Initial Create",
Higher Results Are Better
"Native Btrfs: RAID 0",212.92,203.24,204.05
"Native Btrfs: RAID 1",169.94,199.26,193.96
"Native Btrfs: RAID 10",178.45,178.24,175.93
"Native Btrfs: RAID 5",204.68,191.52,172.56
"Native Btrfs: RAID 6",190.17,194.73,200.17
"mdadm EXT4: RAID 0",322.21,321.58,331.75
"mdadm EXT4: RAID 1",269.61,306.45,302.43,315.32,308.12,316.31
"mdadm EXT4: RAID 10",331.2,299.75,302.2,304.4,292.97,307.68
"mdadm EXT4: RAID 5",314.79,320.14,313.57
"mdadm EXT4: RAID 6",296.9,338.3,317.57,320.1,328.36,323.7
"mdadm Btrfs: RAID 0",187.38,175.58,173.83,176.43
"mdadm Btrfs: RAID 1",162.77,160.15,158.81
"mdadm Btrfs: RAID 10",145.14,154.58,155.07,164.32,159.14,163.59
"mdadm Btrfs: RAID 5",167.98,145.21,160.34,162.13,151.03,150.54
"mdadm Btrfs: RAID 6",169.91,153.02,135.96,144.67,144.63,161.62
"mdadm XFS: RAID 0",271.13,257.92,264.09
"mdadm XFS: RAID 1",227.4,229.72,227.44
"mdadm XFS: RAID 10",244.55,215.87,214.08,224.2,233.47,237.05
"mdadm XFS: RAID 5",281.25,270.65,261.77,245.29,228.93,248.06
"mdadm XFS: RAID 6",269.28,273.07,272.5
"mdadm F2FS: RAID 0",258.39,360.41,355.21,333.67,350.8,329.5
"mdadm F2FS: RAID 1",226.32,326.04,358.42,342.33,376.93,342.72
"mdadm F2FS: RAID 10",266.68,363.43,366.39,331.55,405.35,381.41
"mdadm F2FS: RAID 5",348.11,390.9,401.48,388.18,356.46,381.5
"mdadm F2FS: RAID 6",345.81,350.8,349.67
"Glusterfs-1G on XFS SSD via NFS-1G",9.1,17.78,17.78
"Glusterfs-1G on XFS SSD via NFG-1G noop",9.04,16.63,19.19,17.25,17.91