Btrfs RAID 0/1/5/6/10 Disk Testing Btrfs RAID benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1410291-LI-BTRFSRAID01 .
Btrfs RAID 0/1/5/6/10 Disk Testing Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 Intel Core i7-5960X @ 4.00GHz (16 Cores) Gigabyte X99-UD4-CF Intel Xeon E5 v3/Core 16384MB 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1 XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB Intel C610/X99 SyncMaster Intel Connection Ubuntu 14.10 3.18.0-031800rc1-generic (x86_64) Unity 7.3.1 X Server 1.16.0 radeon 7.4.0 3.3 Mesa 10.3.0 Gallium 0.4 GCC 4.9.1 btrfs 2560x1600 OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details - DEADLINE / relatime,rw,space_cache,ssd Processor Details - Scaling Governor: intel_pstate powersave System Details - Disk Scheduler: DEADLINE. Python 2.7.8.
Btrfs RAID 0/1/5/6/10 Disk Testing fio: Rand Read - Libaio - No - 16KB - Default Test Directory - MB/s fio: Rand Write - Libaio - No - 16KB - Default Test Directory - MB/s fio: Seq Read - Libaio - No - 16KB - Default Test Directory - MB/s fio: Seq Write - Libaio - No - 16KB - Default Test Directory - MB/s fs-mark: 1000 Files, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size iozone: 4Kb - 8GB - Write Performance compilebench: Initial Create Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 236.89 170.35 239.98 169.40 40.53 79.93 40.80 481.77 162.15 787.97 436.31 796.84 344.88 41.20 84.40 41.03 1133.91 176.58 758.26 497.23 824.97 319.41 41.43 83.73 40.73 1142.43 206.74 233.00 128.00 323.80 130.32 35.10 69.03 35.63 584.85 187.72 469.10 267.48 450.78 272.19 38.33 77.07 38.50 599.32 177.54 742.06 248.93 869.68 242.55 38.87 79.87 39.17 876.77 189.59 653.54 214.56 960.89 208.96 38.20 75.47 37.73 598.43 195.02 OpenBenchmarking.org
Flexible IO Tester Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 2.1.11 Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 200 400 600 800 1000 SE +/- 2.80, N = 3 SE +/- 40.14, N = 6 SE +/- 23.17, N = 6 SE +/- 0.84, N = 3 SE +/- 10.47, N = 6 SE +/- 52.17, N = 6 SE +/- 67.86, N = 6 236.89 787.97 758.26 233.00 469.10 742.06 653.54 1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 2.1.11 Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 110 220 330 440 550 SE +/- 0.33, N = 3 SE +/- 16.68, N = 6 SE +/- 13.92, N = 6 SE +/- 0.39, N = 3 SE +/- 2.33, N = 3 SE +/- 3.37, N = 6 SE +/- 2.95, N = 6 170.35 436.31 497.23 128.00 267.48 248.93 214.56 1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 2.1.11 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 200 400 600 800 1000 SE +/- 3.46, N = 3 SE +/- 16.37, N = 6 SE +/- 22.85, N = 6 SE +/- 0.96, N = 3 SE +/- 1.47, N = 3 SE +/- 40.14, N = 6 SE +/- 8.58, N = 3 239.98 796.84 824.97 323.80 450.78 869.68 960.89 1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 2.1.11 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 70 140 210 280 350 SE +/- 0.04, N = 3 SE +/- 5.97, N = 6 SE +/- 3.82, N = 3 SE +/- 2.46, N = 6 SE +/- 0.90, N = 3 SE +/- 0.41, N = 3 SE +/- 1.21, N = 3 169.40 344.88 319.41 130.32 272.19 242.55 208.96 1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl
FS-Mark Test: 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 9 18 27 36 45 SE +/- 0.07, N = 3 SE +/- 0.21, N = 3 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 SE +/- 0.32, N = 3 SE +/- 0.17, N = 3 SE +/- 0.06, N = 3 40.53 41.20 41.43 35.10 38.33 38.87 38.20 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.23, N = 3 SE +/- 0.35, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 SE +/- 0.27, N = 3 79.93 84.40 83.73 69.03 77.07 79.87 75.47 1. (CC) gcc options: -static
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 9 18 27 36 45 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.25, N = 3 SE +/- 0.28, N = 3 SE +/- 0.07, N = 3 40.80 41.03 40.73 35.63 38.50 39.17 37.73 1. (CC) gcc options: -static
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 200 400 600 800 1000 SE +/- 0.08, N = 3 SE +/- 0.84, N = 3 SE +/- 1.16, N = 3 SE +/- 3.64, N = 3 SE +/- 0.36, N = 3 SE +/- 0.45, N = 3 SE +/- 0.24, N = 3 481.77 1133.91 1142.43 584.85 599.32 876.77 598.43 1. (CC) gcc options: -O3
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create Single Disk 4 Disks, Non-RAID RAID 0 RAID 1 RAID 1+0 RAID 5 RAID 6 50 100 150 200 250 SE +/- 3.45, N = 3 SE +/- 0.57, N = 3 SE +/- 3.10, N = 3 SE +/- 9.02, N = 3 SE +/- 0.81, N = 3 SE +/- 9.32, N = 3 SE +/- 2.89, N = 3 162.15 176.58 206.74 187.72 177.54 189.59 195.02
Phoronix Test Suite v10.8.4