Btrfs RAID Testing

Btrfs HDD RAID 0 file-system benchmarking on Ubuntu 14.10 using two Samsung hard drives. Benchmarks by Michael Larabel for a future article on Phoronix.com with benchmarking from Linux 3.10 kernel through Linux 3.18 kernel.

HTML result view exported from: https://openbenchmarking.org/result/1410230-PTS-BTRFSRAI40.

Btrfs RAID TestingProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc1Intel Core i7-5960X @ 3.00GHz (16 Cores)Gigabyte X99-UD4-CFIntel Xeon E5 v3/Core16384MB128GB Crucial_CT128MX1 + 2 x 250GB SAMSUNG HD253GJNVIDIA GeForce GTX 760 2048MBRealtek ALC1150SyncMasterIntel ConnectionUbuntu 14.103.10.0-031000-generic (x86_64)Unity 7.3.1X Server 1.16.0nouveau 1.0.113.3 Mesa 10.3.0 Gallium 0.4GCC 4.9.1btrfs2560x16003.11.0-031100-generic (x86_64)Intel Core i7-5960X @ 3.50GHz (16 Cores)3.12.0-031200-generic (x86_64)NVIDIA GeForce GTX 760 2048MB (405/324MHz)3.13.0-031300-generic (x86_64)NVIDIA GeForce GTX 760 2048MB (405/648MHz)3.14.0-031400-generic (x86_64)Intel C610/X993.15.0-031500-generic (x86_64)3.16.0-031600-generic (x86_64)NVIDIA GeForce GTX 760 2048MB3.17.0-031700-generic (x86_64)3.18.0-031800rc1-generic (x86_64)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- DEADLINE / relatime,rw,space_cacheProcessor Details- Linux 3.10: Scaling Governor: acpi-cpufreq ondemand- Linux 3.11: Scaling Governor: acpi-cpufreq ondemand- Linux 3.12: Scaling Governor: intel_pstate powersave- Linux 3.13: Scaling Governor: intel_pstate powersave- Linux 3.14: Scaling Governor: intel_pstate powersave- Linux 3.15.0: Scaling Governor: intel_pstate powersave- Linux 3.16.0: Scaling Governor: intel_pstate powersave- Linux 3.17.0: Scaling Governor: intel_pstate powersave- Linux 3.18-rc1: Scaling Governor: intel_pstate powersaveSystem Details- Disk Scheduler: DEADLINE. Python 2.7.8.

Btrfs RAID Testingfio: Rand Read - Libaio - No - 16KB - Default Test Directory - IOPSfio: Rand Read - Libaio - No - 16KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - 16KB - Default Test Directory - IOPSfio: Rand Write - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - 16KB - Default Test Directory - IOPSfio: Seq Read - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - 16KB - Default Test Directory - IOPSfio: Seq Write - Libaio - No - 16KB - Default Test Directory - MB/sfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizedbench: 6iozone: 4Kb - 8GB - Write Performancecompilebench: Initial Createpostmark: Disk Transaction PerformanceLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc164010.3215563241.914868.279542163.1523.7744.6723.7754.16271.72150.0638494308.6716407263.794328.41422467.9822.5344.4024.0055.22272.19148.0040994447.1517048277.874697.80449172.0622.9043.4324.4056.94271.64233.1244135289.2615638256.124579.1016091277.3423.2744.3724.0756.63270.53214.4938323685.9017125279.344508.6215166272.2623.4744.5722.9355.63270.83178.6046303986.4216479272.434637.4516991282.5123.2045.7023.5754.05271.53170.0940334779.4315304239.114008.0514318278.4223.1345.4323.3756.01272.66164.8848705058.1317374283.914667.6117542278.4422.0343.9022.8756.08272.55171.46502862111.0017049281.325389.3617198284.6122.9044.8723.6354.21271.29176.635137OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPS

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.11Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPSLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc1140280420560700SE +/- 10.68, N = 3SE +/- 1.76, N = 3SE +/- 3.93, N = 3SE +/- 23.28, N = 6SE +/- 3.18, N = 3SE +/- 1.53, N = 3SE +/- 9.02, N = 3SE +/- 7.90, N = 5SE +/- 42.53, N = 66404304445283683984775056211. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc13691215SE +/- 0.05, N = 3SE +/- 0.25, N = 6SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.32, N = 6SE +/- 0.05, N = 3SE +/- 0.04, N = 310.328.677.159.265.906.429.438.1311.001. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPS

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.11Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPSLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc14K8K12K16K20KSE +/- 164.86, N = 3SE +/- 197.43, N = 3SE +/- 253.88, N = 5SE +/- 300.30, N = 3SE +/- 293.44, N = 3SE +/- 129.96, N = 3SE +/- 120.79, N = 3SE +/- 124.68, N = 3SE +/- 329.14, N = 31556316407170481563817125164791530417374170491. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc160120180240300SE +/- 1.05, N = 3SE +/- 1.44, N = 3SE +/- 2.23, N = 3SE +/- 3.86, N = 3SE +/- 1.22, N = 3SE +/- 2.42, N = 3SE +/- 0.60, N = 3SE +/- 1.33, N = 3SE +/- 0.38, N = 3241.91263.79277.87256.12279.34272.43239.11283.91281.321. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPS

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPSLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc1120240360480600SE +/- 18.48, N = 6SE +/- 3.61, N = 3SE +/- 5.04, N = 3SE +/- 5.57, N = 3SE +/- 3.93, N = 3SE +/- 2.08, N = 3SE +/- 2.19, N = 3SE +/- 2.85, N = 3SE +/- 26.15, N = 64864324694574504634004665381. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc13691215SE +/- 0.01, N = 3SE +/- 0.32, N = 6SE +/- 0.10, N = 3SE +/- 0.31, N = 6SE +/- 0.42, N = 6SE +/- 0.02, N = 3SE +/- 0.19, N = 6SE +/- 0.04, N = 3SE +/- 0.03, N = 38.278.417.809.108.627.458.057.619.361. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPS

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: IOPSLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc14K8K12K16K20KSE +/- 299.02, N = 6SE +/- 14.11, N = 3SE +/- 9.49, N = 3SE +/- 419.77, N = 6SE +/- 177.28, N = 3SE +/- 364.14, N = 6SE +/- 473.86, N = 6SE +/- 262.61, N = 5SE +/- 313.35, N = 69542422444911609115166169911431817542171981. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc160120180240300SE +/- 1.79, N = 3SE +/- 0.07, N = 3SE +/- 0.25, N = 3SE +/- 0.47, N = 3SE +/- 3.77, N = 3SE +/- 1.43, N = 3SE +/- 0.97, N = 3SE +/- 3.47, N = 3SE +/- 1.39, N = 3163.1567.9872.06277.34272.26282.51278.42278.44284.611. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc1612182430SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 3SE +/- 0.26, N = 323.7722.5322.9023.2723.4723.2023.1322.0322.901. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc11020304050SE +/- 0.44, N = 3SE +/- 0.72, N = 3SE +/- 0.15, N = 3SE +/- 0.54, N = 3SE +/- 0.38, N = 3SE +/- 0.70, N = 3SE +/- 0.22, N = 3SE +/- 0.64, N = 3SE +/- 0.58, N = 344.6744.4043.4344.3744.5745.7045.4343.9044.871. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc1612182430SE +/- 0.19, N = 3SE +/- 0.35, N = 5SE +/- 0.23, N = 3SE +/- 0.33, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 323.7724.0024.4024.0722.9323.5723.3722.8723.631. (CC) gcc options: -static

Dbench

Client Count: 6

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6Linux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc11326395265SE +/- 0.14, N = 3SE +/- 0.90, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.44, N = 3SE +/- 0.62, N = 354.1655.2256.9456.6355.6354.0556.0156.0854.211. (CC) gcc options: -lpopt -O2

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc160120180240300SE +/- 0.25, N = 3SE +/- 0.16, N = 3SE +/- 0.60, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.92, N = 3271.72272.19271.64270.53270.83271.53272.66272.55271.291. (CC) gcc options: -O3

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc150100150200250SE +/- 1.86, N = 3SE +/- 0.78, N = 3SE +/- 4.10, N = 3SE +/- 3.59, N = 6SE +/- 2.56, N = 3SE +/- 1.23, N = 3SE +/- 2.92, N = 3SE +/- 5.94, N = 3SE +/- 2.61, N = 4150.06148.00233.12214.49178.60170.09164.88171.46176.63

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceLinux 3.10Linux 3.11Linux 3.12Linux 3.13Linux 3.14Linux 3.15.0Linux 3.16.0Linux 3.17.0Linux 3.18-rc111002200330044005500SE +/- 177.07, N = 6SE +/- 38.68, N = 3SE +/- 69.30, N = 3SE +/- 204.02, N = 6SE +/- 49.37, N = 3SE +/- 37.53, N = 3SE +/- 31.33, N = 3SE +/- 76.45, N = 4SE +/- 35.33, N = 33849409944133832463040334870502851371. (CC) gcc options: -O3

Phoronix Test Suite v10.8.4