Linux 5.4 HDD File-System RAID Benchmarks

AMD Ryzen 5 3400G storage testing on Linux 5.4 by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1910292-HU-HDDTESTS045&grr.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionRAID0RAID10RAID1Single Btrfs EXT4 XFS Btrfs EXT4 XFS Btrfs EXT4 XFS Btrfs EXT4 XFSAMD Ryzen 5 3400G @ 3.70GHz (4 Cores / 8 Threads)ASUS PRIME B450M-A (1814 BIOS)AMD Device 15d02 x 8192 MB DDR4-3000MT/s CRUCIAL29GB INTEL MEMPEK1W032GA + 4 x 6001GB Seagate ST6000VN0033-2EEASUS AMD Picasso 2GB (1400/1500MHz)AMD Device 15deASUS PB278Realtek RTL8111/8168/8411Ubuntu 19.045.4.0-999-generic (x86_64) 20191024GNOME Shell 3.32.2X Server4.5 Mesa 19.0.8 (LLVM 8.0.0)GCC 8.3.0btrfs2560x1440ext4xfsbtrfsext4xfsbtrfsext4xfsbtrfsext4xfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- RAID0: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID0- RAID0: EXT4: NONE / relatime,rw,stripe=512 / raid0 sdd[3] sdc[2] sdb[1] sda[0]- RAID0: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=4096 / raid0 sda[0] sdd[3] sdc[2] sdb[1] - RAID10: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID10- RAID10: EXT4: NONE / relatime,rw,stripe=256 / raid10 sdd[3] sdc[2] sdb[1] sda[0]- RAID10: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=2048 / raid10 sdd[3] sdc[2] sda[0] sdb[1] - RAID1: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID1- RAID1: EXT4: NONE / relatime,rw / raid1 sdd[3] sdc[2] sdb[1] sda[0]- RAID1: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw / raid1 sdc[2] sdb[1] sdd[3] sda[0]- Single: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5- Single: EXT4: MQ-DEADLINE / relatime,rw- Single: XFS: MQ-DEADLINE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rwProcessor Details- Scaling Governor: acpi-cpufreq ondemandJava Details- OpenJDK Runtime Environment (build 11.0.4+11-post-Ubuntu-1ubuntu219.04)Python Details- Python 2.7.16 + Python 3.7.3Security Details- l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling

sqlite: 1startup-time: Only Seq Reads - xterm - Default Test Directorycassandra: Readsstartup-time: Seq Reads + Writes - xterm - Default Test Directorystartup-time: Seq Reads + Writes - LibreOffice Writer - Default Test Directorycassandra: Mixed 1:3startup-time: Seq Reads + Writes - GNOME Terminal - Default Test Directorycompilebench: Compilecassandra: Mixed 1:1build-llvm: Time To Compilepgbench: Buffer Test - Normal Load - Read Writefio: Seq Write - Linux AIO - Yes - No - 2MB - Default Test Directorycassandra: Writespgbench: Buffer Test - Normal Load - Read Onlyrocksdb: Rand Readfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directorysqlite-speedtest: Timed Time - Size 1,000rocksdb: Read While Writingfs-mark: 1000 Files, 1MB Sizerocksdb: Rand Fillrocksdb: Rand Fill Syncfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directoryrocksdb: Seq Fillior: Read Testior: Write TestRAID0RAID10RAID1Single Btrfs EXT4 XFS Btrfs EXT4 XFS Btrfs EXT4 XFS Btrfs EXT4 XFS454.888.94188674.6410.171754313.071280.0818622976.14309.9883222457101996.852161022611933346573.0675482037.3067583422567455926999514.3230.31377.5423.99185319.9923.651748626.361050.8618774981.91500.2754422324101193.932226587110525041173.5175281028.3067488822749600911943362.1125.23305.3723.02189637.4115.821762719.911169.2517914976.51420.0755922942101280.892188689211433344773.6175180636.1767546422524756929255397.1730.33529.6519.921882710.8721.741780229.60923.1518544975.66261.9542722546101172.60211511557305328673.5075475333.3067945122510432917508419.0328.032302.1928.6613.7045.1449.27573.711055.79182.5527893430.92199971296521025577.926934877.4060462524588195797598251.139.081083.3627.8513.6543.1049.68536.871066.94147.4123892314.73208652586759326479.8469533012.1758972024770216780297282.3418.23412.0325.69188518.7518.021815733.25827.9818857978.42254.8524423380100627.32220154535330020873.8275470338.1366932822709226909103301.6031.102290.412.022.674.625.63457.921015.2689.8710997761.56209058862556799.9076.077329226.806366702428082.42854120257.447.15408.0210.15183752.594.58179545.39603.4518574978.32313.5811292244499994.222216713110370040573.8374185934.6267056022551225938347373.1814.12582.8067.281817855.00101.7617862689.2718311977.32231.8522223042100948.28219894335013319673.4775957929.4367331722484227915934289.6228.99533.0743.021897519.8683.611754478.21586.2818894984.69370.2815822813101849.25218459723740014673.1574286718.4767713722636174946405394.2517.01319.3174.571891233.3371.7917539102.50649.1418284975.26240.4220922529100930.95217369004880019173.5775707946.1767084222515229918239377.0115.62OpenBenchmarking.org

SQLite

Threads / Copies: 1

RAID0RAID10RAID1SingleOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1BtrfsEXT4XFS5001000150020002500SE +/- 3.65, N = 3SE +/- 0.66, N = 3SE +/- 0.53, N = 3SE +/- 3.90, N = 3SE +/- 37.37, N = 3SE +/- 9.71, N = 3SE +/- 2.15, N = 3SE +/- 12.61, N = 3SE +/- 4.56, N = 9SE +/- 0.14, N = 3SE +/- 5.29, N = 3SE +/- 2.84, N = 3454.88377.54305.37529.652302.191083.36412.032290.41408.02582.80533.07319.311. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test DirectoryBtrfsEXT4XFS20406080100SE +/- 0.18, N = 12SE +/- 0.53, N = 12SE +/- 0.40, N = 12SE +/- 0.81, N = 12SE +/- 0.37, N = 3SE +/- 0.27, N = 9SE +/- 2.69, N = 12SE +/- 0.22, N = 12SE +/- 1.12, N = 9SE +/- 1.15, N = 9SE +/- 1.18, N = 12SE +/- 2.69, N = 78.9423.9923.0219.9228.6627.8525.692.0210.1567.2843.0274.57

Apache Cassandra

Test: Reads

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: ReadsBtrfsEXT4XFS4K8K12K16K20KSE +/- 406.13, N = 12SE +/- 518.49, N = 12SE +/- 459.74, N = 12SE +/- 483.29, N = 12SE +/- 451.22, N = 12SE +/- 464.19, N = 12SE +/- 486.43, N = 12SE +/- 397.24, N = 12SE +/- 428.17, N = 12188671853118963188271885118375181781897518912

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test DirectoryBtrfsEXT4XFS1224364860SE +/- 0.18, N = 9SE +/- 0.48, N = 9SE +/- 0.26, N = 12SE +/- 0.33, N = 9SE +/- 0.14, N = 12SE +/- 0.18, N = 12SE +/- 0.52, N = 10SE +/- 0.33, N = 12SE +/- 0.28, N = 9SE +/- 0.75, N = 9SE +/- 0.83, N = 9SE +/- 1.20, N = 124.649.997.4110.8713.7013.658.752.672.5955.0019.8633.33

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryBtrfsEXT4XFS20406080100SE +/- 0.18, N = 12SE +/- 0.66, N = 9SE +/- 0.05, N = 3SE +/- 0.54, N = 12SE +/- 0.67, N = 4SE +/- 0.65, N = 3SE +/- 1.37, N = 12SE +/- 0.58, N = 12SE +/- 0.53, N = 12SE +/- 1.60, N = 9SE +/- 3.00, N = 6SE +/- 3.08, N = 810.1723.6515.8221.7445.1443.1018.024.624.58101.7683.6171.79

Apache Cassandra

Test: Mixed 1:3

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: Mixed 1:3BtrfsEXT4XFS4K8K12K16K20KSE +/- 413.14, N = 12SE +/- 453.58, N = 12SE +/- 411.93, N = 10SE +/- 308.57, N = 12SE +/- 169.19, N = 3SE +/- 410.14, N = 12SE +/- 377.44, N = 12SE +/- 455.96, N = 9SE +/- 319.83, N = 12175431748617627178021815717954178621754417539

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryBtrfsEXT4XFS20406080100SE +/- 0.33, N = 12SE +/- 0.36, N = 3SE +/- 0.26, N = 3SE +/- 0.71, N = 12SE +/- 0.27, N = 3SE +/- 0.77, N = 3SE +/- 3.69, N = 12SE +/- 0.85, N = 9SE +/- 0.48, N = 9SE +/- 1.33, N = 9SE +/- 1.25, N = 213.0726.3619.9129.6049.2749.6833.255.635.3978.21102.50

Compile Bench

Test: Compile

RAID0RAID10RAID1SingleOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileBtrfsEXT4XFS30060090012001500SE +/- 10.26, N = 13SE +/- 13.73, N = 4SE +/- 10.62, N = 3SE +/- 14.65, N = 15SE +/- 12.09, N = 12SE +/- 24.33, N = 9SE +/- 7.03, N = 15SE +/- 12.36, N = 9SE +/- 10.43, N = 3SE +/- 5.58, N = 15SE +/- 3.04, N = 3SE +/- 8.39, N = 51280.081050.861169.25923.15573.71536.87827.98457.92603.45689.27586.28649.14

Apache Cassandra

Test: Mixed 1:1

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: Mixed 1:1BtrfsEXT4XFS4K8K12K16K20KSE +/- 234.54, N = 5SE +/- 270.71, N = 3SE +/- 305.74, N = 12SE +/- 29.17, N = 3SE +/- 82.49, N = 3SE +/- 216.30, N = 12SE +/- 205.87, N = 12SE +/- 308.87, N = 3SE +/- 221.66, N = 12186221877417914185441885718574183111889418284

Timed LLVM Compilation

Time To Compile

RAID0RAID10RAID1SingleOpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 6.0.1Time To CompileBtrfsEXT4XFS2004006008001000976.14981.91976.51975.661055.791066.94978.421015.26978.32977.32984.69975.26

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

RAID0RAID10RAID1SingleOpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteBtrfsEXT4XFS110220330440550SE +/- 1.26, N = 3SE +/- 2.87, N = 3SE +/- 19.15, N = 12SE +/- 1.52, N = 3SE +/- 1.95, N = 15SE +/- 2.36, N = 15SE +/- 4.80, N = 15SE +/- 0.52, N = 3SE +/- 4.93, N = 15SE +/- 1.24, N = 3SE +/- 2.65, N = 3SE +/- 3.64, N = 15309.98500.27420.07261.95182.55147.41254.8589.87313.58231.85370.28240.421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4XFS2004006008001000SE +/- 3.71, N = 3SE +/- 4.19, N = 15SE +/- 11.09, N = 13SE +/- 2.40, N = 3SE +/- 2.74, N = 15SE +/- 8.93, N = 15SE +/- 4.12, N = 15SE +/- 1.62, N = 15SE +/- 69.47, N = 15SE +/- 1.00, N = 3SE +/- 1.92, N = 1583254455942727823824410911292221582091. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Apache Cassandra

Test: Writes

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: WritesBtrfsEXT4XFS5K10K15K20K25KSE +/- 264.86, N = 3SE +/- 122.21, N = 3SE +/- 288.71, N = 3SE +/- 212.02, N = 3SE +/- 317.35, N = 4SE +/- 325.60, N = 4SE +/- 236.84, N = 3SE +/- 302.71, N = 4SE +/- 219.65, N = 3224572232422942225462338022444230422281322529

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

RAID0RAID10RAID1SingleOpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyBtrfsEXT4XFS20K40K60K80K100KSE +/- 288.87, N = 3SE +/- 425.73, N = 3SE +/- 288.10, N = 3SE +/- 249.01, N = 3SE +/- 216.26, N = 3SE +/- 24.82, N = 3SE +/- 500.82, N = 3SE +/- 283.93, N = 3SE +/- 355.13, N = 3SE +/- 271.87, N = 3SE +/- 179.80, N = 3SE +/- 488.81, N = 3101996.85101193.93101280.89101172.6093430.9292314.73100627.3297761.5699994.22100948.28101849.25100930.951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Facebook RocksDB

Test: Random Read

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random ReadBtrfsEXT4XFS5M10M15M20M25MSE +/- 348403.79, N = 3SE +/- 82890.59, N = 3SE +/- 348286.11, N = 3SE +/- 317731.30, N = 3SE +/- 194517.46, N = 15SE +/- 98838.08, N = 3SE +/- 159370.52, N = 3SE +/- 305525.93, N = 3SE +/- 199256.97, N = 3SE +/- 104490.98, N = 3SE +/- 85438.09, N = 3SE +/- 284713.89, N = 32161022622265871218868922115115519997129208652582201545320905886221671312198943321845972217369001. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4XFS30K60K90K120K150KSE +/- 666.67, N = 3SE +/- 1652.02, N = 4SE +/- 666.67, N = 3SE +/- 1645.34, N = 15SE +/- 622.26, N = 10SE +/- 1254.72, N = 15SE +/- 1360.99, N = 15SE +/- 120.19, N = 3SE +/- 4230.89, N = 12SE +/- 375.65, N = 3SE +/- 152.75, N = 311933310525011433373053652106759353300255671037005013337400488001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4XFS100200300400500SE +/- 3.06, N = 3SE +/- 6.02, N = 4SE +/- 3.38, N = 3SE +/- 6.20, N = 15SE +/- 2.41, N = 10SE +/- 4.81, N = 15SE +/- 5.29, N = 15SE +/- 0.56, N = 3SE +/- 16.53, N = 12SE +/- 0.67, N = 3465.00411.00447.00286.00255.00264.00208.0099.90405.00196.00146.00191.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

SQLite Speedtest

Timed Time - Size 1,000

RAID0RAID10RAID1SingleOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000BtrfsEXT4XFS20406080100SE +/- 0.18, N = 3SE +/- 0.46, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.29, N = 3SE +/- 0.60, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 373.0673.5173.6173.5077.9279.8473.8276.0773.8373.4773.1573.571. (CC) gcc options: -O2 -ldl -lz -lpthread

Facebook RocksDB

Test: Read While Writing

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingBtrfsEXT4XFS160K320K480K640K800KSE +/- 11024.93, N = 4SE +/- 9102.22, N = 6SE +/- 11713.89, N = 3SE +/- 8396.98, N = 3SE +/- 3190.44, N = 3SE +/- 4218.75, N = 3SE +/- 6974.93, N = 3SE +/- 7567.05, N = 3SE +/- 3786.28, N = 3SE +/- 4750.75, N = 3SE +/- 2129.10, N = 3SE +/- 9685.94, N = 57548207528107518067547536934876953307547037329227418597595797428677570791. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

FS-Mark

Test: 1000 Files, 1MB Size

RAID0RAID10RAID1SingleOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4XFS1020304050SE +/- 0.38, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.49, N = 4SE +/- 0.00, N = 3SE +/- 0.55, N = 13SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.47, N = 337.3028.3036.1733.307.4012.1738.136.8034.6229.4318.4746.171. (CC) gcc options: -static

Facebook RocksDB

Test: Random Fill

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillBtrfsEXT4XFS150K300K450K600K750KSE +/- 3146.87, N = 3SE +/- 1496.51, N = 3SE +/- 2445.48, N = 3SE +/- 5328.83, N = 3SE +/- 1386.96, N = 3SE +/- 5206.09, N = 3SE +/- 2938.70, N = 3SE +/- 2943.34, N = 3SE +/- 1791.39, N = 3SE +/- 621.55, N = 3SE +/- 1308.11, N = 3SE +/- 1095.35, N = 36758346748886754646794516046255897206693286366706705606733176771376708421. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Fill Sync

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random Fill SyncBtrfsEXT4XFS5K10K15K20K25KSE +/- 26.93, N = 3SE +/- 90.20, N = 3SE +/- 27.95, N = 3SE +/- 13.68, N = 3SE +/- 77.31, N = 3SE +/- 37.76, N = 3SE +/- 8.33, N = 3SE +/- 46.39, N = 3SE +/- 44.83, N = 3SE +/- 52.00, N = 3SE +/- 48.72, N = 3SE +/- 44.38, N = 32256722749225242251024588247702270924280225512248422636225151. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

RAID0RAID10RAID1SingleOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4XFS160320480640800SE +/- 2.33, N = 3SE +/- 4.51, N = 3SE +/- 4.18, N = 3SE +/- 1.67, N = 3SE +/- 2.96, N = 3SE +/- 1.20, N = 3SE +/- 1.40, N = 15SE +/- 0.88, N = 3SE +/- 0.33, N = 3455.00600.00756.00432.00195.00216.00226.0082.42225.00227.00174.00229.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Facebook RocksDB

Test: Sequential Fill

RAID0RAID10RAID1SingleOpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillBtrfsEXT4XFS200K400K600K800K1000KSE +/- 6346.84, N = 3SE +/- 6749.26, N = 3SE +/- 8455.87, N = 3SE +/- 10923.97, N = 5SE +/- 11499.26, N = 3SE +/- 8899.22, N = 15SE +/- 7691.70, N = 3SE +/- 6468.87, N = 3SE +/- 7818.99, N = 3SE +/- 5804.41, N = 3SE +/- 9919.14, N = 3SE +/- 8059.67, N = 39269999119439292559175087975987802979091038541209383479159349464059182391. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

IOR

Read Test

RAID0RAID10RAID1SingleOpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Read TestBtrfsEXT4XFS110220330440550SE +/- 2.32, N = 3SE +/- 1.34, N = 7SE +/- 0.98, N = 15SE +/- 2.96, N = 3SE +/- 7.14, N = 3SE +/- 4.35, N = 15SE +/- 0.73, N = 15SE +/- 13.97, N = 3SE +/- 0.51, N = 3SE +/- 1.80, N = 3SE +/- 0.91, N = 3SE +/- 2.41, N = 3514.32362.11397.17419.03251.13282.34301.60257.44373.18289.62394.25377.011. (CC) gcc options: -O2 -lm -pthread -lmpi

IOR

Write Test

RAID0RAID10RAID1SingleOpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Write TestBtrfsEXT4XFS714212835SE +/- 0.33, N = 3SE +/- 0.27, N = 7SE +/- 0.55, N = 15SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 15SE +/- 0.34, N = 15SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 330.3125.2330.3328.039.0818.2331.107.1514.1228.9917.0115.621. (CC) gcc options: -O2 -lm -pthread -lmpi

Phoronix Test Suite v10.8.5