Linux 5.4 HDD File-System RAID Benchmarks

AMD Ryzen 5 3400G storage testing on Linux 5.4 by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1910292-HU-HDDTESTS045&rdt&grr.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionSingleRAID1RAID0RAID10RAID0RAID1RAID10 EXT4 XFS Btrfs Btrfs Btrfs Btrfs EXT4 XFS EXT4 XFS EXT4 XFSAMD Ryzen 5 3400G @ 3.70GHz (4 Cores / 8 Threads)ASUS PRIME B450M-A (1814 BIOS)AMD Device 15d02 x 8192 MB DDR4-3000MT/s CRUCIAL29GB INTEL MEMPEK1W032GA + 4 x 6001GB Seagate ST6000VN0033-2EEASUS AMD Picasso 2GB (1400/1500MHz)AMD Device 15deASUS PB278Realtek RTL8111/8168/8411Ubuntu 19.045.4.0-999-generic (x86_64) 20191024GNOME Shell 3.32.2X Server4.5 Mesa 19.0.8 (LLVM 8.0.0)GCC 8.3.0ext42560x1440xfsbtrfsext4xfsext4xfsext4xfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- Single: EXT4: MQ-DEADLINE / relatime,rw- Single: XFS: MQ-DEADLINE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw- Single: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5- RAID1: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID1- RAID0: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID0- RAID10: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID10- RAID0: EXT4: NONE / relatime,rw,stripe=512 / raid0 sdd[3] sdc[2] sdb[1] sda[0]- RAID0: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=4096 / raid0 sda[0] sdd[3] sdc[2] sdb[1] - RAID1: EXT4: NONE / relatime,rw / raid1 sdd[3] sdc[2] sdb[1] sda[0]- RAID1: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw / raid1 sdc[2] sdb[1] sdd[3] sda[0]- RAID10: EXT4: NONE / relatime,rw,stripe=256 / raid10 sdd[3] sdc[2] sdb[1] sda[0]- RAID10: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=2048 / raid10 sdd[3] sdc[2] sda[0] sdb[1] Processor Details- Scaling Governor: acpi-cpufreq ondemandJava Details- OpenJDK Runtime Environment (build 11.0.4+11-post-Ubuntu-1ubuntu219.04)Python Details- Python 2.7.16 + Python 3.7.3Security Details- l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling

sqlite: 1startup-time: Only Seq Reads - xterm - Default Test Directorycassandra: Readsstartup-time: Seq Reads + Writes - xterm - Default Test Directorystartup-time: Seq Reads + Writes - LibreOffice Writer - Default Test Directorycassandra: Mixed 1:3startup-time: Seq Reads + Writes - GNOME Terminal - Default Test Directorycompilebench: Compilecassandra: Mixed 1:1build-llvm: Time To Compilepgbench: Buffer Test - Normal Load - Read Writefio: Seq Write - Linux AIO - Yes - No - 2MB - Default Test Directorycassandra: Writespgbench: Buffer Test - Normal Load - Read Onlyrocksdb: Rand Readfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directorysqlite-speedtest: Timed Time - Size 1,000rocksdb: Read While Writingfs-mark: 1000 Files, 1MB Sizerocksdb: Rand Fillrocksdb: Rand Fill Syncfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directoryrocksdb: Seq Fillior: Read Testior: Write TestSingleRAID1RAID0RAID10RAID0RAID1RAID10 EXT4 XFS Btrfs Btrfs Btrfs Btrfs EXT4 XFS EXT4 XFS EXT4 XFS533.0743.021897519.8683.611754478.21586.2818894984.69370.2815822813101849.25218459723740014673.1574286718.4767713722636174946405394.2517.01319.3174.571891233.3371.7917539102.50649.1418284975.26240.4220922529100930.95217369004880019173.5775707946.1767084222515229918239377.0115.62582.8067.281817855.00101.7617862689.2718311977.32231.8522223042100948.28219894335013319673.4775957929.4367331722484227915934289.6228.99412.0325.69188518.7518.021815733.25827.9818857978.42254.8524423380100627.32220154535330020873.8275470338.1366932822709226909103301.6031.10454.888.94188674.6410.171754313.071280.0818622976.14309.9883222457101996.852161022611933346573.0675482037.3067583422567455926999514.3230.31529.6519.921882710.8721.741780229.60923.1518544975.66261.9542722546101172.60211511557305328673.5075475333.3067945122510432917508419.0328.03377.5423.99185319.9923.651748626.361050.8618774981.91500.2754422324101193.932226587110525041173.5175281028.3067488822749600911943362.1125.23305.3723.02189637.4115.821762719.911169.2517914976.51420.0755922942101280.892188689211433344773.6175180636.1767546422524756929255397.1730.332290.412.022.674.625.63457.921015.2689.8710997761.56209058862556799.9076.077329226.806366702428082.42854120257.447.15408.0210.15183752.594.58179545.39603.4518574978.32313.5811292244499994.222216713110370040573.8374185934.6267056022551225938347373.1814.122302.1928.6613.7045.1449.27573.711055.79182.5527893430.92199971296521025577.926934877.4060462524588195797598251.139.081083.3627.8513.6543.1049.68536.871066.94147.4123892314.73208652586759326479.8469533012.1758972024770216780297282.3418.23OpenBenchmarking.org

SQLite

Threads / Copies: 1

SingleRAID1RAID0RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1EXT4XFSBtrfs5001000150020002500SE +/- 5.29, N = 3SE +/- 2.84, N = 3SE +/- 0.14, N = 3SE +/- 2.15, N = 3SE +/- 12.61, N = 3SE +/- 4.56, N = 9SE +/- 3.65, N = 3SE +/- 0.66, N = 3SE +/- 0.53, N = 3SE +/- 3.90, N = 3SE +/- 37.37, N = 3SE +/- 9.71, N = 3533.07319.31582.80412.032290.41408.02454.88377.54305.37529.652302.191083.361. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test DirectoryEXT4XFSBtrfs20406080100SE +/- 1.18, N = 12SE +/- 2.69, N = 7SE +/- 1.15, N = 9SE +/- 2.69, N = 12SE +/- 0.22, N = 12SE +/- 1.12, N = 9SE +/- 0.18, N = 12SE +/- 0.53, N = 12SE +/- 0.40, N = 12SE +/- 0.81, N = 12SE +/- 0.37, N = 3SE +/- 0.27, N = 943.0274.5767.2825.692.0210.158.9423.9923.0219.9228.6627.85

Apache Cassandra

Test: Reads

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: ReadsEXT4XFSBtrfs4K8K12K16K20KSE +/- 397.24, N = 12SE +/- 428.17, N = 12SE +/- 486.43, N = 12SE +/- 451.22, N = 12SE +/- 464.19, N = 12SE +/- 406.13, N = 12SE +/- 518.49, N = 12SE +/- 459.74, N = 12SE +/- 483.29, N = 12189751891218178188511837518867185311896318827

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test DirectoryEXT4XFSBtrfs1224364860SE +/- 0.83, N = 9SE +/- 1.20, N = 12SE +/- 0.75, N = 9SE +/- 0.52, N = 10SE +/- 0.33, N = 12SE +/- 0.28, N = 9SE +/- 0.18, N = 9SE +/- 0.48, N = 9SE +/- 0.26, N = 12SE +/- 0.33, N = 9SE +/- 0.14, N = 12SE +/- 0.18, N = 1219.8633.3355.008.752.672.594.649.997.4110.8713.7013.65

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryEXT4XFSBtrfs20406080100SE +/- 3.00, N = 6SE +/- 3.08, N = 8SE +/- 1.60, N = 9SE +/- 1.37, N = 12SE +/- 0.58, N = 12SE +/- 0.53, N = 12SE +/- 0.18, N = 12SE +/- 0.66, N = 9SE +/- 0.05, N = 3SE +/- 0.54, N = 12SE +/- 0.67, N = 4SE +/- 0.65, N = 383.6171.79101.7618.024.624.5810.1723.6515.8221.7445.1443.10

Apache Cassandra

Test: Mixed 1:3

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: Mixed 1:3EXT4XFSBtrfs4K8K12K16K20KSE +/- 455.96, N = 9SE +/- 319.83, N = 12SE +/- 377.44, N = 12SE +/- 169.19, N = 3SE +/- 410.14, N = 12SE +/- 413.14, N = 12SE +/- 453.58, N = 12SE +/- 411.93, N = 10SE +/- 308.57, N = 12175441753917862181571795417543174861762717802

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryEXT4XFSBtrfs20406080100SE +/- 1.33, N = 9SE +/- 1.25, N = 2SE +/- 3.69, N = 12SE +/- 0.85, N = 9SE +/- 0.48, N = 9SE +/- 0.33, N = 12SE +/- 0.36, N = 3SE +/- 0.26, N = 3SE +/- 0.71, N = 12SE +/- 0.27, N = 3SE +/- 0.77, N = 378.21102.5033.255.635.3913.0726.3619.9129.6049.2749.68

Compile Bench

Test: Compile

SingleRAID1RAID0RAID10OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileEXT4XFSBtrfs30060090012001500SE +/- 3.04, N = 3SE +/- 8.39, N = 5SE +/- 5.58, N = 15SE +/- 7.03, N = 15SE +/- 12.36, N = 9SE +/- 10.43, N = 3SE +/- 10.26, N = 13SE +/- 13.73, N = 4SE +/- 10.62, N = 3SE +/- 14.65, N = 15SE +/- 12.09, N = 12SE +/- 24.33, N = 9586.28649.14689.27827.98457.92603.451280.081050.861169.25923.15573.71536.87

Apache Cassandra

Test: Mixed 1:1

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: Mixed 1:1EXT4XFSBtrfs4K8K12K16K20KSE +/- 308.87, N = 3SE +/- 221.66, N = 12SE +/- 205.87, N = 12SE +/- 82.49, N = 3SE +/- 216.30, N = 12SE +/- 234.54, N = 5SE +/- 270.71, N = 3SE +/- 305.74, N = 12SE +/- 29.17, N = 3188941828418311188571857418622187741791418544

Timed LLVM Compilation

Time To Compile

SingleRAID1RAID0RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 6.0.1Time To CompileEXT4XFSBtrfs2004006008001000984.69975.26977.32978.421015.26978.32976.14981.91976.51975.661055.791066.94

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

SingleRAID1RAID0RAID10OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteEXT4XFSBtrfs110220330440550SE +/- 2.65, N = 3SE +/- 3.64, N = 15SE +/- 1.24, N = 3SE +/- 4.80, N = 15SE +/- 0.52, N = 3SE +/- 4.93, N = 15SE +/- 1.26, N = 3SE +/- 2.87, N = 3SE +/- 19.15, N = 12SE +/- 1.52, N = 3SE +/- 1.95, N = 15SE +/- 2.36, N = 15370.28240.42231.85254.8589.87313.58309.98500.27420.07261.95182.55147.411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4XFSBtrfs2004006008001000SE +/- 1.92, N = 15SE +/- 1.00, N = 3SE +/- 4.12, N = 15SE +/- 1.62, N = 15SE +/- 69.47, N = 15SE +/- 3.71, N = 3SE +/- 4.19, N = 15SE +/- 11.09, N = 13SE +/- 2.40, N = 3SE +/- 2.74, N = 15SE +/- 8.93, N = 1515820922224410911298325445594272782381. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Apache Cassandra

Test: Writes

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: WritesEXT4XFSBtrfs5K10K15K20K25KSE +/- 302.71, N = 4SE +/- 219.65, N = 3SE +/- 236.84, N = 3SE +/- 317.35, N = 4SE +/- 325.60, N = 4SE +/- 264.86, N = 3SE +/- 122.21, N = 3SE +/- 288.71, N = 3SE +/- 212.02, N = 3228132252923042233802244422457223242294222546

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

SingleRAID1RAID0RAID10OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyEXT4XFSBtrfs20K40K60K80K100KSE +/- 179.80, N = 3SE +/- 488.81, N = 3SE +/- 271.87, N = 3SE +/- 500.82, N = 3SE +/- 283.93, N = 3SE +/- 355.13, N = 3SE +/- 288.87, N = 3SE +/- 425.73, N = 3SE +/- 288.10, N = 3SE +/- 249.01, N = 3SE +/- 216.26, N = 3SE +/- 24.82, N = 3101849.25100930.95100948.28100627.3297761.5699994.22101996.85101193.93101280.89101172.6093430.9292314.731. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Facebook RocksDB

Test: Random Read

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random ReadEXT4XFSBtrfs5M10M15M20M25MSE +/- 85438.09, N = 3SE +/- 284713.89, N = 3SE +/- 104490.98, N = 3SE +/- 159370.52, N = 3SE +/- 305525.93, N = 3SE +/- 199256.97, N = 3SE +/- 348403.79, N = 3SE +/- 82890.59, N = 3SE +/- 348286.11, N = 3SE +/- 317731.30, N = 3SE +/- 194517.46, N = 15SE +/- 98838.08, N = 32184597221736900219894332201545320905886221671312161022622265871218868922115115519997129208652581. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfs30K60K90K120K150KSE +/- 152.75, N = 3SE +/- 375.65, N = 3SE +/- 1360.99, N = 15SE +/- 120.19, N = 3SE +/- 4230.89, N = 12SE +/- 666.67, N = 3SE +/- 1652.02, N = 4SE +/- 666.67, N = 3SE +/- 1645.34, N = 15SE +/- 622.26, N = 10SE +/- 1254.72, N = 1537400488005013353300255671037001193331052501143337305365210675931. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfs100200300400500SE +/- 0.67, N = 3SE +/- 5.29, N = 15SE +/- 0.56, N = 3SE +/- 16.53, N = 12SE +/- 3.06, N = 3SE +/- 6.02, N = 4SE +/- 3.38, N = 3SE +/- 6.20, N = 15SE +/- 2.41, N = 10SE +/- 4.81, N = 15146.00191.00196.00208.0099.90405.00465.00411.00447.00286.00255.00264.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

SQLite Speedtest

Timed Time - Size 1,000

SingleRAID1RAID0RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000EXT4XFSBtrfs20406080100SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.46, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.29, N = 3SE +/- 0.60, N = 373.1573.5773.4773.8276.0773.8373.0673.5173.6173.5077.9279.841. (CC) gcc options: -O2 -ldl -lz -lpthread

Facebook RocksDB

Test: Read While Writing

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingEXT4XFSBtrfs160K320K480K640K800KSE +/- 2129.10, N = 3SE +/- 9685.94, N = 5SE +/- 4750.75, N = 3SE +/- 6974.93, N = 3SE +/- 7567.05, N = 3SE +/- 3786.28, N = 3SE +/- 11024.93, N = 4SE +/- 9102.22, N = 6SE +/- 11713.89, N = 3SE +/- 8396.98, N = 3SE +/- 3190.44, N = 3SE +/- 4218.75, N = 37428677570797595797547037329227418597548207528107518067547536934876953301. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

FS-Mark

Test: 1000 Files, 1MB Size

SingleRAID1RAID0RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4XFSBtrfs1020304050SE +/- 0.03, N = 3SE +/- 0.47, N = 3SE +/- 0.23, N = 3SE +/- 0.49, N = 4SE +/- 0.00, N = 3SE +/- 0.55, N = 13SE +/- 0.38, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 318.4746.1729.4338.136.8034.6237.3028.3036.1733.307.4012.171. (CC) gcc options: -static

Facebook RocksDB

Test: Random Fill

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillEXT4XFSBtrfs150K300K450K600K750KSE +/- 1308.11, N = 3SE +/- 1095.35, N = 3SE +/- 621.55, N = 3SE +/- 2938.70, N = 3SE +/- 2943.34, N = 3SE +/- 1791.39, N = 3SE +/- 3146.87, N = 3SE +/- 1496.51, N = 3SE +/- 2445.48, N = 3SE +/- 5328.83, N = 3SE +/- 1386.96, N = 3SE +/- 5206.09, N = 36771376708426733176693286366706705606758346748886754646794516046255897201. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Fill Sync

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random Fill SyncEXT4XFSBtrfs5K10K15K20K25KSE +/- 48.72, N = 3SE +/- 44.38, N = 3SE +/- 52.00, N = 3SE +/- 8.33, N = 3SE +/- 46.39, N = 3SE +/- 44.83, N = 3SE +/- 26.93, N = 3SE +/- 90.20, N = 3SE +/- 27.95, N = 3SE +/- 13.68, N = 3SE +/- 77.31, N = 3SE +/- 37.76, N = 32263622515224842270924280225512256722749225242251024588247701. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID1RAID0RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4XFSBtrfs160320480640800SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 1.40, N = 15SE +/- 0.88, N = 3SE +/- 2.33, N = 3SE +/- 4.51, N = 3SE +/- 4.18, N = 3SE +/- 1.67, N = 3SE +/- 2.96, N = 3174.00229.00227.00226.0082.42225.00455.00600.00756.00432.00195.00216.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Facebook RocksDB

Test: Sequential Fill

SingleRAID1RAID0RAID10OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillEXT4XFSBtrfs200K400K600K800K1000KSE +/- 9919.14, N = 3SE +/- 8059.67, N = 3SE +/- 5804.41, N = 3SE +/- 7691.70, N = 3SE +/- 6468.87, N = 3SE +/- 7818.99, N = 3SE +/- 6346.84, N = 3SE +/- 6749.26, N = 3SE +/- 8455.87, N = 3SE +/- 10923.97, N = 5SE +/- 11499.26, N = 3SE +/- 8899.22, N = 159464059182399159349091038541209383479269999119439292559175087975987802971. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

IOR

Read Test

SingleRAID1RAID0RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Read TestEXT4XFSBtrfs110220330440550SE +/- 0.91, N = 3SE +/- 2.41, N = 3SE +/- 1.80, N = 3SE +/- 0.73, N = 15SE +/- 13.97, N = 3SE +/- 0.51, N = 3SE +/- 2.32, N = 3SE +/- 1.34, N = 7SE +/- 0.98, N = 15SE +/- 2.96, N = 3SE +/- 7.14, N = 3SE +/- 4.35, N = 15394.25377.01289.62301.60257.44373.18514.32362.11397.17419.03251.13282.341. (CC) gcc options: -O2 -lm -pthread -lmpi

IOR

Write Test

SingleRAID1RAID0RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Write TestEXT4XFSBtrfs714212835SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.34, N = 15SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.33, N = 3SE +/- 0.27, N = 7SE +/- 0.55, N = 15SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 1517.0115.6228.9931.107.1514.1230.3125.2330.3328.039.0818.231. (CC) gcc options: -O2 -lm -pthread -lmpi

Phoronix Test Suite v10.8.5