SSD RAID Linux 5.5

2 x AMD EPYC 7601 32-Core testing with a Dell 02MJ3T (1.2.5 BIOS) and Matrox G200eW3 on Ubuntu 19.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2001113-HU-SSDRAIDLI49.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionSingleRAID0RAID1RAID5RAID6RAID10RAID0RAID1RAID5RAID6RAID10 EXT4 F2FS Btrfs XFS Btrfs Btrfs Btrfs Btrfs Btrfs EXT4 XFS F2FS EXT4 XFS F2FS EXT4 XFS F2FS EXT4 XFS F2FS EXT4 XFS F2FS2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads)Dell 02MJ3T (1.2.5 BIOS)AMD 17h16 x 32 GB DDR4-2666MT/s 36ASF4G72PZ-2G6D2280GB INTEL SSDPED1D280GA + 13 x 500GB Samsung SSD 860 + 120GB SSDSCKJB120G7RMatrox G200eW3VE2282 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA + 2 x Broadcom NetXtreme BCM5720 2-port PCIeUbuntu 19.105.5.0-999-generic (x86_64) 20191231GNOME Shell 3.34.1X ServerGCC 9.2.1 20191008ext41600x1200f2fsbtrfsxfsbtrfsext4xfsf2fsext4xfsf2fsext4xfsf2fsext4xfsf2fs1024x768ext4xfsVE228f2fs1600x1200OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- Single: EXT4: MQ-DEADLINE / relatime,rw- Single: F2FS: MQ-DEADLINE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Single: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Single: XFS: MQ-DEADLINE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw- RAID0: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- RAID1: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- RAID5: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID5- RAID6: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID6- RAID10: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- RAID0: EXT4: NONE / relatime,rw,stripe=512 / raid0 sde[3] sdd[2] sdc[1] sdb[0]- RAID0: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=4096 / raid0 sde[3] sdb[0] sdc[1] sdd[2]- RAID0: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 sde[3] sdd[2] sdc[1] sdb[0]- RAID1: EXT4: NONE / relatime,rw / raid1 sde[3] sdd[2] sdc[1] sdb[0]- RAID1: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw / raid1 sdb[0] sdc[2] sdd[3] sdn[1]- RAID1: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 sdb[0] sdc[2] sdd[3] sdn[1]- RAID5: EXT4: NONE / relatime,rw,stripe=384 / raid5 sde[4] sdd[2] sdc[1] sdb[0]- RAID5: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=3072 / raid5 sde[4] sdd[2] sdb[0] sdc[1]- RAID5: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid5 sde[4] sdd[2] sdc[1] sdb[0]- RAID6: EXT4: NONE / relatime,rw,stripe=256 / raid6 sde[3] sdd[2] sdc[1] sdb[0]- RAID6: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=2048 / raid6 sde[3] sdc[1] sdd[2] sdb[0]- RAID6: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid6 sdd[2] sde[3] sdc[1] sdb[0]- RAID10: EXT4: NONE / relatime,rw,stripe=256 / raid10 sde[3] sdd[2] sdc[1] sdb[0]- RAID10: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=2048 / raid10 sdb[0] sdd[2] sdc[1] sdh[3]- RAID10: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid10 sdd[1] sde[2] sdc[0] sdb[3]Processor Details- CPU Microcode: 0x8001227Python Details- Python 2.7.17rc1 + Python 3.7.5rc1Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + tsx_async_abort: Not affected

startup-time: Only Seq Reads - xterm - Default Test Directorystartup-time: Seq Reads + Writes - xterm - Default Test Directorystartup-time: Only Seq Reads - GNOME Terminal - Default Test Directorystartup-time: Only Seq Reads - LibreOffice Writer - Default Test Directorystartup-time: Seq Reads + Writes - GNOME Terminal - Default Test Directorystartup-time: Seq Reads + Writes - LibreOffice Writer - Default Test Directorysqlite: 1sqlite: 8fio: Rand Read - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeior: Write Testior: Read Testcompilebench: Initial Createpgbench: Buffer Test - Normal Load - Read Writerocksdb: Seq Fillrocksdb: Read While Writingfio: Rand Read - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 2MB - Default Test DirectorySingleRAID0RAID1RAID5RAID6RAID10RAID0RAID1RAID5RAID6RAID10 EXT4 F2FS Btrfs XFS Btrfs Btrfs Btrfs Btrfs Btrfs EXT4 XFS F2FS EXT4 XFS F2FS EXT4 XFS F2FS EXT4 XFS F2FS EXT4 XFS F2FS1.763331.420677.811226.014336.512334.8540032.356118.04042940.8105333412907436752550012800033530277467171.9179.086.590.00377.69369.624877.47482819177050718481.706441.404335.348893.611784.183112.9260046.928217.66642732.52852085320052250012800026120552400131.7180.0128.6134.71386.43257.994961.477653193912527037334.775517.967495.732061.646053.012733.546069.708147.86539629.13732726930045745011500040536092133165.3178.8161.9176.71343.45214.673281.90505119232853034871.794001.267007.648446.038675.632894.3762232.82484.47342840105003502957553352650112800035230377500185.4160.384.4189.28396.46304.764691.47166719235951297767.115783.0446419.845812.78788.757506.2581171.887251.88585828.61018516132200166012253136671284801205000223.8282.5124.3239.16657.36292.014509.81499019083652127474.000222.8815314.93308.121786.630195.68717116.394278.15041229.17451358250640005225151320003753629253399.0195.2103.1157.62297.90281.282873.47072618979850977452021752571848.690643.6828122.707114.340110.679546.9306783.301227.680102229.37528858453115667154510822766671019864221333173.3204.4117.892.79490.12289.643232.32189019241552369205074267695068.226973.3692017.288611.67008.652675.41756139.651293.467108729.5755161740110266715171096280333728671171667110.2188.893.5104.67513.75291.593188.28236619316451722435403057553606.841562.8961420.771513.02028.755835.6478986.543290.69362629.17433648406104000987981251000741690176667189.8221.7110.9197.11500.32281.343068.922340191888524802930932049036710.70604.9927846.463734.607422.163016.661036.032121.715112440.31046786362716066717331551397000864658168333210.5583.2209.0184.17388.52362.186514.514369190474515137555842886342810.007845.0565045.826035.440622.846317.052935.30383.035111234.6884593364716566719071555398000957677173333231.9442.9230.4196.62417.31319.576003.79232819138752609605524629504756.507953.2175817.763612.57089.408226.1092553.900218.306110532.6835781952913553318931559399000831556142333188.0304.2176.1167.74458.05329.965840.84562419272252375355494069434120.3850830.3212781.464251.820441.1536401.4535640.998133.85132140.010333155129327672332285826716714837833136.9133.586.380.51373.21358.082433.653252190244516958715774113800.4632960.3175931.682782.140420.7483891.01881538.916107.19431840.4103331290284725335045021280001169585149760140.8125.589.2168.79386.08296.033691.18238519352953536951556422485810.5166390.3018521.585561.1571110.8182500.64988948.580256.82133331.581441671433655050850112800016714938067105.1151.6108.9164.77386.14204.323489.692139192467505828116280250800.2044072.6477830.390522.94377.185976.0578940.358308.022111937.89685476366935801821162441566742438698700129.2209.274.268.99369.20367.202681.12484419142251652485562359072098.762441.8590339.190728.06818.630676.1365046.384221.803103340.5103675734801226671852132633966760547012026799.4125.573.066.49369.78305.022625.42203319073751670415132839232995.538661.6233915.263810.28454.776672.9155046.165412.052110032.58315438336858331767157840366742734287536103.0127.075.886.03452.46252.313609.47339419043151650345462168802104.939631.5005324.740118.7895.240143.2673342.278398.33874031.5805240129475327176816114126673372747016773.7148.763.562.16362.44367.372174.39279119358750844463661978801656.038531.3751726.700020.13325.552444.6937843.136332.680111037.89677478391996001794157940433352542710926769.690.042.655.09355.75305.492079.27189819123150584235522368932593.750371.1506111.21017.277673.392572.1645847.713562.31989731.9816635223058817178316044103333202015148764.792.658.972.98336.81218.483235.97797819087352668814451728881561.843450.9643335.951224.035563.020561.8670337.344317.23849235.69103298267682537026751726673012666812799.5210.798.291.34349.95369.262639.03309719125349824702421453471471.355630.6847225.029453.850312.381171.5022536.39988.48747340.5103331027336861256866921773331042582148860220.7184.0106.7185.84392.51304.574654.43846619290752792332335103395170.6729170.2583331.849311.464860.6413060.52713943.916240.95849632.182252972426203364474719100030027269700180.7244.9177.6174.56432.59261.514328.7823171936025358226244145318146OpenBenchmarking.org

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS816243240SE +/- 0.004017, N = 3SE +/- 0.007893, N = 3SE +/- 0.121450, N = 3SE +/- 0.007412, N = 3SE +/- 0.034642, N = 3SE +/- 0.134867, N = 12SE +/- 0.085574, N = 12SE +/- 0.152081, N = 12SE +/- 0.264581, N = 9SE +/- 0.025577, N = 12SE +/- 0.037580, N = 9SE +/- 0.037649, N = 12SE +/- 0.155843, N = 12SE +/- 0.026604, N = 9SE +/- 0.123068, N = 3SE +/- 0.035620, N = 3SE +/- 0.151773, N = 12SE +/- 0.197645, N = 9SE +/- 0.054491, N = 12SE +/- 0.035936, N = 9SE +/- 0.106575, N = 12SE +/- 0.087434, N = 9SE +/- 0.062133, N = 9SE +/- 0.022046, N = 121.7633301.70644034.7755001.7940007.11578010.70600010.0078406.5079504.0002200.3850830.4632960.5166398.6906400.2044078.7624405.5386608.2269704.9396306.0385303.7503706.8415601.8434501.3556300.672917

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS48121620SE +/- 0.014640, N = 3SE +/- 0.023516, N = 3SE +/- 0.199033, N = 6SE +/- 0.009528, N = 3SE +/- 0.037447, N = 12SE +/- 0.024902, N = 3SE +/- 0.070902, N = 4SE +/- 0.053719, N = 12SE +/- 0.121435, N = 12SE +/- 0.014444, N = 12SE +/- 0.015736, N = 9SE +/- 0.018173, N = 9SE +/- 0.086821, N = 9SE +/- 0.419100, N = 12SE +/- 0.131339, N = 12SE +/- 0.017753, N = 12SE +/- 0.055449, N = 12SE +/- 0.029180, N = 12SE +/- 0.061645, N = 12SE +/- 0.015238, N = 12SE +/- 0.047374, N = 12SE +/- 0.027558, N = 12SE +/- 0.024292, N = 12SE +/- 0.008816, N = 121.4206701.40433017.9674001.2670003.0446404.9927805.0565003.2175802.8815300.3212780.3175930.3018523.6828102.6477801.8590301.6233903.3692001.5005301.3751701.1506102.8961400.9643330.6847220.258333

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS20406080100SE +/- 0.01634, N = 3SE +/- 0.04835, N = 3SE +/- 0.71070, N = 3SE +/- 0.01631, N = 3SE +/- 0.31761, N = 12SE +/- 0.47888, N = 8SE +/- 0.47926, N = 3SE +/- 0.10985, N = 3SE +/- 0.78610, N = 12SE +/- 0.04657, N = 12SE +/- 0.07719, N = 12SE +/- 0.04695, N = 12SE +/- 0.34990, N = 3SE +/- 2.55892, N = 9SE +/- 0.50722, N = 3SE +/- 0.16662, N = 3SE +/- 0.24142, N = 3SE +/- 0.36026, N = 3SE +/- 0.22180, N = 3SE +/- 0.19153, N = 3SE +/- 0.23225, N = 6SE +/- 0.17274, N = 12SE +/- 0.06866, N = 3SE +/- 0.03872, N = 127.811225.3488995.732007.6484419.8458046.4637045.8260017.7636014.933001.464251.682781.5855622.7071030.3905039.1907015.2638017.2886024.7401026.7000011.2101020.771505.951225.029451.84931

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS1428425670SE +/- 0.011398, N = 3SE +/- 0.041717, N = 3SE +/- 0.827731, N = 9SE +/- 0.005102, N = 3SE +/- 0.195276, N = 12SE +/- 0.449117, N = 5SE +/- 0.349625, N = 8SE +/- 0.201190, N = 3SE +/- 0.570641, N = 9SE +/- 0.102438, N = 12SE +/- 0.075823, N = 12SE +/- 0.053631, N = 12SE +/- 0.220382, N = 12SE +/- 1.950546, N = 9SE +/- 0.365878, N = 5SE +/- 0.088326, N = 3SE +/- 0.191342, N = 3SE +/- 0.220749, N = 5SE +/- 0.012418, N = 3SE +/- 0.112266, N = 3SE +/- 0.181354, N = 12SE +/- 0.078180, N = 12SE +/- 0.093885, N = 12SE +/- 0.062840, N = 126.0143303.61178061.6460006.03867012.78780034.60740035.44060012.5708008.1217801.8204402.1404201.15711114.34010022.94370028.06810010.28450011.67000018.78900020.1332007.27767013.0202004.0355603.8503101.464860

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS1224364860SE +/- 0.009393, N = 3SE +/- 0.019191, N = 3SE +/- 0.711449, N = 3SE +/- 0.013567, N = 3SE +/- 0.120651, N = 4SE +/- 0.078585, N = 3SE +/- 0.192940, N = 3SE +/- 0.153551, N = 3SE +/- 0.277801, N = 12SE +/- 0.028505, N = 12SE +/- 0.026823, N = 12SE +/- 0.055703, N = 12SE +/- 0.149649, N = 12SE +/- 0.423513, N = 12SE +/- 0.072080, N = 3SE +/- 0.062336, N = 5SE +/- 0.046415, N = 3SE +/- 0.130933, N = 12SE +/- 0.187340, N = 12SE +/- 0.031917, N = 10SE +/- 0.137693, N = 12SE +/- 0.048914, N = 3SE +/- 0.158264, N = 12SE +/- 0.015592, N = 126.5123304.18311053.0127005.6328908.75750022.16300022.8463009.4082206.6301901.1536400.7483890.81825010.6795407.1859708.6306704.7766708.6526705.2401405.5524403.3925708.7558303.0205602.3811700.641306

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS816243240SE +/- 0.028225, N = 3SE +/- 0.022316, N = 3SE +/- 0.251992, N = 3SE +/- 0.009721, N = 3SE +/- 0.014474, N = 3SE +/- 0.096656, N = 3SE +/- 0.050982, N = 3SE +/- 0.063263, N = 8SE +/- 0.169130, N = 12SE +/- 0.035673, N = 12SE +/- 0.098608, N = 9SE +/- 0.030886, N = 12SE +/- 0.100570, N = 4SE +/- 0.027941, N = 3SE +/- 0.083129, N = 4SE +/- 0.039545, N = 4SE +/- 0.082398, N = 12SE +/- 0.126927, N = 12SE +/- 0.508145, N = 9SE +/- 0.023827, N = 12SE +/- 0.063041, N = 3SE +/- 0.050685, N = 12SE +/- 0.020590, N = 4SE +/- 0.016241, N = 124.8540002.92600033.5460004.3762206.25811016.66100017.0529006.1092505.6871701.4535601.0188150.6498896.9306706.0578906.1365002.9155005.4175603.2673304.6937802.1645805.6478901.8670301.5022500.527139

SQLite

Threads / Copies: 1

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1EXT4F2FSBtrfsXFS306090120150SE +/- 0.02, N = 3SE +/- 2.68, N = 15SE +/- 0.69, N = 15SE +/- 0.02, N = 3SE +/- 0.83, N = 15SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.52, N = 3SE +/- 6.10, N = 12SE +/- 0.24, N = 3SE +/- 0.13, N = 3SE +/- 0.71, N = 3SE +/- 0.68, N = 13SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 5.38, N = 10SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 3.42, N = 12SE +/- 0.17, N = 3SE +/- 0.01, N = 3SE +/- 0.29, N = 332.3646.9369.7132.8271.8936.0335.3053.90116.3941.0038.9248.5883.3040.3646.3846.17139.6542.2843.1447.7186.5437.3436.4043.921. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

SQLite

Threads / Copies: 8

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8EXT4F2FSBtrfsXFS120240360480600SE +/- 0.38, N = 3SE +/- 0.53, N = 3SE +/- 1.40, N = 3SE +/- 0.82, N = 3SE +/- 14.70, N = 9SE +/- 0.53, N = 3SE +/- 0.49, N = 3SE +/- 2.43, N = 6SE +/- 15.06, N = 6SE +/- 0.04, N = 3SE +/- 0.94, N = 3SE +/- 0.60, N = 3SE +/- 0.89, N = 3SE +/- 15.91, N = 9SE +/- 13.52, N = 10SE +/- 6.79, N = 3SE +/- 1.92, N = 3SE +/- 11.35, N = 9SE +/- 27.89, N = 9SE +/- 10.63, N = 6SE +/- 14.01, N = 9SE +/- 12.80, N = 9SE +/- 0.52, N = 3SE +/- 0.72, N = 3118.04217.67147.8784.47251.89121.7283.04218.31278.15133.85107.19256.82227.68308.02221.80412.05293.47398.34332.68562.32290.69317.2488.49240.961. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS2004006008001000SE +/- 0.88, N = 3SE +/- 1.86, N = 3SE +/- 0.88, N = 3SE +/- 4.73, N = 3SE +/- 2.33, N = 3SE +/- 5.51, N = 3SE +/- 7.51, N = 3SE +/- 2.85, N = 3SE +/- 2.40, N = 3SE +/- 1.76, N = 3SE +/- 10.27, N = 3SE +/- 4.48, N = 3SE +/- 10.73, N = 3SE +/- 8.95, N = 3SE +/- 14.17, N = 3SE +/- 3.51, N = 3SE +/- 0.67, N = 3SE +/- 7.00, N = 3SE +/- 1.86, N = 3SE +/- 1.33, N = 3SE +/- 0.33, N = 34294273964288581124111211054123213183331022111910331100108774011108976264924734961. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS918273645SE +/- 0.40, N = 3SE +/- 0.31, N = 15SE +/- 0.03, N = 3SE +/- 0.52, N = 15SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 3SE +/- 0.27, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.35, N = 3SE +/- 0.52, N = 3SE +/- 0.17, N = 3SE +/- 0.26, N = 3SE +/- 0.28, N = 10SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.34, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.54, N = 1540.832.732.529.829.140.029.228.640.334.632.629.140.040.431.529.337.840.532.529.531.537.831.929.135.640.532.11. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID1RAID5RAID6RAID10RAID0OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS2K4K6K8K10KSE +/- 33.33, N = 3SE +/- 93.63, N = 3SE +/- 66.67, N = 3SE +/- 33.33, N = 3SE +/- 25.79, N = 3SE +/- 47.77, N = 10SE +/- 25.08, N = 3SE +/- 33.33, N = 3SE +/- 7.84, N = 3SE +/- 19.60, N = 3SE +/- 17.95, N = 3SE +/- 14.81, N = 3SE +/- 11.89, N = 3SE +/- 86.52, N = 3SE +/- 5.51, N = 3SE +/- 33.33, N = 3SE +/- 141.18, N = 15SE +/- 33.33, N = 3SE +/- 11.20, N = 3SE +/- 6.81, N = 310533105007451103331033381447528968510367831575518052967781667433910310333822510467884583571. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS30060090012001500SE +/- 1.33, N = 3SE +/- 6.82, N = 15SE +/- 6.03, N = 3SE +/- 1.45, N = 3SE +/- 6.74, N = 3SE +/- 5.57, N = 3SE +/- 9.68, N = 3SE +/- 2.31, N = 3SE +/- 4.70, N = 15SE +/- 26.50, N = 15SE +/- 5.05, N = 15SE +/- 11.85, N = 3SE +/- 3.28, N = 3SE +/- 8.70, N = 15SE +/- 8.15, N = 12SE +/- 4.94, N = 15SE +/- 8.77, N = 12SE +/- 7.21, N = 15SE +/- 13.78, N = 15SE +/- 5.06, N = 14SE +/- 2.67, N = 3SE +/- 8.45, N = 3SE +/- 3.38, N = 33412853733501018863933819358155129016785847657343861740147835264829810272971. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS140280420560700SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 4.06, N = 3SE +/- 2.00, N = 3SE +/- 4.22, N = 15SE +/- 5.24, N = 3SE +/- 3.18, N = 3SE +/- 9.36, N = 15SE +/- 1.20, N = 3SE +/- 2.19, N = 3SE +/- 14.33, N = 12SE +/- 1.97, N = 4SE +/- 4.58, N = 3SE +/- 5.05, N = 15SE +/- 6.37, N = 15SE +/- 3.22, N = 9SE +/- 3.33, N = 3SE +/- 5.61, N = 15SE +/- 5.20, N = 3SE +/- 7.55, N = 12SE +/- 2.40, N = 3SE +/- 4.00, N = 15SE +/- 4.39, N = 4SE +/- 2.40, N = 32902082722955166276475292501292841434533664803364012943912304062673362421. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS40K80K120K160K200KSE +/- 352.77, N = 3SE +/- 173.21, N = 3SE +/- 1274.10, N = 3SE +/- 536.45, N = 3SE +/- 1087.59, N = 15SE +/- 1452.97, N = 3SE +/- 881.92, N = 3SE +/- 2396.16, N = 15SE +/- 305.51, N = 3SE +/- 887.57, N = 3SE +/- 3679.91, N = 12SE +/- 512.35, N = 4SE +/- 1201.85, N = 3SE +/- 1335.89, N = 15SE +/- 1655.20, N = 15SE +/- 765.03, N = 9SE +/- 666.67, N = 3SE +/- 1432.20, N = 15SE +/- 1249.00, N = 3SE +/- 1935.51, N = 12SE +/- 1036.88, N = 15SE +/- 1132.38, N = 4SE +/- 560.75, N = 3743675320069300755331322001606671656671355336400032767725333655011566793580122667858331026677532799600588171040006825386125620331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS400800120016002000SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 10.50, N = 3SE +/- 0.67, N = 3SE +/- 2.85, N = 3SE +/- 17.83, N = 12SE +/- 2.56, N = 6SE +/- 3.06, N = 3SE +/- 16.75, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 28.53, N = 15SE +/- 22.81, N = 3SE +/- 2.19, N = 3SE +/- 3.21, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 2.31, N = 35255224575261660173319071893522233504508154518211852176715171768179417839877026866441. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS30060090012001500SE +/- 0.67, N = 3SE +/- 5.57, N = 3SE +/- 13.12, N = 3SE +/- 10.17, N = 3SE +/- 0.33, N = 3SE +/- 5.84, N = 3SE +/- 1.76, N = 3SE +/- 6.08, N = 3SE +/- 9.61, N = 3SE +/- 10.20, N = 3SE +/- 9.50, N = 3SE +/- 13.20, N = 3SE +/- 5.78, N = 3SE +/- 7.21, N = 3SE +/- 9.29, N = 3SE +/- 2.08, N = 35005004505011225155115551559515228502501108216241326157810961611157916049816756927471. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS90K180K270K360K450KSE +/- 1201.85, N = 3SE +/- 3214.55, N = 3SE +/- 2516.61, N = 3SE +/- 33.33, N = 3SE +/- 1333.33, N = 3SE +/- 666.67, N = 3SE +/- 1452.97, N = 3SE +/- 2403.70, N = 3SE +/- 2848.00, N = 3SE +/- 2333.33, N = 3SE +/- 3179.80, N = 3SE +/- 1452.97, N = 3SE +/- 1855.92, N = 3SE +/- 2333.33, N = 3SE +/- 577.35, N = 3128000128000115000128000313667397000398000399000132000582671280001280002766674156673396674036672803334126674043334103332510001726671773331910001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS30060090012001500SE +/- 0.67, N = 3SE +/- 6.63, N = 15SE +/- 5.02, N = 5SE +/- 2.67, N = 3SE +/- 12.56, N = 9SE +/- 11.50, N = 3SE +/- 8.09, N = 3SE +/- 6.03, N = 3SE +/- 1.76, N = 3SE +/- 5.45, N = 15SE +/- 8.01, N = 3SE +/- 5.10, N = 15SE +/- 14.33, N = 3SE +/- 3.28, N = 3SE +/- 6.64, N = 3SE +/- 6.51, N = 15SE +/- 11.26, N = 3SE +/- 7.48, N = 15SE +/- 5.96, N = 15SE +/- 5.24, N = 3SE +/- 1.86, N = 3SE +/- 16.77, N = 3SE +/- 1.33, N = 333526140535212848649578313751671169167101942460542772833752532074130110423001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS2004006008001000SE +/- 1.86, N = 3SE +/- 4.51, N = 3SE +/- 1.45, N = 3SE +/- 9.69, N = 6SE +/- 11.06, N = 3SE +/- 7.97, N = 3SE +/- 4.39, N = 15SE +/- 2.40, N = 3SE +/- 1.53, N = 3SE +/- 46.48, N = 15SE +/- 0.33, N = 3SE +/- 2.00, N = 3SE +/- 5.03, N = 3SE +/- 6.72, N = 15SE +/- 3.03, N = 11SE +/- 6.00, N = 3SE +/- 2.03, N = 3SE +/- 5.78, N = 15SE +/- 3.84, N = 15SE +/- 2.85, N = 3SE +/- 4.81, N = 15SE +/- 25.12, N = 15SE +/- 2.96, N = 33022053603038016586775563621485851498643864703426712744272016902665822721. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFS50K100K150K200K250KSE +/- 480.74, N = 3SE +/- 1172.37, N = 3SE +/- 378.59, N = 3SE +/- 2516.61, N = 6SE +/- 2848.00, N = 3SE +/- 1855.92, N = 3SE +/- 1157.45, N = 15SE +/- 633.33, N = 3SE +/- 328.30, N = 3SE +/- 11891.67, N = 15SE +/- 88.19, N = 3SE +/- 666.67, N = 3SE +/- 1250.33, N = 3SE +/- 1711.21, N = 15SE +/- 769.45, N = 11SE +/- 1333.33, N = 3SE +/- 520.68, N = 3SE +/- 1487.94, N = 15SE +/- 973.01, N = 15SE +/- 666.67, N = 3SE +/- 1231.86, N = 15SE +/- 6452.51, N = 15SE +/- 793.73, N = 3774675240092133775002050001683331733331423339253337833149760380672213339870012026787536171667701671092675148717666768127148860697001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4F2FSBtrfsXFS50100150200250SE +/- 0.43, N = 3SE +/- 6.76, N = 15SE +/- 1.47, N = 3SE +/- 1.20, N = 3SE +/- 2.32, N = 3SE +/- 0.65, N = 3SE +/- 0.81, N = 3SE +/- 1.72, N = 3SE +/- 6.08, N = 15SE +/- 0.44, N = 3SE +/- 1.95, N = 4SE +/- 1.67, N = 3SE +/- 2.03, N = 3SE +/- 1.12, N = 3SE +/- 4.39, N = 12SE +/- 1.64, N = 15SE +/- 5.50, N = 15SE +/- 0.91, N = 15SE +/- 6.27, N = 12SE +/- 1.74, N = 15SE +/- 2.02, N = 3SE +/- 0.23, N = 3SE +/- 0.38, N = 3SE +/- 0.33, N = 3171.9131.7165.3185.4223.8210.5231.9188.099.0136.9140.8105.1173.3129.299.4103.0110.273.769.664.7189.899.5220.7180.71. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4F2FSBtrfsXFS130260390520650SE +/- 3.76, N = 14SE +/- 1.07, N = 3SE +/- 11.17, N = 15SE +/- 11.10, N = 12SE +/- 7.86, N = 15SE +/- 0.61, N = 3SE +/- 1.54, N = 3SE +/- 4.03, N = 5SE +/- 1.62, N = 3SE +/- 2.00, N = 12SE +/- 4.24, N = 12SE +/- 1.98, N = 3SE +/- 3.12, N = 3SE +/- 3.44, N = 15SE +/- 5.60, N = 12SE +/- 5.33, N = 9SE +/- 4.74, N = 15SE +/- 0.84, N = 3SE +/- 2.28, N = 12SE +/- 1.59, N = 12SE +/- 13.29, N = 15SE +/- 1.41, N = 3SE +/- 1.99, N = 7SE +/- 0.33, N = 3179.0180.0178.8160.3282.5583.2442.9304.2195.2133.5125.5151.6204.4209.2125.5127.0188.8148.790.092.6221.7210.7184.0244.91. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4F2FSBtrfsXFS50100150200250SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 1.22, N = 3SE +/- 0.44, N = 3SE +/- 5.80, N = 15SE +/- 0.60, N = 3SE +/- 1.14, N = 3SE +/- 3.02, N = 15SE +/- 3.45, N = 14SE +/- 5.68, N = 15SE +/- 7.05, N = 12SE +/- 1.33, N = 15SE +/- 5.90, N = 15SE +/- 0.23, N = 3SE +/- 5.77, N = 15SE +/- 0.75, N = 8SE +/- 3.30, N = 15SE +/- 0.72, N = 7SE +/- 3.39, N = 15SE +/- 0.09, N = 3SE +/- 4.73, N = 15SE +/- 0.93, N = 15SE +/- 1.39, N = 14SE +/- 1.03, N = 386.5128.6161.984.4124.3209.0230.4176.1103.186.389.2108.9117.874.273.075.893.563.542.658.9110.998.2106.7177.61. (CC) gcc options: -static

IOR

Write Test

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Write TestEXT4F2FSBtrfsXFS50100150200250SE +/- 0.28, N = 3SE +/- 1.97, N = 4SE +/- 0.91, N = 3SE +/- 0.78, N = 3SE +/- 1.56, N = 3SE +/- 0.95, N = 3SE +/- 0.44, N = 3SE +/- 1.13, N = 3SE +/- 1.50, N = 3SE +/- 0.37, N = 3SE +/- 0.62, N = 3SE +/- 8.84, N = 15SE +/- 0.65, N = 3SE +/- 0.33, N = 3SE +/- 1.31, N = 15SE +/- 0.78, N = 11SE +/- 1.37, N = 3SE +/- 0.62, N = 8SE +/- 0.92, N = 15SE +/- 1.29, N = 15SE +/- 1.59, N = 3SE +/- 0.53, N = 3SE +/- 0.63, N = 3SE +/- 0.70, N = 390.00134.71176.71189.28239.16184.17196.62167.74157.6280.51168.79164.7792.7968.9966.4986.03104.6762.1655.0972.98197.1191.34185.84174.561. (CC) gcc options: -O2 -lm -pthread -lmpi

IOR

Read Test

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Read TestEXT4F2FSBtrfsXFS140280420560700SE +/- 1.12, N = 3SE +/- 6.45, N = 4SE +/- 0.93, N = 3SE +/- 0.43, N = 3SE +/- 4.52, N = 3SE +/- 1.62, N = 3SE +/- 0.39, N = 3SE +/- 1.69, N = 3SE +/- 14.92, N = 3SE +/- 1.12, N = 3SE +/- 0.35, N = 3SE +/- 4.95, N = 15SE +/- 22.70, N = 3SE +/- 0.84, N = 3SE +/- 9.42, N = 15SE +/- 1.54, N = 11SE +/- 9.91, N = 3SE +/- 2.01, N = 8SE +/- 8.69, N = 15SE +/- 17.95, N = 15SE +/- 5.60, N = 3SE +/- 8.71, N = 3SE +/- 1.27, N = 3SE +/- 1.64, N = 3377.69386.43343.45396.46657.36388.52417.31458.05297.90373.21386.08386.14490.12369.20369.78452.46513.75362.44355.75336.81500.32349.95392.51432.591. (CC) gcc options: -O2 -lm -pthread -lmpi

Compile Bench

Test: Initial Create

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4F2FSBtrfsXFS80160240320400SE +/- 1.14, N = 3SE +/- 3.87, N = 15SE +/- 2.04, N = 3SE +/- 1.46, N = 3SE +/- 3.53, N = 6SE +/- 6.21, N = 3SE +/- 2.39, N = 3SE +/- 5.10, N = 3SE +/- 2.62, N = 10SE +/- 1.64, N = 3SE +/- 1.60, N = 3SE +/- 3.52, N = 12SE +/- 1.41, N = 3SE +/- 1.06, N = 3SE +/- 4.01, N = 3SE +/- 3.75, N = 3SE +/- 3.24, N = 3SE +/- 3.93, N = 3SE +/- 2.63, N = 3SE +/- 2.98, N = 15SE +/- 4.58, N = 3SE +/- 0.20, N = 3SE +/- 2.83, N = 3SE +/- 2.69, N = 15369.62257.99214.67304.76292.01362.18319.57329.96281.28358.08296.03204.32289.64367.20305.02252.31291.59367.37305.49218.48281.34369.26304.57261.51

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteEXT4F2FSBtrfsXFS14002800420056007000SE +/- 61.03, N = 3SE +/- 41.82, N = 3SE +/- 251.33, N = 6SE +/- 356.17, N = 9SE +/- 70.65, N = 9SE +/- 84.80, N = 5SE +/- 812.21, N = 9SE +/- 409.58, N = 6SE +/- 86.05, N = 9SE +/- 26.43, N = 3SE +/- 26.90, N = 3SE +/- 50.59, N = 3SE +/- 52.03, N = 3SE +/- 150.35, N = 9SE +/- 114.01, N = 9SE +/- 91.08, N = 9SE +/- 60.68, N = 9SE +/- 24.93, N = 3SE +/- 28.50, N = 9SE +/- 6.06, N = 3SE +/- 46.64, N = 9SE +/- 73.63, N = 9SE +/- 193.53, N = 6SE +/- 186.03, N = 94877.474961.483281.914691.474509.816514.516003.795840.852873.472433.653691.183489.693232.322681.122625.423609.473188.282174.392079.273235.983068.922639.034654.444328.781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Facebook RocksDB

Test: Sequential Fill

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillEXT4F2FSBtrfsXFS40K80K120K160K200KSE +/- 1877.53, N = 3SE +/- 1302.45, N = 3SE +/- 192.23, N = 3SE +/- 1475.84, N = 3SE +/- 468.36, N = 3SE +/- 579.72, N = 3SE +/- 1156.15, N = 3SE +/- 1799.47, N = 3SE +/- 236.38, N = 3SE +/- 634.71, N = 3SE +/- 1121.31, N = 3SE +/- 2171.87, N = 3SE +/- 2116.87, N = 3SE +/- 815.64, N = 3SE +/- 471.38, N = 3SE +/- 235.32, N = 3SE +/- 2051.64, N = 3SE +/- 2119.08, N = 3SE +/- 739.77, N = 3SE +/- 710.89, N = 3SE +/- 1227.14, N = 3SE +/- 1076.08, N = 3SE +/- 2031.46, N = 3SE +/- 1251.52, N = 31917701939121923281923591908361904741913871927221897981902441935291924671924151914221907371904311931641935871912311908731918881912531929071936021. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Read While Writing

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingEXT4F2FSBtrfsXFS1.1M2.2M3.3M4.4M5.5MSE +/- 51408.63, N = 8SE +/- 43550.79, N = 12SE +/- 62312.38, N = 15SE +/- 49890.84, N = 3SE +/- 50239.52, N = 15SE +/- 27589.86, N = 3SE +/- 50607.79, N = 15SE +/- 71396.74, N = 15SE +/- 57347.13, N = 7SE +/- 57861.20, N = 15SE +/- 84813.20, N = 3SE +/- 27130.40, N = 3SE +/- 48981.34, N = 10SE +/- 60853.21, N = 3SE +/- 72023.44, N = 3SE +/- 60483.96, N = 15SE +/- 30867.20, N = 3SE +/- 73150.73, N = 3SE +/- 56765.47, N = 3SE +/- 64783.58, N = 15SE +/- 40138.43, N = 3SE +/- 65606.98, N = 3SE +/- 44750.84, N = 3SE +/- 81780.97, N = 35071848527037353034875129776521274751513755260960523753550977455169587535369550582815236920516524851670415165034517224350844465058423526688152480294982470527923353582261. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

RAID1RAID5RAID6RAID10RAID0OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4XFSF2FS120240360480600SE +/- 1.53, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 3SE +/- 5.03, N = 3SE +/- 2.40, N = 3SE +/- 5.17, N = 3SE +/- 4.37, N = 3SE +/- 7.17, N = 3SE +/- 1.67, N = 3SE +/- 3.53, N = 3SE +/- 1.00, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.45, N = 3SE +/- 2.85, N = 3SE +/- 3.67, N = 32021571551625075565135465403665524453092422332445585525491. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

RAID1RAID5RAID6RAID10RAID0OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4XFSF2FS140280420560700SE +/- 0.67, N = 3SE +/- 2.29, N = 15SE +/- 13.23, N = 15SE +/- 2.48, N = 15SE +/- 5.93, N = 3SE +/- 1.86, N = 3SE +/- 4.37, N = 15SE +/- 4.07, N = 12SE +/- 2.47, N = 15SE +/- 4.36, N = 12SE +/- 3.58, N = 15SE +/- 6.84, N = 15SE +/- 2.55, N = 14SE +/- 1.33, N = 3SE +/- 4.10, N = 3SE +/- 1.86, N = 3SE +/- 2.73, N = 3SE +/- 4.84, N = 3SE +/- 1.15, N = 317574642804262352832163051972361723201455101454284624061. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

RAID1RAID5RAID6RAID10RAID0OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4XFSF2FS2004006008001000SE +/- 1.20, N = 6SE +/- 1.53, N = 3SE +/- 8.37, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 14.27, N = 15SE +/- 11.41, N = 3SE +/- 1.00, N = 3SE +/- 1.53, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 0.58, N = 3SE +/- 1.33, N = 3SE +/- 8.91, N = 122571132482507699079238807558808938884903473393188639509431. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

RAID1RAID5RAID6RAID10RAID0OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4XFSF2FS130260390520650SE +/- 0.88, N = 3SE +/- 2.66, N = 15SE +/- 4.16, N = 3SE +/- 2.50, N = 15SE +/- 7.13, N = 3SE +/- 1.45, N = 3SE +/- 3.18, N = 3SE +/- 3.25, N = 15SE +/- 5.57, N = 3SE +/- 3.72, N = 15SE +/- 2.97, N = 15SE +/- 2.91, N = 3SE +/- 0.88, N = 3SE +/- 8.39, N = 3SE +/- 0.67, N = 3SE +/- 5.84, N = 3SE +/- 4.06, N = 3SE +/- 3.18, N = 318480581805062092992103601652591563671475171464284754121. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.4