SSD RAID Linux 5.5 Performance

Linux 5.5 solid-state drive RAID benchmarks by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2001248-PTS-SSDRAID643
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 2 Tests
Database Test Suite 2 Tests
Disk Test Suite 4 Tests
Server 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Single: Btrfs
January 03 2020
  3 Hours, 43 Minutes
Single: EXT4
January 03 2020
  1 Hour, 59 Minutes
Single: F2FS
January 03 2020
  2 Hours, 10 Minutes
Single: XFS
January 04 2020
  2 Hours, 36 Minutes
RAID0: Btrfs
January 04 2020
  4 Hours, 36 Minutes
RAID0: EXT4
January 06 2020
  2 Hours, 32 Minutes
RAID0: F2FS
January 06 2020
  3 Hours, 13 Minutes
RAID0: XFS
January 06 2020
  2 Hours, 43 Minutes
RAID1: Btrfs
January 04 2020
  5 Hours, 25 Minutes
RAID1: EXT4
January 06 2020
  4 Hours, 54 Minutes
RAID1: F2FS
January 07 2020
  4 Hours, 29 Minutes
RAID1: XFS
January 07 2020
  4 Hours, 14 Minutes
RAID5: Btrfs
January 05 2020
  3 Hours, 36 Minutes
RAID5: EXT4
January 07 2020
  5 Hours, 2 Minutes
RAID5: F2FS
January 08 2020
  3 Hours, 46 Minutes
RAID5: XFS
January 08 2020
  4 Hours, 23 Minutes
RAID6: Btrfs
January 05 2020
  4 Hours, 21 Minutes
RAID6: EXT4
January 08 2020
  4 Hours, 27 Minutes
RAID6: F2FS
January 09 2020
  4 Hours, 54 Minutes
RAID6: XFS
January 09 2020
  6 Hours, 16 Minutes
RAID10: Btrfs
January 05 2020
  5 Hours, 13 Minutes
RAID10: EXT4
January 10 2020
  5 Hours, 29 Minutes
RAID10: F2FS
January 11 2020
  4 Hours, 53 Minutes
RAID10: XFS
January 10 2020
  3 Hours, 32 Minutes
Invert Hiding All Results Option
  4 Hours, 6 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


SSD RAID Linux 5.5 PerformanceOpenBenchmarking.orgPhoronix Test Suite2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads)Dell 02MJ3T (1.2.5 BIOS)AMD 17h16 x 32 GB DDR4-2666MT/s 36ASF4G72PZ-2G6D2280GB INTEL SSDPED1D280GA + 13 x 500GB Samsung SSD 860 + 120GB SSDSCKJB120G7RMatrox G200eW32 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA + 2 x Broadcom NetXtreme BCM5720 2-port PCIeUbuntu 19.105.5.0-999-generic (x86_64) 20191231GNOME Shell 3.34.1X ServerGCC 9.2.1 20191008btrfsext4f2fsxfsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemsSSD RAID Linux 5.5 Performance BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Single: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Single: EXT4: MQ-DEADLINE / relatime,rw- Single: F2FS: MQ-DEADLINE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - Single: XFS: MQ-DEADLINE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw- RAID0: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- RAID0: EXT4: NONE / relatime,rw,stripe=512 / raid0 sde[3] sdd[2] sdc[1] sdb[0]- RAID0: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 sde[3] sdd[2] sdc[1] sdb[0] - RAID0: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=4096 / raid0 sde[3] sdb[0] sdc[1] sdd[2] - RAID1: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- RAID1: EXT4: NONE / relatime,rw / raid1 sde[3] sdd[2] sdc[1] sdb[0]- RAID1: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 sdb[0] sdc[2] sdd[3] sdn[1] - RAID1: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw / raid1 sdb[0] sdc[2] sdd[3] sdn[1]- RAID5: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID5- RAID5: EXT4: NONE / relatime,rw,stripe=384 / raid5 sde[4] sdd[2] sdc[1] sdb[0]- RAID5: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid5 sde[4] sdd[2] sdc[1] sdb[0] - RAID5: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=3072 / raid5 sde[4] sdd[2] sdb[0] sdc[1] - RAID6: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID6- RAID6: EXT4: NONE / relatime,rw,stripe=256 / raid6 sde[3] sdd[2] sdc[1] sdb[0]- RAID6: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid6 sdd[2] sde[3] sdc[1] sdb[0] - RAID6: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=2048 / raid6 sde[3] sdc[1] sdd[2] sdb[0] - RAID10: Btrfs: MQ-DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- RAID10: EXT4: NONE / relatime,rw,stripe=256 / raid10 sde[3] sdd[2] sdc[1] sdb[0]- RAID10: F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,discard,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid10 sdd[1] sde[2] sdc[0] sdb[3] - RAID10: XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,sunit=1024,swidth=2048 / raid10 sdb[0] sdd[2] sdc[1] sdh[3] - CPU Microcode: 0x8001227- Python 2.7.17rc1 + Python 3.7.5rc1- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + tsx_async_abort: Not affected

startup-time: Only Seq Reads - xterm - Default Test Directorystartup-time: Seq Reads + Writes - xterm - Default Test Directorystartup-time: Only Seq Reads - GNOME Terminal - Default Test Directorystartup-time: Only Seq Reads - LibreOffice Writer - Default Test Directorystartup-time: Seq Reads + Writes - GNOME Terminal - Default Test Directorystartup-time: Seq Reads + Writes - LibreOffice Writer - Default Test Directorysqlite: 1sqlite: 8fio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 2MB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeior: Write Testior: Read Testcompilebench: Initial Createpgbench: Buffer Test - Normal Load - Read WriteSingleRAID0RAID1RAID5RAID6RAID10 Btrfs EXT4 F2FS XFS Btrfs EXT4 F2FS XFS Btrfs EXT4 F2FS XFS Btrfs EXT4 F2FS XFS Btrfs EXT4 F2FS XFS Btrfs EXT4 F2FS XFS34.775517.967495.732061.646053.012733.546069.708147.86569300457405165.3178.8161.9176.71343.45214.673281.9050511.763331.420677.811226.014336.512334.8540032.356118.0401053374367525335171.9179.086.590.00377.69369.624877.4748281.706441.404335.348893.611784.183112.9260046.928217.66653200522261131.7180.0128.6134.71386.43257.994961.4776531.794001.267007.648446.038675.632894.3762232.82484.4731050075533526352185.4160.384.4189.28396.46304.764691.4716677.115783.0446419.845812.78788.757506.2581171.887251.88513220016601284223.8282.5124.3239.16657.36292.014509.81499010.70604.9927846.463734.607422.163016.661036.032121.715104671606671733864210.5583.2209.0184.17388.52362.186514.5143696.507953.2175817.763612.57089.408226.1092553.900218.30683571355331893831188.0304.2176.1167.74458.05329.965840.84562410.007845.0565045.826035.440622.846317.052935.30383.03588451656671907957231.9442.9230.4196.62417.31319.576003.7923284.000222.8815314.93308.121786.630195.68717116.394278.15074516400052237599.0195.2103.1157.62297.90281.282873.4707260.3850830.3212781.464251.820441.1536401.4535640.998133.8511033332767233167136.9133.586.380.51373.21358.082433.6532520.5166390.3018521.585561.1571110.8182500.64988948.580256.821814436550508167105.1151.6108.9164.77386.14204.323489.6921390.4632960.3175931.682782.140420.7483891.01881538.916107.19410333725335041169140.8125.589.2168.79386.08296.033691.1823858.690643.6828122.707114.340110.679546.9306783.301227.680752811566715451019173.3204.4117.892.79490.12289.643232.3218900.2044072.6477830.390522.94377.185976.0578940.358308.0229685935801821424129.2209.274.268.99369.20367.202681.1248445.538661.6233915.263810.28454.776672.9155046.165412.0528315858331767427103.0127.075.886.03452.46252.313609.4733948.762441.8590339.190728.06818.630676.1365046.384221.80310367122667185260599.4125.573.066.49369.78305.022625.4220338.226973.3692017.288611.67008.652675.41756139.651293.46775511026671517728110.2188.893.5104.67513.75291.593188.2823664.939631.5005324.740118.7895.240143.2673342.278398.338805275327176833773.7148.763.562.16362.44367.372174.3927913.750371.1506111.21017.277673.392572.1645847.713562.319816658817178332064.792.658.972.98336.81218.483235.9779786.038531.3751726.700020.13325.552444.6937843.136332.680967799600179452569.690.042.655.09355.75305.492079.2718986.841562.8961420.771513.02028.755835.6478986.543290.6937433104000987741189.8221.7110.9197.11500.32281.343068.9223401.843450.9643335.951224.035563.020561.8670337.344317.23891036825370230199.5210.798.291.34349.95369.262639.0330970.6729170.2583331.849311.464860.6413060.52713943.916240.958822562033644300180.7244.9177.6174.56432.59261.514328.7823171.355630.6847225.029453.850312.381171.5022536.39988.48710333861256861042220.7184.0106.7185.84392.51304.574654.438466OpenBenchmarking.org

Application Start-up Time

This benchmark measures the start-up time of applications when there is some I/O in the background. Learn more via the OpenBenchmarking.org test page.

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS816243240SE +/- 0.121450, N = 3SE +/- 0.004017, N = 3SE +/- 0.007893, N = 3SE +/- 0.007412, N = 3SE +/- 0.034642, N = 3SE +/- 0.134867, N = 12SE +/- 0.152081, N = 12SE +/- 0.085574, N = 12SE +/- 0.264581, N = 9SE +/- 0.025577, N = 12SE +/- 0.037649, N = 12SE +/- 0.037580, N = 9SE +/- 0.155843, N = 12SE +/- 0.026604, N = 9SE +/- 0.035620, N = 3SE +/- 0.123068, N = 3SE +/- 0.151773, N = 12SE +/- 0.197645, N = 9SE +/- 0.035936, N = 9SE +/- 0.054491, N = 12SE +/- 0.106575, N = 12SE +/- 0.087434, N = 9SE +/- 0.022046, N = 12SE +/- 0.062133, N = 934.7755001.7633301.7064401.7940007.11578010.7060006.50795010.0078404.0002200.3850830.5166390.4632968.6906400.2044075.5386608.7624408.2269704.9396303.7503706.0385306.8415601.8434500.6729171.355630
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS714212835Min: 34.56 / Avg: 34.78 / Max: 34.98Min: 1.76 / Avg: 1.76 / Max: 1.77Min: 1.69 / Avg: 1.71 / Max: 1.72Min: 1.78 / Avg: 1.79 / Max: 1.81Min: 7.07 / Avg: 7.12 / Max: 7.18Min: 10.08 / Avg: 10.71 / Max: 11.87Min: 5.85 / Avg: 6.51 / Max: 7.44Min: 9.64 / Avg: 10.01 / Max: 10.65Min: 2.65 / Avg: 4 / Max: 5.71Min: 0.29 / Avg: 0.39 / Max: 0.58Min: 0.36 / Avg: 0.52 / Max: 0.84Min: 0.32 / Avg: 0.46 / Max: 0.67Min: 7.78 / Avg: 8.69 / Max: 9.48Min: 0.15 / Avg: 0.2 / Max: 0.41Min: 5.47 / Avg: 5.54 / Max: 5.59Min: 8.52 / Avg: 8.76 / Max: 8.89Min: 7.34 / Avg: 8.23 / Max: 9Min: 4.01 / Avg: 4.94 / Max: 5.74Min: 3.58 / Avg: 3.75 / Max: 3.88Min: 5.55 / Avg: 6.04 / Max: 6.2Min: 6.27 / Avg: 6.84 / Max: 7.66Min: 1.5 / Avg: 1.84 / Max: 2.41Min: 0.55 / Avg: 0.67 / Max: 0.83Min: 1.01 / Avg: 1.36 / Max: 1.61

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS48121620SE +/- 0.199033, N = 6SE +/- 0.014640, N = 3SE +/- 0.023516, N = 3SE +/- 0.009528, N = 3SE +/- 0.037447, N = 12SE +/- 0.024902, N = 3SE +/- 0.053719, N = 12SE +/- 0.070902, N = 4SE +/- 0.121435, N = 12SE +/- 0.014444, N = 12SE +/- 0.018173, N = 9SE +/- 0.015736, N = 9SE +/- 0.086821, N = 9SE +/- 0.419100, N = 12SE +/- 0.017753, N = 12SE +/- 0.131339, N = 12SE +/- 0.055449, N = 12SE +/- 0.029180, N = 12SE +/- 0.015238, N = 12SE +/- 0.061645, N = 12SE +/- 0.047374, N = 12SE +/- 0.027558, N = 12SE +/- 0.008816, N = 12SE +/- 0.024292, N = 1217.9674001.4206701.4043301.2670003.0446404.9927803.2175805.0565002.8815300.3212780.3018520.3175933.6828102.6477801.6233901.8590303.3692001.5005301.1506101.3751702.8961400.9643330.2583330.684722
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS510152025Min: 17.48 / Avg: 17.97 / Max: 18.82Min: 1.39 / Avg: 1.42 / Max: 1.44Min: 1.37 / Avg: 1.4 / Max: 1.45Min: 1.25 / Avg: 1.27 / Max: 1.28Min: 2.83 / Avg: 3.04 / Max: 3.26Min: 4.96 / Avg: 4.99 / Max: 5.04Min: 2.76 / Avg: 3.22 / Max: 3.44Min: 4.85 / Avg: 5.06 / Max: 5.16Min: 2.41 / Avg: 2.88 / Max: 3.88Min: 0.26 / Avg: 0.32 / Max: 0.4Min: 0.23 / Avg: 0.3 / Max: 0.42Min: 0.27 / Avg: 0.32 / Max: 0.41Min: 3.26 / Avg: 3.68 / Max: 3.99Min: 1.18 / Avg: 2.65 / Max: 5.83Min: 1.51 / Avg: 1.62 / Max: 1.73Min: 1.12 / Avg: 1.86 / Max: 2.83Min: 3.15 / Avg: 3.37 / Max: 3.69Min: 1.35 / Avg: 1.5 / Max: 1.69Min: 1.09 / Avg: 1.15 / Max: 1.26Min: 1.21 / Avg: 1.38 / Max: 1.93Min: 2.68 / Avg: 2.9 / Max: 3.25Min: 0.8 / Avg: 0.96 / Max: 1.14Min: 0.21 / Avg: 0.26 / Max: 0.31Min: 0.54 / Avg: 0.68 / Max: 0.83

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS20406080100SE +/- 0.71070, N = 3SE +/- 0.01634, N = 3SE +/- 0.04835, N = 3SE +/- 0.01631, N = 3SE +/- 0.31761, N = 12SE +/- 0.47888, N = 8SE +/- 0.10985, N = 3SE +/- 0.47926, N = 3SE +/- 0.78610, N = 12SE +/- 0.04657, N = 12SE +/- 0.04695, N = 12SE +/- 0.07719, N = 12SE +/- 0.34990, N = 3SE +/- 2.55892, N = 9SE +/- 0.16662, N = 3SE +/- 0.50722, N = 3SE +/- 0.24142, N = 3SE +/- 0.36026, N = 3SE +/- 0.19153, N = 3SE +/- 0.22180, N = 3SE +/- 0.23225, N = 6SE +/- 0.17274, N = 12SE +/- 0.03872, N = 12SE +/- 0.06866, N = 395.732007.811225.348897.6484419.8458046.4637017.7636045.8260014.933001.464251.585561.6827822.7071030.3905015.2638039.1907017.2886024.7401011.2101026.7000020.771505.951221.849315.02945
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS20406080100Min: 94.31 / Avg: 95.73 / Max: 96.5Min: 7.78 / Avg: 7.81 / Max: 7.83Min: 5.25 / Avg: 5.35 / Max: 5.41Min: 7.63 / Avg: 7.65 / Max: 7.68Min: 17.69 / Avg: 19.85 / Max: 21.42Min: 44.34 / Avg: 46.46 / Max: 47.8Min: 17.61 / Avg: 17.76 / Max: 17.98Min: 45.13 / Avg: 45.83 / Max: 46.75Min: 11.2 / Avg: 14.93 / Max: 19.29Min: 1.21 / Avg: 1.46 / Max: 1.73Min: 1.38 / Avg: 1.59 / Max: 1.84Min: 1.38 / Avg: 1.68 / Max: 2.35Min: 22.31 / Avg: 22.71 / Max: 23.4Min: 14.87 / Avg: 30.39 / Max: 37.24Min: 15.02 / Avg: 15.26 / Max: 15.58Min: 38.18 / Avg: 39.19 / Max: 39.76Min: 16.84 / Avg: 17.29 / Max: 17.67Min: 24.22 / Avg: 24.74 / Max: 25.43Min: 11 / Avg: 11.21 / Max: 11.59Min: 26.33 / Avg: 26.7 / Max: 27.09Min: 20.05 / Avg: 20.77 / Max: 21.49Min: 4.49 / Avg: 5.95 / Max: 7.04Min: 1.7 / Avg: 1.85 / Max: 2.15Min: 4.91 / Avg: 5.03 / Max: 5.15

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS1428425670SE +/- 0.827731, N = 9SE +/- 0.011398, N = 3SE +/- 0.041717, N = 3SE +/- 0.005102, N = 3SE +/- 0.195276, N = 12SE +/- 0.449117, N = 5SE +/- 0.201190, N = 3SE +/- 0.349625, N = 8SE +/- 0.570641, N = 9SE +/- 0.102438, N = 12SE +/- 0.053631, N = 12SE +/- 0.075823, N = 12SE +/- 0.220382, N = 12SE +/- 1.950546, N = 9SE +/- 0.088326, N = 3SE +/- 0.365878, N = 5SE +/- 0.191342, N = 3SE +/- 0.220749, N = 5SE +/- 0.112266, N = 3SE +/- 0.012418, N = 3SE +/- 0.181354, N = 12SE +/- 0.078180, N = 12SE +/- 0.062840, N = 12SE +/- 0.093885, N = 1261.6460006.0143303.6117806.03867012.78780034.60740012.57080035.4406008.1217801.8204401.1571112.14042014.34010022.94370010.28450028.06810011.67000018.7890007.27767020.13320013.0202004.0355601.4648603.850310
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS1224364860Min: 58.42 / Avg: 61.65 / Max: 65.84Min: 6 / Avg: 6.01 / Max: 6.04Min: 3.56 / Avg: 3.61 / Max: 3.69Min: 6.03 / Avg: 6.04 / Max: 6.05Min: 11.62 / Avg: 12.79 / Max: 13.76Min: 33.31 / Avg: 34.61 / Max: 35.69Min: 12.21 / Avg: 12.57 / Max: 12.9Min: 34.57 / Avg: 35.44 / Max: 37.79Min: 5.84 / Avg: 8.12 / Max: 11.22Min: 1.33 / Avg: 1.82 / Max: 2.44Min: 0.85 / Avg: 1.16 / Max: 1.45Min: 1.78 / Avg: 2.14 / Max: 2.64Min: 12.86 / Avg: 14.34 / Max: 15.28Min: 11.49 / Avg: 22.94 / Max: 27.35Min: 10.19 / Avg: 10.28 / Max: 10.46Min: 27.06 / Avg: 28.07 / Max: 29.14Min: 11.29 / Avg: 11.67 / Max: 11.88Min: 17.99 / Avg: 18.79 / Max: 19.23Min: 7.15 / Avg: 7.28 / Max: 7.5Min: 20.11 / Avg: 20.13 / Max: 20.15Min: 11.85 / Avg: 13.02 / Max: 14Min: 3.54 / Avg: 4.04 / Max: 4.4Min: 1.04 / Avg: 1.46 / Max: 1.83Min: 3.37 / Avg: 3.85 / Max: 4.33

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS1224364860SE +/- 0.711449, N = 3SE +/- 0.009393, N = 3SE +/- 0.019191, N = 3SE +/- 0.013567, N = 3SE +/- 0.120651, N = 4SE +/- 0.078585, N = 3SE +/- 0.153551, N = 3SE +/- 0.192940, N = 3SE +/- 0.277801, N = 12SE +/- 0.028505, N = 12SE +/- 0.055703, N = 12SE +/- 0.026823, N = 12SE +/- 0.149649, N = 12SE +/- 0.423513, N = 12SE +/- 0.062336, N = 5SE +/- 0.072080, N = 3SE +/- 0.046415, N = 3SE +/- 0.130933, N = 12SE +/- 0.031917, N = 10SE +/- 0.187340, N = 12SE +/- 0.137693, N = 12SE +/- 0.048914, N = 3SE +/- 0.015592, N = 12SE +/- 0.158264, N = 1253.0127006.5123304.1831105.6328908.75750022.1630009.40822022.8463006.6301901.1536400.8182500.74838910.6795407.1859704.7766708.6306708.6526705.2401403.3925705.5524408.7558303.0205600.6413062.381170
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS1122334455Min: 51.8 / Avg: 53.01 / Max: 54.26Min: 6.5 / Avg: 6.51 / Max: 6.53Min: 4.15 / Avg: 4.18 / Max: 4.21Min: 5.61 / Avg: 5.63 / Max: 5.66Min: 8.42 / Avg: 8.76 / Max: 8.99Min: 22.05 / Avg: 22.16 / Max: 22.31Min: 9.13 / Avg: 9.41 / Max: 9.66Min: 22.57 / Avg: 22.85 / Max: 23.22Min: 5.41 / Avg: 6.63 / Max: 7.93Min: 0.98 / Avg: 1.15 / Max: 1.29Min: 0.56 / Avg: 0.82 / Max: 1.3Min: 0.64 / Avg: 0.75 / Max: 0.91Min: 9.79 / Avg: 10.68 / Max: 11.54Min: 4.02 / Avg: 7.19 / Max: 8.31Min: 4.6 / Avg: 4.78 / Max: 4.93Min: 8.49 / Avg: 8.63 / Max: 8.72Min: 8.58 / Avg: 8.65 / Max: 8.74Min: 4.62 / Avg: 5.24 / Max: 5.87Min: 3.22 / Avg: 3.39 / Max: 3.52Min: 4.31 / Avg: 5.55 / Max: 7.01Min: 7.97 / Avg: 8.76 / Max: 9.75Min: 2.94 / Avg: 3.02 / Max: 3.11Min: 0.56 / Avg: 0.64 / Max: 0.75Min: 2.01 / Avg: 2.38 / Max: 4.05

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS816243240SE +/- 0.251992, N = 3SE +/- 0.028225, N = 3SE +/- 0.022316, N = 3SE +/- 0.009721, N = 3SE +/- 0.014474, N = 3SE +/- 0.096656, N = 3SE +/- 0.063263, N = 8SE +/- 0.050982, N = 3SE +/- 0.169130, N = 12SE +/- 0.035673, N = 12SE +/- 0.030886, N = 12SE +/- 0.098608, N = 9SE +/- 0.100570, N = 4SE +/- 0.027941, N = 3SE +/- 0.039545, N = 4SE +/- 0.083129, N = 4SE +/- 0.082398, N = 12SE +/- 0.126927, N = 12SE +/- 0.023827, N = 12SE +/- 0.508145, N = 9SE +/- 0.063041, N = 3SE +/- 0.050685, N = 12SE +/- 0.016241, N = 12SE +/- 0.020590, N = 433.5460004.8540002.9260004.3762206.25811016.6610006.10925017.0529005.6871701.4535600.6498891.0188156.9306706.0578902.9155006.1365005.4175603.2673302.1645804.6937805.6478901.8670300.5271391.502250
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS714212835Min: 33.16 / Avg: 33.55 / Max: 34.02Min: 4.8 / Avg: 4.85 / Max: 4.9Min: 2.88 / Avg: 2.93 / Max: 2.96Min: 4.36 / Avg: 4.38 / Max: 4.39Min: 6.23 / Avg: 6.26 / Max: 6.28Min: 16.48 / Avg: 16.66 / Max: 16.81Min: 5.94 / Avg: 6.11 / Max: 6.5Min: 16.96 / Avg: 17.05 / Max: 17.13Min: 4.82 / Avg: 5.69 / Max: 6.48Min: 1.25 / Avg: 1.45 / Max: 1.65Min: 0.53 / Avg: 0.65 / Max: 0.85Min: 0.79 / Avg: 1.02 / Max: 1.77Min: 6.63 / Avg: 6.93 / Max: 7.04Min: 6.02 / Avg: 6.06 / Max: 6.11Min: 2.8 / Avg: 2.92 / Max: 2.97Min: 5.94 / Avg: 6.14 / Max: 6.3Min: 5.05 / Avg: 5.42 / Max: 5.87Min: 2.54 / Avg: 3.27 / Max: 4.25Min: 2.03 / Avg: 2.16 / Max: 2.3Min: 3.29 / Avg: 4.69 / Max: 8.59Min: 5.52 / Avg: 5.65 / Max: 5.73Min: 1.61 / Avg: 1.87 / Max: 2.25Min: 0.42 / Avg: 0.53 / Max: 0.6Min: 1.45 / Avg: 1.5 / Max: 1.53

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1BtrfsEXT4F2FSXFS306090120150SE +/- 0.69, N = 15SE +/- 0.02, N = 3SE +/- 2.68, N = 15SE +/- 0.02, N = 3SE +/- 0.83, N = 15SE +/- 0.06, N = 3SE +/- 0.52, N = 3SE +/- 0.02, N = 3SE +/- 6.10, N = 12SE +/- 0.24, N = 3SE +/- 0.71, N = 3SE +/- 0.13, N = 3SE +/- 0.68, N = 13SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 5.38, N = 10SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 3.42, N = 12SE +/- 0.17, N = 3SE +/- 0.29, N = 3SE +/- 0.01, N = 369.7132.3646.9332.8271.8936.0353.9035.30116.3941.0048.5838.9283.3040.3646.1746.38139.6542.2847.7143.1486.5437.3443.9236.401. (CC) gcc options: -O2 -lz -lm -ldl -lpthread
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1BtrfsEXT4F2FSXFS306090120150Min: 67.89 / Avg: 69.71 / Max: 75.65Min: 32.32 / Avg: 32.36 / Max: 32.38Min: 38.13 / Avg: 46.93 / Max: 60.66Min: 32.79 / Avg: 32.82 / Max: 32.87Min: 69.87 / Avg: 71.89 / Max: 77.86Min: 35.94 / Avg: 36.03 / Max: 36.14Min: 52.89 / Avg: 53.9 / Max: 54.61Min: 35.26 / Avg: 35.3 / Max: 35.34Min: 78.35 / Avg: 116.39 / Max: 145.59Min: 40.6 / Avg: 41 / Max: 41.41Min: 47.84 / Avg: 48.58 / Max: 50Min: 38.74 / Avg: 38.92 / Max: 39.17Min: 82.08 / Avg: 83.3 / Max: 89.71Min: 40.13 / Avg: 40.36 / Max: 40.54Min: 45.98 / Avg: 46.16 / Max: 46.41Min: 46.23 / Avg: 46.38 / Max: 46.47Min: 94.14 / Avg: 139.65 / Max: 153.8Min: 42.08 / Avg: 42.28 / Max: 42.49Min: 47.48 / Avg: 47.71 / Max: 48.02Min: 42.91 / Avg: 43.14 / Max: 43.39Min: 73.13 / Avg: 86.54 / Max: 108.75Min: 37.15 / Avg: 37.34 / Max: 37.69Min: 43.48 / Avg: 43.92 / Max: 44.47Min: 36.38 / Avg: 36.4 / Max: 36.421. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8BtrfsEXT4F2FSXFS120240360480600SE +/- 1.40, N = 3SE +/- 0.38, N = 3SE +/- 0.53, N = 3SE +/- 0.82, N = 3SE +/- 14.70, N = 9SE +/- 0.53, N = 3SE +/- 2.43, N = 6SE +/- 0.49, N = 3SE +/- 15.06, N = 6SE +/- 0.04, N = 3SE +/- 0.60, N = 3SE +/- 0.94, N = 3SE +/- 0.89, N = 3SE +/- 15.91, N = 9SE +/- 6.79, N = 3SE +/- 13.52, N = 10SE +/- 1.92, N = 3SE +/- 11.35, N = 9SE +/- 10.63, N = 6SE +/- 27.89, N = 9SE +/- 14.01, N = 9SE +/- 12.80, N = 9SE +/- 0.72, N = 3SE +/- 0.52, N = 3147.87118.04217.6784.47251.89121.72218.3183.04278.15133.85256.82107.19227.68308.02412.05221.80293.47398.34562.32332.68290.69317.24240.9688.491. (CC) gcc options: -O2 -lz -lm -ldl -lpthread
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8BtrfsEXT4F2FSXFS100200300400500Min: 145.08 / Avg: 147.86 / Max: 149.5Min: 117.3 / Avg: 118.04 / Max: 118.58Min: 216.61 / Avg: 217.67 / Max: 218.23Min: 82.91 / Avg: 84.47 / Max: 85.66Min: 148.94 / Avg: 251.88 / Max: 279.36Min: 120.76 / Avg: 121.71 / Max: 122.61Min: 214.17 / Avg: 218.31 / Max: 229.72Min: 82.41 / Avg: 83.04 / Max: 84.01Min: 225.03 / Avg: 278.15 / Max: 313.52Min: 133.79 / Avg: 133.85 / Max: 133.92Min: 255.8 / Avg: 256.82 / Max: 257.88Min: 105.32 / Avg: 107.19 / Max: 108.14Min: 226.54 / Avg: 227.68 / Max: 229.43Min: 186.77 / Avg: 308.02 / Max: 339.84Min: 404.35 / Avg: 412.05 / Max: 425.58Min: 112.57 / Avg: 221.8 / Max: 263.03Min: 290.41 / Avg: 293.47 / Max: 297.01Min: 307.79 / Avg: 398.34 / Max: 412.3Min: 524.84 / Avg: 562.32 / Max: 595.11Min: 126.04 / Avg: 332.68 / Max: 381.67Min: 212.96 / Avg: 290.69 / Max: 314.34Min: 215.29 / Avg: 317.24 / Max: 336.39Min: 239.52 / Avg: 240.96 / Max: 241.78Min: 87.57 / Avg: 88.49 / Max: 89.381. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs2K4K6K8K10KSE +/- 33.33, N = 3SE +/- 33.33, N = 3SE +/- 6.81, N = 3SE +/- 11.20, N = 3SE +/- 93.63, N = 3SE +/- 66.67, N = 3SE +/- 25.79, N = 3SE +/- 33.33, N = 3SE +/- 47.77, N = 10SE +/- 25.08, N = 3SE +/- 7.84, N = 3SE +/- 33.33, N = 3SE +/- 19.60, N = 3SE +/- 17.95, N = 3SE +/- 11.89, N = 3SE +/- 14.81, N = 3SE +/- 86.52, N = 3SE +/- 5.51, N = 3SE +/- 141.18, N = 15SE +/- 33.33, N = 310533105001046783578845745110333814410333752896858315103677551805281669677743391038225103331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs2K4K6K8K10KMin: 10500 / Avg: 10533.33 / Max: 10600Min: 10400 / Avg: 10466.67 / Max: 10500Min: 8347 / Avg: 8357 / Max: 8370Min: 8823 / Avg: 8845.33 / Max: 8858Min: 7264 / Avg: 7450.67 / Max: 7557Min: 10200 / Avg: 10333.33 / Max: 10400Min: 8094 / Avg: 8144 / Max: 8180Min: 10300 / Avg: 10333.33 / Max: 10400Min: 7163 / Avg: 7527.6 / Max: 7638Min: 9648 / Avg: 9685.33 / Max: 9733Min: 8307 / Avg: 8315.33 / Max: 8331Min: 10300 / Avg: 10366.67 / Max: 10400Min: 7512 / Avg: 7551 / Max: 7574Min: 8025 / Avg: 8052 / Max: 8086Min: 8150 / Avg: 8165.67 / Max: 8189Min: 9649 / Avg: 9677.33 / Max: 9699Min: 7262 / Avg: 7433.33 / Max: 7540Min: 9092 / Avg: 9103 / Max: 9109Min: 8044 / Avg: 8225.4 / Max: 10200Min: 10300 / Avg: 10333.33 / Max: 104001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS40K80K120K160K200KSE +/- 1274.10, N = 3SE +/- 352.77, N = 3SE +/- 173.21, N = 3SE +/- 536.45, N = 3SE +/- 1087.59, N = 15SE +/- 1452.97, N = 3SE +/- 2396.16, N = 15SE +/- 881.92, N = 3SE +/- 305.51, N = 3SE +/- 887.57, N = 3SE +/- 512.35, N = 4SE +/- 3679.91, N = 12SE +/- 1201.85, N = 3SE +/- 1335.89, N = 15SE +/- 765.03, N = 9SE +/- 1655.20, N = 15SE +/- 666.67, N = 3SE +/- 1432.20, N = 15SE +/- 1935.51, N = 12SE +/- 1249.00, N = 3SE +/- 1036.88, N = 15SE +/- 560.75, N = 3SE +/- 1132.38, N = 4693007436753200755331322001606671355331656676400032767365507253311566793580858331226671026677532758817996001040006825362033861251. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.16Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS30K60K90K120K150KMin: 67000 / Avg: 69300 / Max: 71400Min: 73700 / Avg: 74366.67 / Max: 74900Min: 52900 / Avg: 53200 / Max: 53500Min: 74900 / Avg: 75533.33 / Max: 76600Min: 125000 / Avg: 132200 / Max: 141000Min: 158000 / Avg: 160666.67 / Max: 163000Min: 127000 / Avg: 135533.33 / Max: 156000Min: 164000 / Avg: 165666.67 / Max: 167000Min: 63400 / Avg: 64000 / Max: 64400Min: 31000 / Avg: 32766.67 / Max: 33800Min: 35100 / Avg: 36550 / Max: 37500Min: 45300 / Avg: 72533.33 / Max: 89500Min: 114000 / Avg: 115666.67 / Max: 118000Min: 87400 / Avg: 93580 / Max: 102000Min: 82900 / Avg: 85833.33 / Max: 89800Min: 110000 / Avg: 122666.67 / Max: 131000Min: 102000 / Avg: 102666.67 / Max: 104000Min: 69600 / Avg: 75326.67 / Max: 89300Min: 49100 / Avg: 58816.67 / Max: 71800Min: 97800 / Avg: 99600 / Max: 102000Min: 57500 / Avg: 68253.33 / Max: 72900Min: 61200 / Avg: 62033.33 / Max: 63100Min: 83200 / Avg: 86125 / Max: 886001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS400800120016002000SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 10.50, N = 3SE +/- 0.67, N = 3SE +/- 17.83, N = 12SE +/- 2.85, N = 3SE +/- 2.56, N = 6SE +/- 3.06, N = 3SE +/- 16.75, N = 3SE +/- 1.20, N = 3SE +/- 28.53, N = 15SE +/- 1.20, N = 3SE +/- 22.81, N = 3SE +/- 2.19, N = 3SE +/- 3.21, N = 3SE +/- 0.88, N = 3SE +/- 2.31, N = 3SE +/- 0.88, N = 34575255225261660173318931907522233508504154518211767185215171768178317949877026446861. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS30060090012001500Min: 456 / Avg: 457.33 / Max: 458Min: 521 / Avg: 522 / Max: 523Min: 1649 / Avg: 1660 / Max: 1681Min: 1732 / Avg: 1733.33 / Max: 1734Min: 1697 / Avg: 1893 / Max: 1915Min: 1901 / Avg: 1906.67 / Max: 1910Min: 221 / Avg: 233.17 / Max: 238Min: 498 / Avg: 504 / Max: 508Min: 1516 / Avg: 1545.33 / Max: 1574Min: 1819 / Avg: 1820.67 / Max: 1823Min: 1537 / Avg: 1767 / Max: 1831Min: 1850 / Avg: 1852.33 / Max: 1854Min: 1482 / Avg: 1517.33 / Max: 1560Min: 1765 / Avg: 1767.67 / Max: 1772Min: 1777 / Avg: 1783 / Max: 1788Min: 701 / Avg: 702.33 / Max: 704Min: 640 / Avg: 644 / Max: 648Min: 684 / Avg: 685.67 / Max: 6871. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS30060090012001500SE +/- 5.02, N = 5SE +/- 0.67, N = 3SE +/- 6.63, N = 15SE +/- 2.67, N = 3SE +/- 12.56, N = 9SE +/- 11.50, N = 3SE +/- 6.03, N = 3SE +/- 8.09, N = 3SE +/- 1.76, N = 3SE +/- 5.45, N = 15SE +/- 5.10, N = 15SE +/- 8.01, N = 3SE +/- 14.33, N = 3SE +/- 3.28, N = 3SE +/- 6.51, N = 15SE +/- 6.64, N = 3SE +/- 11.26, N = 3SE +/- 7.48, N = 15SE +/- 5.24, N = 3SE +/- 5.96, N = 15SE +/- 1.86, N = 3SE +/- 1.33, N = 3SE +/- 16.77, N = 340533526135212848648319573751671671169101942442760572833732052574130130010421. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS2004006008001000Min: 388 / Avg: 404.8 / Max: 415Min: 334 / Avg: 334.67 / Max: 336Min: 230 / Avg: 260.8 / Max: 344Min: 347 / Avg: 352.33 / Max: 355Min: 1249 / Avg: 1283.56 / Max: 1361Min: 852 / Avg: 864 / Max: 887Min: 824 / Avg: 831 / Max: 843Min: 943 / Avg: 956.67 / Max: 971Min: 372 / Avg: 374.67 / Max: 378Min: 138 / Avg: 166.87 / Max: 208Min: 134 / Avg: 166.6 / Max: 208Min: 1157 / Avg: 1168.67 / Max: 1184Min: 991 / Avg: 1018.67 / Max: 1039Min: 418 / Avg: 424.33 / Max: 429Min: 384 / Avg: 426.67 / Max: 465Min: 593 / Avg: 604.67 / Max: 616Min: 714 / Avg: 727.67 / Max: 750Min: 299 / Avg: 336.67 / Max: 384Min: 310 / Avg: 319.67 / Max: 328Min: 489 / Avg: 524.8 / Max: 562Min: 297 / Avg: 300.67 / Max: 303Min: 297 / Avg: 299.67 / Max: 301Min: 1012 / Avg: 1042 / Max: 10701. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lcurl -lssl -lcrypto -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FSXFS50100150200250SE +/- 1.47, N = 3SE +/- 0.43, N = 3SE +/- 6.76, N = 15SE +/- 1.20, N = 3SE +/- 2.32, N = 3SE +/- 0.65, N = 3SE +/- 1.72, N = 3SE +/- 0.81, N = 3SE +/- 6.08, N = 15SE +/- 0.44, N = 3SE +/- 1.67, N = 3SE +/- 1.95, N = 4SE +/- 2.03, N = 3SE +/- 1.12, N = 3SE +/- 1.64, N = 15SE +/- 4.39, N = 12SE +/- 5.50, N = 15SE +/- 0.91, N = 15SE +/- 1.74, N = 15SE +/- 6.27, N = 12SE +/- 2.02, N = 3SE +/- 0.23, N = 3SE +/- 0.33, N = 3SE +/- 0.38, N = 3165.3171.9131.7185.4223.8210.5188.0231.999.0136.9105.1140.8173.3129.2103.099.4110.273.764.769.6189.899.5180.7220.71. (CC) gcc options: -static
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FSXFS4080120160200Min: 162.5 / Avg: 165.27 / Max: 167.5Min: 171.1 / Avg: 171.87 / Max: 172.6Min: 120.3 / Avg: 131.71 / Max: 226.2Min: 183 / Avg: 185.4 / Max: 186.7Min: 219.2 / Avg: 223.77 / Max: 226.8Min: 209.3 / Avg: 210.53 / Max: 211.5Min: 184.6 / Avg: 188 / Max: 190.1Min: 230.5 / Avg: 231.93 / Max: 233.3Min: 85.9 / Avg: 99.05 / Max: 159.3Min: 136.1 / Avg: 136.9 / Max: 137.6Min: 103 / Avg: 105.1 / Max: 108.4Min: 136.7 / Avg: 140.78 / Max: 146.1Min: 169.7 / Avg: 173.33 / Max: 176.7Min: 127 / Avg: 129.23 / Max: 130.5Min: 95.2 / Avg: 103.01 / Max: 120.7Min: 76.7 / Avg: 99.43 / Max: 119.3Min: 95.5 / Avg: 110.22 / Max: 169.4Min: 70.1 / Avg: 73.69 / Max: 81.5Min: 57.5 / Avg: 64.71 / Max: 84.6Min: 54.1 / Avg: 69.62 / Max: 117.6Min: 186.3 / Avg: 189.8 / Max: 193.3Min: 99.1 / Avg: 99.47 / Max: 99.9Min: 180.4 / Avg: 180.73 / Max: 181.4Min: 220.1 / Avg: 220.67 / Max: 221.41. (CC) gcc options: -static

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FSXFS130260390520650SE +/- 11.17, N = 15SE +/- 3.76, N = 14SE +/- 1.07, N = 3SE +/- 11.10, N = 12SE +/- 7.86, N = 15SE +/- 0.61, N = 3SE +/- 4.03, N = 5SE +/- 1.54, N = 3SE +/- 1.62, N = 3SE +/- 2.00, N = 12SE +/- 1.98, N = 3SE +/- 4.24, N = 12SE +/- 3.12, N = 3SE +/- 3.44, N = 15SE +/- 5.33, N = 9SE +/- 5.60, N = 12SE +/- 4.74, N = 15SE +/- 0.84, N = 3SE +/- 1.59, N = 12SE +/- 2.28, N = 12SE +/- 13.29, N = 15SE +/- 1.41, N = 3SE +/- 0.33, N = 3SE +/- 1.99, N = 7178.8179.0180.0160.3282.5583.2304.2442.9195.2133.5151.6125.5204.4209.2127.0125.5188.8148.792.690.0221.7210.7244.9184.01. (CC) gcc options: -static
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FSXFS100200300400500Min: 138 / Avg: 178.77 / Max: 255.6Min: 173.6 / Avg: 179 / Max: 227.6Min: 178.4 / Avg: 179.97 / Max: 182Min: 132.1 / Avg: 160.32 / Max: 245.3Min: 241.2 / Avg: 282.47 / Max: 339Min: 582.4 / Avg: 583.2 / Max: 584.4Min: 299 / Avg: 304.2 / Max: 320.2Min: 440.9 / Avg: 442.87 / Max: 445.9Min: 192.4 / Avg: 195.23 / Max: 198Min: 122.4 / Avg: 133.53 / Max: 149.2Min: 148.4 / Avg: 151.57 / Max: 155.2Min: 113.8 / Avg: 125.54 / Max: 154.4Min: 198.6 / Avg: 204.4 / Max: 209.3Min: 201.2 / Avg: 209.2 / Max: 244Min: 101.6 / Avg: 126.97 / Max: 157.1Min: 103.8 / Avg: 125.53 / Max: 162.7Min: 175.3 / Avg: 188.76 / Max: 248.5Min: 147.2 / Avg: 148.7 / Max: 150.1Min: 84.6 / Avg: 92.59 / Max: 99.3Min: 67.9 / Avg: 90.03 / Max: 97.5Min: 197.2 / Avg: 221.71 / Max: 352.1Min: 208 / Avg: 210.67 / Max: 212.8Min: 244.4 / Avg: 244.87 / Max: 245.5Min: 179.8 / Avg: 184.04 / Max: 195.41. (CC) gcc options: -static

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FSXFS50100150200250SE +/- 1.22, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 5.80, N = 15SE +/- 0.60, N = 3SE +/- 3.02, N = 15SE +/- 1.14, N = 3SE +/- 3.45, N = 14SE +/- 5.68, N = 15SE +/- 1.33, N = 15SE +/- 7.05, N = 12SE +/- 5.90, N = 15SE +/- 0.23, N = 3SE +/- 0.75, N = 8SE +/- 5.77, N = 15SE +/- 3.30, N = 15SE +/- 0.72, N = 7SE +/- 0.09, N = 3SE +/- 3.39, N = 15SE +/- 4.73, N = 15SE +/- 0.93, N = 15SE +/- 1.03, N = 3SE +/- 1.39, N = 14161.986.5128.684.4124.3209.0176.1230.4103.186.3108.989.2117.874.275.873.093.563.558.942.6110.998.2177.6106.71. (CC) gcc options: -static
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FSXFS4080120160200Min: 160.1 / Avg: 161.87 / Max: 164.2Min: 86.4 / Avg: 86.53 / Max: 86.7Min: 128.2 / Avg: 128.57 / Max: 128.9Min: 83.5 / Avg: 84.37 / Max: 84.9Min: 101.4 / Avg: 124.35 / Max: 175.3Min: 207.8 / Avg: 209 / Max: 209.7Min: 170 / Avg: 176.11 / Max: 217.4Min: 228.3 / Avg: 230.4 / Max: 232.2Min: 91.4 / Avg: 103.06 / Max: 139.5Min: 72.6 / Avg: 86.33 / Max: 126.6Min: 101.4 / Avg: 108.87 / Max: 115.4Min: 73.4 / Avg: 89.23 / Max: 140.6Min: 96.9 / Avg: 117.82 / Max: 164.8Min: 73.7 / Avg: 74.17 / Max: 74.4Min: 71.9 / Avg: 75.78 / Max: 79.1Min: 57.1 / Avg: 72.99 / Max: 135.8Min: 85.8 / Avg: 93.48 / Max: 134.3Min: 61.2 / Avg: 63.54 / Max: 66.3Min: 58.7 / Avg: 58.87 / Max: 59Min: 31.8 / Avg: 42.56 / Max: 86Min: 100.3 / Avg: 110.95 / Max: 170.9Min: 94.3 / Avg: 98.24 / Max: 107.2Min: 175.6 / Avg: 177.6 / Max: 179Min: 104.5 / Avg: 106.73 / Max: 124.31. (CC) gcc options: -static

IOR

IOR is a parallel I/O storage benchmark. Learn more via the OpenBenchmarking.org test page.

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Write TestBtrfsEXT4F2FSXFS50100150200250SE +/- 0.91, N = 3SE +/- 0.28, N = 3SE +/- 1.97, N = 4SE +/- 0.78, N = 3SE +/- 1.56, N = 3SE +/- 0.95, N = 3SE +/- 1.13, N = 3SE +/- 0.44, N = 3SE +/- 1.50, N = 3SE +/- 0.37, N = 3SE +/- 8.84, N = 15SE +/- 0.62, N = 3SE +/- 0.65, N = 3SE +/- 0.33, N = 3SE +/- 0.78, N = 11SE +/- 1.31, N = 15SE +/- 1.37, N = 3SE +/- 0.62, N = 8SE +/- 1.29, N = 15SE +/- 0.92, N = 15SE +/- 1.59, N = 3SE +/- 0.53, N = 3SE +/- 0.70, N = 3SE +/- 0.63, N = 3176.7190.00134.71189.28239.16184.17167.74196.62157.6280.51164.77168.7992.7968.9986.0366.49104.6762.1672.9855.09197.1191.34174.56185.841. (CC) gcc options: -O2 -lm -pthread -lmpi
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Write TestBtrfsEXT4F2FSXFS4080120160200Min: 175.2 / Avg: 176.71 / Max: 178.35Min: 89.63 / Avg: 90 / Max: 90.56Min: 129.23 / Avg: 134.71 / Max: 137.66Min: 188.49 / Avg: 189.28 / Max: 190.84Min: 236.53 / Avg: 239.16 / Max: 241.93Min: 183.13 / Avg: 184.17 / Max: 186.07Min: 166 / Avg: 167.74 / Max: 169.86Min: 196.09 / Avg: 196.62 / Max: 197.5Min: 155.01 / Avg: 157.62 / Max: 160.22Min: 79.79 / Avg: 80.51 / Max: 81Min: 107.61 / Avg: 164.77 / Max: 199.29Min: 168.1 / Avg: 168.79 / Max: 170.02Min: 91.81 / Avg: 92.79 / Max: 94.02Min: 68.65 / Avg: 68.99 / Max: 69.64Min: 80.3 / Avg: 86.03 / Max: 90.47Min: 60.65 / Avg: 66.49 / Max: 78.43Min: 103.11 / Avg: 104.67 / Max: 107.4Min: 58.34 / Avg: 62.16 / Max: 63.72Min: 61.91 / Avg: 72.98 / Max: 82.46Min: 48.67 / Avg: 55.09 / Max: 60.57Min: 193.96 / Avg: 197.11 / Max: 199.08Min: 90.52 / Avg: 91.34 / Max: 92.33Min: 173.48 / Avg: 174.56 / Max: 175.87Min: 184.64 / Avg: 185.84 / Max: 186.761. (CC) gcc options: -O2 -lm -pthread -lmpi

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Read TestBtrfsEXT4F2FSXFS140280420560700SE +/- 0.93, N = 3SE +/- 1.12, N = 3SE +/- 6.45, N = 4SE +/- 0.43, N = 3SE +/- 4.52, N = 3SE +/- 1.62, N = 3SE +/- 1.69, N = 3SE +/- 0.39, N = 3SE +/- 14.92, N = 3SE +/- 1.12, N = 3SE +/- 4.95, N = 15SE +/- 0.35, N = 3SE +/- 22.70, N = 3SE +/- 0.84, N = 3SE +/- 1.54, N = 11SE +/- 9.42, N = 15SE +/- 9.91, N = 3SE +/- 2.01, N = 8SE +/- 17.95, N = 15SE +/- 8.69, N = 15SE +/- 5.60, N = 3SE +/- 8.71, N = 3SE +/- 1.64, N = 3SE +/- 1.27, N = 3343.45377.69386.43396.46657.36388.52458.05417.31297.90373.21386.14386.08490.12369.20452.46369.78513.75362.44336.81355.75500.32349.95432.59392.511. (CC) gcc options: -O2 -lm -pthread -lmpi
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterIOR 3.2.1Read TestBtrfsEXT4F2FSXFS120240360480600Min: 341.79 / Avg: 343.45 / Max: 345Min: 375.55 / Avg: 377.69 / Max: 379.33Min: 367.13 / Avg: 386.43 / Max: 394.01Min: 396.03 / Avg: 396.46 / Max: 397.32Min: 652.54 / Avg: 657.36 / Max: 666.39Min: 385.59 / Avg: 388.52 / Max: 391.18Min: 454.9 / Avg: 458.05 / Max: 460.71Min: 416.79 / Avg: 417.31 / Max: 418.08Min: 268.15 / Avg: 297.9 / Max: 314.72Min: 372.09 / Avg: 373.21 / Max: 375.44Min: 355.45 / Avg: 386.14 / Max: 406.74Min: 385.4 / Avg: 386.08 / Max: 386.52Min: 444.76 / Avg: 490.12 / Max: 514.46Min: 367.57 / Avg: 369.2 / Max: 370.4Min: 441.84 / Avg: 452.46 / Max: 457.17Min: 282.31 / Avg: 369.78 / Max: 390.05Min: 501.55 / Avg: 513.75 / Max: 533.37Min: 352.92 / Avg: 362.44 / Max: 368.56Min: 232.88 / Avg: 336.81 / Max: 442.49Min: 290.56 / Avg: 355.75 / Max: 394.23Min: 489.13 / Avg: 500.32 / Max: 506.43Min: 333.32 / Avg: 349.95 / Max: 362.76Min: 429.49 / Avg: 432.59 / Max: 435.09Min: 390.03 / Avg: 392.51 / Max: 394.221. (CC) gcc options: -O2 -lm -pthread -lmpi

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateBtrfsEXT4F2FSXFS80160240320400SE +/- 2.04, N = 3SE +/- 1.14, N = 3SE +/- 3.87, N = 15SE +/- 1.46, N = 3SE +/- 3.53, N = 6SE +/- 6.21, N = 3SE +/- 5.10, N = 3SE +/- 2.39, N = 3SE +/- 2.62, N = 10SE +/- 1.64, N = 3SE +/- 3.52, N = 12SE +/- 1.60, N = 3SE +/- 1.41, N = 3SE +/- 1.06, N = 3SE +/- 3.75, N = 3SE +/- 4.01, N = 3SE +/- 3.24, N = 3SE +/- 3.93, N = 3SE +/- 2.98, N = 15SE +/- 2.63, N = 3SE +/- 4.58, N = 3SE +/- 0.20, N = 3SE +/- 2.69, N = 15SE +/- 2.83, N = 3214.67369.62257.99304.76292.01362.18329.96319.57281.28358.08204.32296.03289.64367.20252.31305.02291.59367.37218.48305.49281.34369.26261.51304.57
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateBtrfsEXT4F2FSXFS70140210280350Min: 212.25 / Avg: 214.67 / Max: 218.72Min: 368.19 / Avg: 369.62 / Max: 371.88Min: 249.08 / Avg: 257.99 / Max: 311.52Min: 301.93 / Avg: 304.76 / Max: 306.8Min: 276.34 / Avg: 292.01 / Max: 300.8Min: 350.09 / Avg: 362.18 / Max: 370.68Min: 320.29 / Avg: 329.96 / Max: 337.59Min: 316.97 / Avg: 319.57 / Max: 324.35Min: 267.08 / Avg: 281.28 / Max: 295.91Min: 356.22 / Avg: 358.08 / Max: 361.34Min: 195.46 / Avg: 204.32 / Max: 242.12Min: 293.68 / Avg: 296.03 / Max: 299.08Min: 286.97 / Avg: 289.64 / Max: 291.77Min: 365.19 / Avg: 367.2 / Max: 368.8Min: 245.04 / Avg: 252.31 / Max: 257.51Min: 297.6 / Avg: 305.02 / Max: 311.36Min: 285.15 / Avg: 291.59 / Max: 295.39Min: 359.54 / Avg: 367.37 / Max: 371.92Min: 189.89 / Avg: 218.48 / Max: 236.45Min: 300.24 / Avg: 305.49 / Max: 308.44Min: 273.81 / Avg: 281.34 / Max: 289.63Min: 368.86 / Avg: 369.26 / Max: 369.51Min: 253.92 / Avg: 261.51 / Max: 294.45Min: 298.9 / Avg: 304.57 / Max: 307.48

PostgreSQL pgbench

This is a simple benchmark of PostgreSQL using pgbench. Learn more via the OpenBenchmarking.org test page.

SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteBtrfsEXT4F2FSXFS14002800420056007000SE +/- 251.33, N = 6SE +/- 61.03, N = 3SE +/- 41.82, N = 3SE +/- 356.17, N = 9SE +/- 70.65, N = 9SE +/- 84.80, N = 5SE +/- 409.58, N = 6SE +/- 812.21, N = 9SE +/- 86.05, N = 9SE +/- 26.43, N = 3SE +/- 50.59, N = 3SE +/- 26.90, N = 3SE +/- 52.03, N = 3SE +/- 150.35, N = 9SE +/- 91.08, N = 9SE +/- 114.01, N = 9SE +/- 60.68, N = 9SE +/- 24.93, N = 3SE +/- 6.06, N = 3SE +/- 28.50, N = 9SE +/- 46.64, N = 9SE +/- 73.63, N = 9SE +/- 186.03, N = 9SE +/- 193.53, N = 63281.914877.474961.484691.474509.816514.515840.856003.792873.472433.653489.693691.183232.322681.123609.472625.423188.282174.393235.982079.273068.922639.034328.784654.441. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
SingleRAID0RAID1RAID5RAID6RAID10OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteBtrfsEXT4F2FSXFS11002200330044005500Min: 2836.52 / Avg: 3281.91 / Max: 4479.07Min: 4789.93 / Avg: 4877.47 / Max: 4994.9Min: 4882.22 / Avg: 4961.48 / Max: 5024.23Min: 3952.84 / Avg: 4691.47 / Max: 7448.67Min: 4251.7 / Avg: 4509.81 / Max: 4900.05Min: 6391.34 / Avg: 6514.51 / Max: 6848.43Min: 4784.6 / Avg: 5840.85 / Max: 7175.98Min: 4235.26 / Avg: 6003.79 / Max: 12167.45Min: 2690.71 / Avg: 2873.47 / Max: 3532.37Min: 2384.39 / Avg: 2433.65 / Max: 2474.87Min: 3395.41 / Avg: 3489.69 / Max: 3568.63Min: 3646.77 / Avg: 3691.18 / Max: 3739.67Min: 3128.31 / Avg: 3232.32 / Max: 3286.73Min: 2443.79 / Avg: 2681.12 / Max: 3843.49Min: 3186.93 / Avg: 3609.47 / Max: 3953.67Min: 2409.77 / Avg: 2625.42 / Max: 3529.58Min: 2940.91 / Avg: 3188.28 / Max: 3437.65Min: 2126.11 / Avg: 2174.39 / Max: 2209.33Min: 3224.23 / Avg: 3235.98 / Max: 3244.43Min: 2002.41 / Avg: 2079.27 / Max: 2261.58Min: 2868.3 / Avg: 3068.92 / Max: 3274.26Min: 2359.11 / Avg: 2639.03 / Max: 3113.55Min: 3873.44 / Avg: 4328.78 / Max: 5578.2Min: 4100.55 / Avg: 4654.44 / Max: 5339.951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm