Dell R720 H710 mini IT Mode w/ZSTD

2 x Intel Xeon E5-2667 Dell R720 ZFS 2.0 RAID Testing

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012280-FI-2012190TE84
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
SAS 6x76G RAID1
December 19 2020
  3 Hours, 21 Minutes
SAS 6x76G RAID1 LZ4
December 19 2020
  3 Hours, 44 Minutes
SAS 6x76G RAID1 GZIP
December 19 2020
  3 Hours, 17 Minutes
SSD 2x1TB RAID1
December 19 2020
  4 Hours, 4 Minutes
SSD 2x1TB RAID1 LZ4
December 19 2020
  3 Hours, 17 Minutes
SSD 2x1TB RAID1 GZIP
December 20 2020
  3 Hours, 31 Minutes
SSD 2x1TB RAID1 ashift=13
December 20 2020
  4 Hours, 15 Minutes
SSD 2x1TB RAID1 ashift=13 GZIP
December 20 2020
  3 Hours, 20 Minutes
SSD 2x1TB RAID1 ashift=13 LZ4
December 21 2020
  4 Hours, 58 Minutes
SSD 2x1TB RAID0 zil
December 21 2020
  3 Hours, 9 Minutes
SSD 2x1TB RAID1-zil LZ4
December 21 2020
  2 Hours, 56 Minutes
SSD 4x1TB RAID10-zil LZ4
December 21 2020
  2 Hours, 42 Minutes
SSD 4x1TB RAID10-zil
December 21 2020
  3 Hours, 19 Minutes
SSD 4x1TB RAID10 ZSTD
December 23 2020
  3 Hours, 28 Minutes
SAS 4x1TB RAID10-zil ZSTD
December 24 2020
  2 Hours, 31 Minutes
SAS 4x1TB RAID10-zil ZSTD(2)
December 28 2020
  3 Hours
SAS 10x300GB RAID10-zil-cache
December 28 2020
  3 Hours, 43 Minutes
Invert Hiding All Results Option
  3 Hours, 27 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Dell R720 H710 mini IT Mode w/ZSTDProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSAS 6x76G RAID1SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache2 x Intel Xeon E5-2667 0 @ 3.50GHz (12 Cores / 24 Threads)Dell 0X3D66 (2.9.0 BIOS)Intel Xeon E5/Core190GB10 x 300GB MBD2300RC + 6 x 73GB Seagate ST973452SS + 257GB Flash DriveMatrox G200eR24 x Intel I350Debian 104.19.0-13-amd64 (x86_64)GCC 8.3.0zfs1280x102410 x 300GB MBD2300RC + 4 x 512GB Samsung SSD 840 + 1000GB SanDisk SSD PLUS + 1000GB Samsung SSD 870 + 257GB Flash Drive + 240GB KINGSTON SA400S31024x768256GB PCIe SSD + 10 x 300GB MBD2300RC + 2 x 240GB CT240BX500SSD1 + 3 x 240GB KINGSTON SA400S3 + 1000GB SanDisk SSD PLUS + 1000GB Samsung SSD 870 + 257GB Flash Drive1280x1024256GB PCIe SSD + 10 x 300GB MBD2300RC + 2 x 240GB CT240BX500SSD1 + 1000GB SanDisk SSD PLUS + 3 x 1000GB Samsung SSD 870 + 257GB Flash Drive + 240GB KINGSTON SA400S3GCC 8.3.0 + Clang 7.0.1-8+deb10u2 + LLVM 7.0.1256GB PCIe SSD + 240GB KINGSTON SA400S3 + 10 x 300GB MBD2300RC + 2 x 240GB CT240BX500SSD1 + 3 x 1000GB Samsung SSD 870 + 257GB Flash Drive + 1000GB SanDisk SSD PLUS5.9.0-0.bpo.2-amd64 (x86_64)256GB PCIe SSD + 10 x 300GB MBD2300RC + 1000GB SanDisk SSD PLUS + 2 x 240GB CT240BX500SSD1 + 3 x 1000GB Samsung SSD 870 + 257GB Flash Drive + 240GB KINGSTON SA400S3 + 4001GB VIRTUAL-DISK1024x768OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -vProcessor Details- SAS 6x76G RAID1: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SAS 6x76G RAID1 LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SAS 6x76G RAID1 GZIP: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 GZIP: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 ashift=13: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 ashift=13 GZIP: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 ashift=13 LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID0 zil: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1-zil LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 4x1TB RAID10-zil LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 4x1TB RAID10-zil: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 4x1TB RAID10 ZSTD: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718- SAS 4x1TB RAID10-zil ZSTD: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718- SAS 4x1TB RAID10-zil ZSTD(2): Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718- SAS 10x300GB RAID10-zil-cache: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718Disk Scheduler Details- SAS 6x76G RAID1: MQ-DEADLINE- SAS 6x76G RAID1 LZ4: MQ-DEADLINE- SAS 6x76G RAID1 GZIP: MQ-DEADLINE- SSD 2x1TB RAID1: MQ-DEADLINE- SSD 2x1TB RAID1 LZ4: MQ-DEADLINE- SSD 2x1TB RAID1 GZIP: MQ-DEADLINE- SSD 2x1TB RAID1 ashift=13: MQ-DEADLINE- SSD 2x1TB RAID1 ashift=13 GZIP: MQ-DEADLINE- SSD 2x1TB RAID1 ashift=13 LZ4: MQ-DEADLINE- SSD 2x1TB RAID0 zil: NONE- SSD 2x1TB RAID1-zil LZ4: NONE- SSD 4x1TB RAID10-zil LZ4: NONE- SSD 4x1TB RAID10-zil: NONE- SSD 4x1TB RAID10 ZSTD: NONE- SAS 4x1TB RAID10-zil ZSTD: NONE- SAS 4x1TB RAID10-zil ZSTD(2): NONE- SAS 10x300GB RAID10-zil-cache: NONEPython Details- Python 2.7.16 + Python 3.7.3Security Details- SAS 6x76G RAID1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 6x76G RAID1 LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 6x76G RAID1 GZIP: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 GZIP: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 ashift=13: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 ashift=13 GZIP: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 ashift=13 LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID0 zil: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1-zil LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 4x1TB RAID10-zil LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 4x1TB RAID10-zil: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 4x1TB RAID10 ZSTD: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 4x1TB RAID10-zil ZSTD: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 4x1TB RAID10-zil ZSTD(2): itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 10x300GB RAID10-zil-cache: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

SAS 6x76G RAID1SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cacheResult OverviewPhoronix Test Suite100%333%565%798%1030%SQLiteFS-MarkPostMarkDbenchCompile BenchFlexible IO Tester

Dell R720 H710 mini IT Mode w/ZSTDsqlite: Timed SQLite Insertionsfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncdbench: 12 Clientsdbench: 1 Clientscompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treepostmark: Disk Transaction PerformanceSAS 6x76G RAID1SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache139.458458022867001793333146157035189920449322438912280003142156744111300023.233.322.1960.4120.58439.8467357.4399.56760.651306138.458475223726981788003036151433285000471323538972296253105154942810960029.647.830.2984.4235.08049.7149583.44119.38783.171323138.381468223386961780003253162334788767474623708822256673365167942510866729.547.630.5995.3221.97648.5708647.47125.33657.54161933.5394893244374519066734601726427109000470123479102328753496174448712475025.229.325.1957.2165.18382.4298185.97117.68828.27110155.3934808240075219233335561775396101533477123828912283333414170347012000040.351.638.8957.9428.83996.8502913.34129.04756.19115435.031468323387051806673550177138899293467423339012306003487174047312114340.152.139.3958.2436.89897.1405911.98134.41590.62135348.1444593229374218966734701732449115000460122979392403333523175851513166723.927.924.4991.8154.46879.9679175.84122.93817.73101245.0654710235169017666734871740397101633460422999092326673265162948812500039.347.538.01011.3350.76093.6745885.92132.97599.83131744.0804743236873118713335421768416106333463923169052318003524175849412666738.147.537.8967.3336.95791.0235824.75128.61776.37116416.67646152304733187750328016374171063334665232993123833334351713493126286305.3251.9271.1955.2627.125242.899327.92113.07788.25244217.2464547227069417766734521722385985134590229190823233334181705478122667294.1567.0288.3938.11107.83220.119931.37129.80799.43125815.9124432221270017900031281560355908134465222988022533332961644454116000364.6767.5365.51230.2842.178222.893978.69134.15795.83220515.8574636231471918400031811587377965004558227587822480031081550416106600338.8173.0262.0927.6565.198246.834277.63106.50745.26209530.717340416984051037433102154736793900239611947301870002952147341510620032.549.432.5614.9230.74471.9232331.66120.31822.71198415.68744482220690176667308515393951008334734236388922766728781436433110867297.0174.5262.4626.8652.381268.080279.85117.36635.35196915.942241912061223132731441569367939202329116174118966731241559431110200298.2752.5292.0668.02034.17250.627618.05135.82698.00185814.797239511941163006527551374313800672292114373418800027791386432110667295.3406.8324.0662.1592.880268.210498.12129.66710.822118OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Timed SQLite InsertionsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4SAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SAS 6x76G RAID1306090120150SE +/- 0.09, N = 3SE +/- 0.34, N = 15SE +/- 0.30, N = 15SE +/- 0.35, N = 15SE +/- 0.31, N = 12SE +/- 0.50, N = 12SE +/- 0.34, N = 15SE +/- 0.95, N = 15SE +/- 0.45, N = 3SE +/- 0.59, N = 3SE +/- 0.53, N = 3SE +/- 0.20, N = 3SE +/- 2.90, N = 15SE +/- 4.16, N = 12SE +/- 0.68, N = 3SE +/- 0.30, N = 3SE +/- 0.83, N = 314.8015.6915.8615.9115.9416.6817.2530.7233.5435.0344.0845.0748.1455.39138.38138.46139.46-lz1. (CC) gcc options: -O2 -lm -ldl -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Timed SQLite InsertionsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4SAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SAS 6x76G RAID1306090120150Min: 14.68 / Avg: 14.8 / Max: 14.97Min: 13.17 / Avg: 15.69 / Max: 17.98Min: 14.28 / Avg: 15.86 / Max: 17.98Min: 14.34 / Avg: 15.91 / Max: 18.55Min: 13.92 / Avg: 15.94 / Max: 17.5Min: 14.79 / Avg: 16.68 / Max: 20.2Min: 15.56 / Avg: 17.25 / Max: 20.31Min: 27.75 / Avg: 30.72 / Max: 42.49Min: 32.95 / Avg: 33.54 / Max: 34.42Min: 34.14 / Avg: 35.03 / Max: 36.16Min: 43.11 / Avg: 44.08 / Max: 44.93Min: 44.83 / Avg: 45.07 / Max: 45.45Min: 43.8 / Avg: 48.14 / Max: 88.56Min: 33.27 / Avg: 55.39 / Max: 68.35Min: 137.51 / Avg: 138.38 / Max: 139.73Min: 137.97 / Avg: 138.46 / Max: 139Min: 138.48 / Avg: 139.46 / Max: 141.121. (CC) gcc options: -O2 -lm -ldl -lpthread

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1SSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache10002000300040005000SE +/- 4.06, N = 3SE +/- 35.37, N = 15SE +/- 56.64, N = 3SE +/- 39.88, N = 3SE +/- 42.88, N = 3SE +/- 29.70, N = 3SE +/- 67.40, N = 4SE +/- 18.22, N = 3SE +/- 38.19, N = 15SE +/- 71.50, N = 3SE +/- 48.33, N = 8SE +/- 39.28, N = 15SE +/- 48.23, N = 3SE +/- 13.20, N = 3SE +/- 12.39, N = 3SE +/- 2.31, N = 3SE +/- 7.45, N = 348934808475247434710468346824636461545934580454744484432340424192395-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1SSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache9001800270036004500Min: 4886 / Avg: 4892.67 / Max: 4900Min: 4333 / Avg: 4807.93 / Max: 4879Min: 4644 / Avg: 4751.67 / Max: 4836Min: 4664 / Avg: 4743 / Max: 4792Min: 4626 / Avg: 4710 / Max: 4767Min: 4626 / Avg: 4683 / Max: 4726Min: 4499 / Avg: 4682 / Max: 4824Min: 4603 / Avg: 4635.67 / Max: 4666Min: 4319 / Avg: 4614.8 / Max: 4755Min: 4458 / Avg: 4593.33 / Max: 4701Min: 4397 / Avg: 4579.5 / Max: 4695Min: 4332 / Avg: 4547 / Max: 4702Min: 4386 / Avg: 4448 / Max: 4543Min: 4406 / Avg: 4432 / Max: 4449Min: 3379 / Avg: 3403.67 / Max: 3418Min: 2415 / Avg: 2419 / Max: 2423Min: 2384 / Avg: 2394.67 / Max: 24091. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1SSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache5001000150020002500SE +/- 2.33, N = 3SE +/- 17.68, N = 15SE +/- 28.35, N = 3SE +/- 19.67, N = 3SE +/- 21.61, N = 3SE +/- 14.89, N = 3SE +/- 33.77, N = 4SE +/- 9.24, N = 3SE +/- 19.10, N = 15SE +/- 35.91, N = 3SE +/- 24.18, N = 8SE +/- 19.58, N = 15SE +/- 24.22, N = 3SE +/- 6.77, N = 3SE +/- 6.23, N = 3SE +/- 1.15, N = 3SE +/- 3.84, N = 324432400237223682351233823382314230422932286227022202212169812061194-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1SSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache400800120016002000Min: 2439 / Avg: 2442.67 / Max: 2447Min: 2163 / Avg: 2400.33 / Max: 2436Min: 2318 / Avg: 2372 / Max: 2414Min: 2329 / Avg: 2368 / Max: 2392Min: 2309 / Avg: 2351.33 / Max: 2380Min: 2309 / Avg: 2337.67 / Max: 2359Min: 2246 / Avg: 2337.5 / Max: 2409Min: 2298 / Avg: 2314.33 / Max: 2330Min: 2156 / Avg: 2303.87 / Max: 2374Min: 2225 / Avg: 2293 / Max: 2347Min: 2195 / Avg: 2286.25 / Max: 2344Min: 2163 / Avg: 2270.07 / Max: 2347Min: 2189 / Avg: 2220.33 / Max: 2268Min: 2199 / Avg: 2212.33 / Max: 2221Min: 1686 / Avg: 1698.33 / Max: 1706Min: 1204 / Avg: 1206 / Max: 1208Min: 1188 / Avg: 1193.67 / Max: 12011. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 ashift=13 GZIPSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache160320480640800SE +/- 6.01, N = 3SE +/- 10.81, N = 3SE +/- 9.17, N = 3SE +/- 10.41, N = 4SE +/- 10.31, N = 15SE +/- 7.51, N = 3SE +/- 4.58, N = 3SE +/- 9.21, N = 3SE +/- 8.40, N = 6SE +/- 5.39, N = 15SE +/- 10.33, N = 3SE +/- 11.06, N = 3SE +/- 10.59, N = 3SE +/- 8.74, N = 3SE +/- 4.24, N = 7SE +/- 1.94, N = 15SE +/- 1.79, N = 15752745742733731719705700700698696694690690405122116-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 ashift=13 GZIPSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache130260390520650Min: 740 / Avg: 751.67 / Max: 760Min: 724 / Avg: 745.33 / Max: 759Min: 730 / Avg: 742 / Max: 760Min: 702 / Avg: 732.5 / Max: 748Min: 651 / Avg: 731.07 / Max: 775Min: 711 / Avg: 719 / Max: 734Min: 699 / Avg: 705 / Max: 714Min: 682 / Avg: 699.67 / Max: 713Min: 674 / Avg: 700.17 / Max: 721Min: 654 / Avg: 698.4 / Max: 730Min: 681 / Avg: 696.33 / Max: 716Min: 672 / Avg: 694 / Max: 707Min: 676 / Avg: 690.33 / Max: 711Min: 678 / Avg: 690 / Max: 707Min: 384 / Avg: 405.43 / Max: 417Min: 110 / Avg: 122.27 / Max: 130Min: 107 / Avg: 116.47 / Max: 1271. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1SSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 ashift=13 GZIPSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache40K80K120K160K200KSE +/- 1201.85, N = 3SE +/- 2848.00, N = 3SE +/- 2185.81, N = 3SE +/- 2657.54, N = 4SE +/- 2590.95, N = 15SE +/- 2000.00, N = 3SE +/- 1201.85, N = 3SE +/- 2170.51, N = 6SE +/- 2081.67, N = 3SE +/- 1411.52, N = 15SE +/- 2645.75, N = 3SE +/- 2848.00, N = 3SE +/- 2728.45, N = 3SE +/- 2185.81, N = 3SE +/- 1125.22, N = 7SE +/- 500.81, N = 15SE +/- 446.80, N = 171923331906671896671877501871331840001806671793331790001788001780001776671766671766671037433132730065-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1SSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 ashift=13 GZIPSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache30K60K90K120K150KMin: 190000 / Avg: 192333.33 / Max: 194000Min: 185000 / Avg: 190666.67 / Max: 194000Min: 187000 / Avg: 189666.67 / Max: 194000Min: 180000 / Avg: 187750 / Max: 192000Min: 167000 / Avg: 187133.33 / Max: 198000Min: 182000 / Avg: 184000 / Max: 188000Min: 179000 / Avg: 180666.67 / Max: 183000Min: 173000 / Avg: 179333.33 / Max: 185000Min: 175000 / Avg: 179000 / Max: 182000Min: 167000 / Avg: 178800 / Max: 187000Min: 174000 / Avg: 178000 / Max: 183000Min: 172000 / Avg: 177666.67 / Max: 181000Min: 173000 / Avg: 176666.67 / Max: 182000Min: 174000 / Avg: 176666.67 / Max: 181000Min: 98200 / Avg: 103742.86 / Max: 107000Min: 28200 / Avg: 31326.67 / Max: 33300Min: 27400 / Avg: 30064.71 / Max: 325001. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID0 zilSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache8001600240032004000SE +/- 52.80, N = 4SE +/- 33.15, N = 10SE +/- 2.19, N = 3SE +/- 31.12, N = 15SE +/- 20.17, N = 3SE +/- 45.48, N = 15SE +/- 34.00, N = 8SE +/- 48.38, N = 15SE +/- 51.93, N = 3SE +/- 39.53, N = 15SE +/- 51.32, N = 3SE +/- 48.05, N = 15SE +/- 51.28, N = 15SE +/- 39.90, N = 15SE +/- 64.00, N = 15SE +/- 25.91, N = 3SE +/- 34.05, N = 335563550354234873470346034523280325331813146314431283102308530362755-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID0 zilSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache6001200180024003000Min: 3399 / Avg: 3556 / Max: 3628Min: 3292 / Avg: 3550 / Max: 3651Min: 3538 / Avg: 3542.33 / Max: 3545Min: 3221 / Avg: 3486.93 / Max: 3623Min: 3430 / Avg: 3470.33 / Max: 3491Min: 3185 / Avg: 3460 / Max: 3715Min: 3297 / Avg: 3452.25 / Max: 3555Min: 2814 / Avg: 3280.33 / Max: 3483Min: 3149 / Avg: 3252.67 / Max: 3310Min: 2858 / Avg: 3181.13 / Max: 3372Min: 3046 / Avg: 3146 / Max: 3216Min: 2672 / Avg: 3144.33 / Max: 3392Min: 2731 / Avg: 3128.07 / Max: 3464Min: 2625 / Avg: 3101.8 / Max: 3289Min: 2480 / Avg: 3085.33 / Max: 3406Min: 2984 / Avg: 3035.67 / Max: 3065Min: 2710 / Avg: 2755.33 / Max: 28221. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID0 zilSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache400800120016002000SE +/- 26.43, N = 4SE +/- 16.62, N = 10SE +/- 1.33, N = 3SE +/- 15.56, N = 15SE +/- 9.84, N = 3SE +/- 22.75, N = 15SE +/- 17.03, N = 8SE +/- 24.21, N = 15SE +/- 25.87, N = 3SE +/- 19.78, N = 15SE +/- 25.66, N = 3SE +/- 24.05, N = 15SE +/- 25.66, N = 15SE +/- 19.96, N = 15SE +/- 32.02, N = 15SE +/- 13.05, N = 3SE +/- 16.70, N = 317751771176817401732172617221637162315871570156915601547153915141374-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID0 zilSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache30060090012001500Min: 1696 / Avg: 1774.5 / Max: 1811Min: 1642 / Avg: 1771.2 / Max: 1822Min: 1765 / Avg: 1767.67 / Max: 1769Min: 1607 / Avg: 1739.87 / Max: 1808Min: 1712 / Avg: 1731.67 / Max: 1742Min: 1589 / Avg: 1726.33 / Max: 1854Min: 1645 / Avg: 1722.38 / Max: 1774Min: 1403 / Avg: 1636.6 / Max: 1738Min: 1571 / Avg: 1622.67 / Max: 1651Min: 1425 / Avg: 1586.8 / Max: 1682Min: 1520 / Avg: 1570 / Max: 1605Min: 1332 / Avg: 1568.6 / Max: 1693Min: 1362 / Avg: 1560.47 / Max: 1728Min: 1309 / Avg: 1547.4 / Max: 1641Min: 1236 / Avg: 1539 / Max: 1699Min: 1488 / Avg: 1514 / Max: 1529Min: 1352 / Avg: 1374.33 / Max: 14071. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache100200300400500SE +/- 5.93, N = 3SE +/- 6.01, N = 3SE +/- 3.48, N = 3SE +/- 5.70, N = 3SE +/- 3.61, N = 3SE +/- 3.61, N = 3SE +/- 4.58, N = 3SE +/- 5.41, N = 15SE +/- 4.58, N = 15SE +/- 4.93, N = 3SE +/- 4.20, N = 15SE +/- 5.32, N = 15SE +/- 4.98, N = 15SE +/- 4.49, N = 5SE +/- 2.75, N = 15SE +/- 4.36, N = 3SE +/- 3.19, N = 15449427417416397396395388385377367367355351347332313-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache80160240320400Min: 440 / Avg: 448.67 / Max: 460Min: 419 / Avg: 427.33 / Max: 439Min: 411 / Avg: 416.67 / Max: 423Min: 409 / Avg: 415.67 / Max: 427Min: 390 / Avg: 397 / Max: 402Min: 389 / Avg: 396 / Max: 401Min: 389 / Avg: 395 / Max: 404Min: 351 / Avg: 388.07 / Max: 437Min: 350 / Avg: 385.2 / Max: 415Min: 369 / Avg: 377 / Max: 386Min: 331 / Avg: 367.27 / Max: 399Min: 339 / Avg: 367 / Max: 401Min: 319 / Avg: 354.73 / Max: 382Min: 339 / Avg: 351.4 / Max: 366Min: 328 / Avg: 347 / Max: 361Min: 324 / Avg: 332 / Max: 339Min: 287 / Avg: 313.27 / Max: 3291. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache20K40K60K80K100KSE +/- 1527.53, N = 3SE +/- 1527.53, N = 3SE +/- 881.92, N = 3SE +/- 1333.33, N = 3SE +/- 913.48, N = 3SE +/- 1008.85, N = 3SE +/- 1092.91, N = 3SE +/- 1399.47, N = 15SE +/- 1154.16, N = 15SE +/- 1216.55, N = 3SE +/- 1052.26, N = 15SE +/- 1383.92, N = 15SE +/- 1285.26, N = 15SE +/- 1152.56, N = 5SE +/- 686.93, N = 15SE +/- 1135.78, N = 3SE +/- 791.42, N = 1511500010900010633310633310163310153310083399293985139650093920939009081389920887678500080067-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cache20K40K60K80K100KMin: 113000 / Avg: 115000 / Max: 118000Min: 107000 / Avg: 109000 / Max: 112000Min: 105000 / Avg: 106333.33 / Max: 108000Min: 105000 / Avg: 106333.33 / Max: 109000Min: 99900 / Avg: 101633.33 / Max: 103000Min: 99600 / Avg: 101533.33 / Max: 103000Min: 99500 / Avg: 100833.33 / Max: 103000Min: 89900 / Avg: 99293.33 / Max: 112000Min: 89600 / Avg: 98513.33 / Max: 106000Min: 94500 / Avg: 96500 / Max: 98700Min: 84800 / Avg: 93920 / Max: 102000Min: 86800 / Avg: 93900 / Max: 103000Min: 81600 / Avg: 90813.33 / Max: 97900Min: 86700 / Avg: 89920 / Max: 93600Min: 83900 / Avg: 88766.67 / Max: 92400Min: 82900 / Avg: 85000 / Max: 86800Min: 73500 / Avg: 80066.67 / Max: 841001. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 6x76G RAID1SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache10002000300040005000SE +/- 5.24, N = 3SE +/- 19.81, N = 3SE +/- 42.67, N = 3SE +/- 40.81, N = 15SE +/- 44.31, N = 15SE +/- 53.34, N = 3SE +/- 51.16, N = 7SE +/- 27.18, N = 3SE +/- 43.14, N = 3SE +/- 44.77, N = 15SE +/- 57.37, N = 4SE +/- 41.13, N = 15SE +/- 59.02, N = 5SE +/- 56.46, N = 5SE +/- 15.89, N = 3SE +/- 4.84, N = 3SE +/- 2.08, N = 347714746473447134701467446654639460446014590455844934465239623292292-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 6x76G RAID1SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache8001600240032004000Min: 4761 / Avg: 4770.67 / Max: 4779Min: 4715 / Avg: 4746.33 / Max: 4783Min: 4649 / Avg: 4734.33 / Max: 4778Min: 4376 / Avg: 4713.47 / Max: 4862Min: 4362 / Avg: 4700.87 / Max: 4904Min: 4568 / Avg: 4674.33 / Max: 4735Min: 4411 / Avg: 4665.14 / Max: 4789Min: 4610 / Avg: 4638.67 / Max: 4693Min: 4518 / Avg: 4604 / Max: 4653Min: 4278 / Avg: 4601 / Max: 4763Min: 4420 / Avg: 4589.5 / Max: 4662Min: 4360 / Avg: 4557.93 / Max: 4777Min: 4422 / Avg: 4493 / Max: 4728Min: 4384 / Avg: 4465 / Max: 4689Min: 2369 / Avg: 2396 / Max: 2424Min: 2319 / Avg: 2328.67 / Max: 2334Min: 2289 / Avg: 2292 / Max: 22961. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 6x76G RAID1SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache5001000150020002500SE +/- 9.91, N = 3SE +/- 21.17, N = 3SE +/- 20.40, N = 15SE +/- 22.18, N = 15SE +/- 26.77, N = 3SE +/- 25.56, N = 7SE +/- 13.68, N = 3SE +/- 21.40, N = 3SE +/- 22.37, N = 15SE +/- 28.73, N = 4SE +/- 20.60, N = 15SE +/- 29.48, N = 5SE +/- 28.33, N = 5SE +/- 2.33, N = 3SE +/- 1.20, N = 323822370236323532347233323292316229922972291227522432229119411611143-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 6x76G RAID1SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache400800120016002000Min: 2354 / Avg: 2369.67 / Max: 2388Min: 2321 / Avg: 2363.33 / Max: 2385Min: 2184 / Avg: 2353.07 / Max: 2427Min: 2177 / Avg: 2346.8 / Max: 2449Min: 2280 / Avg: 2333.33 / Max: 2364Min: 2202 / Avg: 2329 / Max: 2391Min: 2301 / Avg: 2315.67 / Max: 2343Min: 2256 / Avg: 2298.67 / Max: 2323Min: 2136 / Avg: 2297 / Max: 2378Min: 2206 / Avg: 2291 / Max: 2327Min: 2176 / Avg: 2275.2 / Max: 2385Min: 2207 / Avg: 2242.6 / Max: 2360Min: 2188 / Avg: 2228.6 / Max: 2341Min: 1156 / Avg: 1160.67 / Max: 1163Min: 1141 / Avg: 1142.67 / Max: 11451. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10 ZSTD2004006008001000SE +/- 7.37, N = 3SE +/- 3.93, N = 3SE +/- 9.60, N = 8SE +/- 3.51, N = 3SE +/- 10.91, N = 3SE +/- 8.08, N = 15SE +/- 8.39, N = 10SE +/- 8.89, N = 8SE +/- 10.48, N = 3SE +/- 10.54, N = 3SE +/- 4.91, N = 3SE +/- 11.02, N = 3SE +/- 4.67, N = 3SE +/- 7.83, N = 15SE +/- 5.90, N = 3SE +/- 6.51, N = 3SE +/- 7.94, N = 3939931910909908905901897891891889882880878741734730-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10 ZSTD160320480640800Min: 925 / Avg: 939 / Max: 950Min: 926 / Avg: 931.33 / Max: 939Min: 848 / Avg: 909.88 / Max: 933Min: 902 / Avg: 909 / Max: 913Min: 887 / Avg: 908.33 / Max: 923Min: 845 / Avg: 905.2 / Max: 953Min: 848 / Avg: 900.7 / Max: 922Min: 840 / Avg: 897.13 / Max: 926Min: 872 / Avg: 891.33 / Max: 908Min: 870 / Avg: 891 / Max: 903Min: 883 / Avg: 889.33 / Max: 899Min: 860 / Avg: 882 / Max: 894Min: 871 / Avg: 879.67 / Max: 887Min: 801 / Avg: 877.53 / Max: 915Min: 729 / Avg: 740.67 / Max: 748Min: 721 / Avg: 734 / Max: 741Min: 718 / Avg: 730 / Max: 7451. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10 ZSTD50K100K150K200K250KSE +/- 1763.83, N = 3SE +/- 881.92, N = 3SE +/- 2488.81, N = 8SE +/- 881.92, N = 3SE +/- 2728.45, N = 3SE +/- 2088.97, N = 15SE +/- 2130.21, N = 10SE +/- 2275.16, N = 8SE +/- 2905.93, N = 3SE +/- 2516.61, N = 3SE +/- 1201.85, N = 3SE +/- 2848.00, N = 3SE +/- 1201.85, N = 3SE +/- 1990.93, N = 15SE +/- 1333.33, N = 3SE +/- 1527.53, N = 3SE +/- 2081.67, N = 3240333238333232875232667232333231800230600229625228333228000227667225667225333224800189667188000187000-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10 ZSTD40K80K120K160K200KMin: 237000 / Avg: 240333.33 / Max: 243000Min: 237000 / Avg: 238333.33 / Max: 240000Min: 217000 / Avg: 232875 / Max: 239000Min: 231000 / Avg: 232666.67 / Max: 234000Min: 227000 / Avg: 232333.33 / Max: 236000Min: 216000 / Avg: 231800 / Max: 244000Min: 217000 / Avg: 230600 / Max: 236000Min: 215000 / Avg: 229625 / Max: 237000Min: 223000 / Avg: 228333.33 / Max: 233000Min: 223000 / Avg: 228000 / Max: 231000Min: 226000 / Avg: 227666.67 / Max: 230000Min: 220000 / Avg: 225666.67 / Max: 229000Min: 223000 / Avg: 225333.33 / Max: 227000Min: 205000 / Avg: 224800 / Max: 234000Min: 187000 / Avg: 189666.67 / Max: 191000Min: 185000 / Avg: 188000 / Max: 190000Min: 184000 / Avg: 187000 / Max: 1910001. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zilSAS 6x76G RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cache8001600240032004000SE +/- 22.41, N = 3SE +/- 34.43, N = 12SE +/- 34.72, N = 3SE +/- 32.55, N = 15SE +/- 50.30, N = 3SE +/- 17.38, N = 3SE +/- 42.61, N = 3SE +/- 30.88, N = 3SE +/- 28.45, N = 3SE +/- 19.00, N = 3SE +/- 45.04, N = 3SE +/- 36.44, N = 12SE +/- 36.95, N = 15SE +/- 33.87, N = 3SE +/- 8.19, N = 3SE +/- 31.25, N = 3SE +/- 17.57, N = 335243523349634873435341834143365329632653142312431083105295228782779-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zilSAS 6x76G RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cache6001200180024003000Min: 3488 / Avg: 3523.67 / Max: 3565Min: 3172 / Avg: 3523.17 / Max: 3688Min: 3438 / Avg: 3495.67 / Max: 3558Min: 3269 / Avg: 3487 / Max: 3702Min: 3364 / Avg: 3434.67 / Max: 3532Min: 3384 / Avg: 3417.67 / Max: 3442Min: 3337 / Avg: 3414.33 / Max: 3484Min: 3325 / Avg: 3365.33 / Max: 3426Min: 3244 / Avg: 3296 / Max: 3342Min: 3246 / Avg: 3265 / Max: 3303Min: 3052 / Avg: 3141.67 / Max: 3194Min: 2805 / Avg: 3124.17 / Max: 3289Min: 2885 / Avg: 3107.53 / Max: 3323Min: 3056 / Avg: 3105 / Max: 3170Min: 2937 / Avg: 2952.33 / Max: 2965Min: 2819 / Avg: 2878.33 / Max: 2925Min: 2745 / Avg: 2779.33 / Max: 28031. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zilSAS 6x76G RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cache400800120016002000SE +/- 11.36, N = 3SE +/- 17.23, N = 12SE +/- 17.65, N = 3SE +/- 25.15, N = 3SE +/- 8.74, N = 3SE +/- 21.15, N = 3SE +/- 15.28, N = 3SE +/- 14.22, N = 3SE +/- 9.67, N = 3SE +/- 22.59, N = 3SE +/- 18.23, N = 12SE +/- 18.49, N = 15SE +/- 16.90, N = 3SE +/- 4.10, N = 3SE +/- 15.62, N = 3SE +/- 8.74, N = 317581758174417401713170517031679164416291567155915501549147314361386-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zilSAS 6x76G RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cache30060090012001500Min: 1740 / Avg: 1758 / Max: 1779Min: 1582 / Avg: 1757.83 / Max: 1840Min: 1715 / Avg: 1744.33 / Max: 1776Min: 1678 / Avg: 1713.33 / Max: 1762Min: 1688 / Avg: 1705 / Max: 1717Min: 1665 / Avg: 1703.33 / Max: 1738Min: 1659 / Avg: 1679 / Max: 1709Min: 1618 / Avg: 1644 / Max: 1667Min: 1619 / Avg: 1628.67 / Max: 1648Min: 1522 / Avg: 1567 / Max: 1593Min: 1399 / Avg: 1558.5 / Max: 1641Min: 1439 / Avg: 1550.13 / Max: 1658Min: 1524 / Avg: 1548.67 / Max: 1581Min: 1465 / Avg: 1472.67 / Max: 1479Min: 1406 / Avg: 1435.67 / Max: 1459Min: 1369 / Avg: 1386 / Max: 13981. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTD110220330440550SE +/- 4.73, N = 3SE +/- 4.06, N = 3SE +/- 5.19, N = 7SE +/- 1.53, N = 3SE +/- 4.84, N = 8SE +/- 3.53, N = 3SE +/- 5.29, N = 7SE +/- 4.63, N = 3SE +/- 5.13, N = 3SE +/- 5.84, N = 3SE +/- 4.52, N = 15SE +/- 2.67, N = 3SE +/- 5.44, N = 5SE +/- 5.59, N = 5SE +/- 3.22, N = 15SE +/- 5.46, N = 5SE +/- 4.29, N = 15515494493488487478473470454441433432431428425416415-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTD90180270360450Min: 508 / Avg: 515 / Max: 524Min: 487 / Avg: 494.33 / Max: 501Min: 469 / Avg: 492.57 / Max: 507Min: 486 / Avg: 488 / Max: 491Min: 460 / Avg: 487 / Max: 507Min: 471 / Avg: 477.67 / Max: 483Min: 457 / Avg: 473.14 / Max: 499Min: 462 / Avg: 470.33 / Max: 478Min: 447 / Avg: 454 / Max: 464Min: 435 / Avg: 441.33 / Max: 453Min: 401 / Avg: 433.27 / Max: 455Min: 429 / Avg: 431.67 / Max: 437Min: 415 / Avg: 430.8 / Max: 448Min: 418 / Avg: 428 / Max: 444Min: 398 / Avg: 424.53 / Max: 445Min: 402 / Avg: 416.2 / Max: 428Min: 394 / Avg: 414.87 / Max: 4461. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTD30K60K90K120K150KSE +/- 1201.85, N = 3SE +/- 881.92, N = 3SE +/- 1340.12, N = 7SE +/- 577.35, N = 3SE +/- 1250.00, N = 8SE +/- 881.92, N = 3SE +/- 1404.56, N = 7SE +/- 1154.70, N = 3SE +/- 1527.53, N = 3SE +/- 1527.53, N = 3SE +/- 1116.40, N = 15SE +/- 666.67, N = 3SE +/- 1462.87, N = 5SE +/- 1435.27, N = 5SE +/- 854.49, N = 15SE +/- 1503.33, N = 5SE +/- 1096.31, N = 15131667126667126286125000124750122667121143120000116000113000110867110667110200109600108667106600106200-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10-zil LZ4SAS 6x76G RAID1SAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTD20K40K60K80K100KMin: 130000 / Avg: 131666.67 / Max: 134000Min: 125000 / Avg: 126666.67 / Max: 128000Min: 120000 / Avg: 126285.71 / Max: 130000Min: 124000 / Avg: 125000 / Max: 126000Min: 118000 / Avg: 124750 / Max: 130000Min: 121000 / Avg: 122666.67 / Max: 124000Min: 117000 / Avg: 121142.86 / Max: 128000Min: 118000 / Avg: 120000 / Max: 122000Min: 114000 / Avg: 116000 / Max: 119000Min: 111000 / Avg: 113000 / Max: 116000Min: 103000 / Avg: 110866.67 / Max: 116000Min: 110000 / Avg: 110666.67 / Max: 112000Min: 106000 / Avg: 110200 / Max: 115000Min: 107000 / Avg: 109600 / Max: 114000Min: 102000 / Avg: 108666.67 / Max: 114000Min: 103000 / Avg: 106600 / Max: 110000Min: 101000 / Avg: 106200 / Max: 1140001. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cacheSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SAS 6x76G RAID180160240320400SE +/- 1.68, N = 3SE +/- 3.27, N = 3SE +/- 2.32, N = 3SE +/- 4.94, N = 3SE +/- 2.45, N = 13SE +/- 2.58, N = 3SE +/- 4.74, N = 3SE +/- 0.58, N = 3SE +/- 0.61, N = 3SE +/- 0.60, N = 3SE +/- 0.43, N = 3SE +/- 0.06, N = 3SE +/- 0.26, N = 3SE +/- 0.44, N = 3SE +/- 0.37, N = 3SE +/- 0.32, N = 4SE +/- 0.23, N = 3364.6338.8305.3298.2297.0295.3294.140.340.139.338.132.529.629.525.223.923.21. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 4x1TB RAID10-zil ZSTDSAS 10x300GB RAID10-zil-cacheSSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SAS 6x76G RAID170140210280350Min: 362.3 / Avg: 364.63 / Max: 367.9Min: 333.7 / Avg: 338.8 / Max: 344.9Min: 302.8 / Avg: 305.27 / Max: 309.9Min: 291.4 / Avg: 298.2 / Max: 307.8Min: 282.5 / Avg: 296.98 / Max: 309.3Min: 290.2 / Avg: 295.33 / Max: 298.4Min: 285.4 / Avg: 294.13 / Max: 301.7Min: 39.7 / Avg: 40.33 / Max: 41.5Min: 39.3 / Avg: 40.1 / Max: 41.3Min: 38.1 / Avg: 39.3 / Max: 39.9Min: 37.4 / Avg: 38.13 / Max: 38.9Min: 32.4 / Avg: 32.5 / Max: 32.6Min: 29.1 / Avg: 29.6 / Max: 30Min: 28.6 / Avg: 29.47 / Max: 30Min: 24.5 / Avg: 25.23 / Max: 25.7Min: 23.1 / Avg: 23.85 / Max: 24.6Min: 22.8 / Avg: 23.2 / Max: 23.61. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsSSD 4x1TB RAID10-zil LZ4SAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1-zil LZ4SAS 10x300GB RAID10-zil-cacheSSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13170340510680850SE +/- 0.39, N = 3SE +/- 2.00, N = 3SE +/- 3.90, N = 3SE +/- 6.85, N = 15SE +/- 4.41, N = 15SE +/- 0.35, N = 3SE +/- 1.52, N = 3SE +/- 0.81, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.66, N = 4SE +/- 0.13, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3767.5752.5567.0406.8251.9174.5173.052.151.649.447.847.647.547.533.329.327.91. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsSSD 4x1TB RAID10-zil LZ4SAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1-zil LZ4SAS 10x300GB RAID10-zil-cacheSSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13130260390520650Min: 767 / Avg: 767.53 / Max: 768.3Min: 748.5 / Avg: 752.5 / Max: 754.6Min: 562 / Avg: 567.03 / Max: 574.7Min: 369.1 / Avg: 406.76 / Max: 474.4Min: 218.8 / Avg: 251.85 / Max: 273.4Min: 173.9 / Avg: 174.47 / Max: 175.1Min: 170 / Avg: 173.03 / Max: 174.6Min: 50.8 / Avg: 52.13 / Max: 53.6Min: 51.6 / Avg: 51.63 / Max: 51.7Min: 48.9 / Avg: 49.43 / Max: 49.8Min: 47.6 / Avg: 47.77 / Max: 48Min: 47.3 / Avg: 47.63 / Max: 47.8Min: 45.6 / Avg: 47.5 / Max: 48.4Min: 47.2 / Avg: 47.47 / Max: 47.6Min: 32.9 / Avg: 33.33 / Max: 33.6Min: 29.2 / Avg: 29.33 / Max: 29.6Min: 27.6 / Avg: 27.93 / Max: 28.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSSD 4x1TB RAID10-zil LZ4SAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SAS 6x76G RAID180160240320400SE +/- 5.48, N = 3SE +/- 5.34, N = 3SE +/- 1.87, N = 3SE +/- 0.56, N = 3SE +/- 7.18, N = 15SE +/- 10.08, N = 15SE +/- 11.64, N = 15SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.52, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3365.5324.0292.0288.3271.1262.4262.039.338.838.037.832.530.530.225.124.422.11. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSSD 4x1TB RAID10-zil LZ4SAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SAS 6x76G RAID170140210280350Min: 354.6 / Avg: 365.53 / Max: 371.7Min: 314.9 / Avg: 323.97 / Max: 333.4Min: 288.3 / Avg: 291.97 / Max: 294.4Min: 287.2 / Avg: 288.3 / Max: 289Min: 193.8 / Avg: 271.05 / Max: 298.5Min: 199.9 / Avg: 262.45 / Max: 297.1Min: 198.6 / Avg: 261.98 / Max: 307.6Min: 39.1 / Avg: 39.33 / Max: 39.8Min: 38.6 / Avg: 38.83 / Max: 39.2Min: 37.9 / Avg: 38 / Max: 38.1Min: 37.4 / Avg: 37.77 / Max: 38.2Min: 32.4 / Avg: 32.47 / Max: 32.6Min: 30.3 / Avg: 30.5 / Max: 30.8Min: 29.3 / Avg: 30.2 / Max: 31.1Min: 24.9 / Avg: 25.1 / Max: 25.4Min: 24.3 / Avg: 24.4 / Max: 24.5Min: 22.1 / Avg: 22.1 / Max: 22.11. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10 ZSTD30060090012001500SE +/- 14.27, N = 6SE +/- 12.20, N = 3SE +/- 2.55, N = 3SE +/- 10.09, N = 15SE +/- 11.63, N = 6SE +/- 12.70, N = 3SE +/- 12.54, N = 5SE +/- 4.72, N = 3SE +/- 3.50, N = 3SE +/- 9.88, N = 3SE +/- 3.97, N = 3SE +/- 6.53, N = 3SE +/- 9.29, N = 15SE +/- 7.05, N = 15SE +/- 9.59, N = 4SE +/- 8.83, N = 4SE +/- 8.92, N = 41230.21011.3995.3991.8984.4967.3960.4958.2957.9957.2955.2938.1927.6668.0662.1626.8614.91. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zilSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10 ZSTD2004006008001000Min: 1165.1 / Avg: 1230.2 / Max: 1252Min: 998.2 / Avg: 1011.33 / Max: 1035.7Min: 992.6 / Avg: 995.3 / Max: 1000.4Min: 940.3 / Avg: 991.79 / Max: 1063.9Min: 950.7 / Avg: 984.35 / Max: 1027.4Min: 948.7 / Avg: 967.33 / Max: 991.6Min: 924.2 / Avg: 960.44 / Max: 995.4Min: 949 / Avg: 958.17 / Max: 964.7Min: 951 / Avg: 957.9 / Max: 962.4Min: 940.4 / Avg: 957.17 / Max: 974.6Min: 950 / Avg: 955.2 / Max: 963Min: 925.3 / Avg: 938.07 / Max: 946.8Min: 863 / Avg: 927.6 / Max: 1006.5Min: 630.8 / Avg: 668.05 / Max: 742Min: 635.1 / Avg: 662.05 / Max: 680.5Min: 612.3 / Avg: 626.83 / Max: 651.7Min: 593.6 / Avg: 614.85 / Max: 637.11. (CC) gcc options: -static

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsSAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID0 zilSAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1400800120016002000SE +/- 14.14, N = 3SE +/- 13.01, N = 3SE +/- 2.01, N = 3SE +/- 11.17, N = 3SE +/- 7.01, N = 3SE +/- 22.03, N = 9SE +/- 7.01, N = 3SE +/- 1.58, N = 3SE +/- 3.80, N = 3SE +/- 0.52, N = 3SE +/- 3.37, N = 9SE +/- 0.52, N = 3SE +/- 0.54, N = 3SE +/- 1.79, N = 3SE +/- 0.70, N = 3SE +/- 0.85, N = 3SE +/- 1.70, N = 32034.171107.83842.18652.38627.13592.88565.20436.90428.84350.76336.96235.08230.74221.98165.18154.47120.581. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsSAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID0 zilSAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10-zilSSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1 LZ4SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SAS 6x76G RAID1400800120016002000Min: 2006.73 / Avg: 2034.17 / Max: 2053.8Min: 1084.63 / Avg: 1107.83 / Max: 1129.63Min: 838.67 / Avg: 842.18 / Max: 845.62Min: 641.03 / Avg: 652.38 / Max: 674.72Min: 614.18 / Avg: 627.12 / Max: 638.26Min: 473.39 / Avg: 592.88 / Max: 684.56Min: 556.54 / Avg: 565.2 / Max: 579.07Min: 435.06 / Avg: 436.9 / Max: 440.03Min: 421.35 / Avg: 428.84 / Max: 433.72Min: 350.02 / Avg: 350.76 / Max: 351.77Min: 319.15 / Avg: 336.96 / Max: 348.21Min: 234.2 / Avg: 235.08 / Max: 235.98Min: 230.11 / Avg: 230.74 / Max: 231.81Min: 219.59 / Avg: 221.98 / Max: 225.48Min: 163.93 / Avg: 165.18 / Max: 166.33Min: 152.96 / Avg: 154.47 / Max: 155.9Min: 118.69 / Avg: 120.58 / Max: 123.981. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 6x76G RAID160120180240300SE +/- 2.41, N = 3SE +/- 3.08, N = 3SE +/- 2.30, N = 3SE +/- 1.24, N = 3SE +/- 1.59, N = 3SE +/- 1.61, N = 3SE +/- 0.45, N = 3SE +/- 0.15, N = 3SE +/- 0.61, N = 3SE +/- 1.41, N = 3SE +/- 0.60, N = 3SE +/- 0.86, N = 3SE +/- 0.69, N = 3SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3268.21268.08250.63246.83242.90222.89220.1297.1496.8593.6791.0282.4379.9771.9249.7148.5739.851. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SSD 4x1TB RAID10-zilSSD 2x1TB RAID0 zilSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSAS 6x76G RAID150100150200250Min: 263.83 / Avg: 268.21 / Max: 272.13Min: 262.05 / Avg: 268.08 / Max: 272.16Min: 248.01 / Avg: 250.63 / Max: 255.21Min: 244.36 / Avg: 246.83 / Max: 248.18Min: 241.11 / Avg: 242.9 / Max: 246.07Min: 220.63 / Avg: 222.89 / Max: 226.02Min: 219.42 / Avg: 220.12 / Max: 220.97Min: 96.85 / Avg: 97.14 / Max: 97.38Min: 95.67 / Avg: 96.85 / Max: 97.73Min: 91.19 / Avg: 93.67 / Max: 96.07Min: 89.85 / Avg: 91.02 / Max: 91.81Min: 80.72 / Avg: 82.43 / Max: 83.37Min: 78.91 / Avg: 79.97 / Max: 81.27Min: 71.87 / Avg: 71.92 / Max: 72.01Min: 49.49 / Avg: 49.71 / Max: 50.13Min: 48.25 / Avg: 48.57 / Max: 48.88Min: 39.61 / Avg: 39.85 / Max: 401. (CC) gcc options: -lpopt -O2

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cacheSAS 6x76G RAID1SSD 4x1TB RAID10 ZSTDSSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=132004006008001000SE +/- 8.79, N = 11SE +/- 7.54, N = 3SE +/- 13.62, N = 4SE +/- 10.65, N = 3SE +/- 11.30, N = 15SE +/- 13.20, N = 15SE +/- 10.24, N = 12SE +/- 10.30, N = 3SE +/- 8.15, N = 4SE +/- 7.12, N = 3SE +/- 4.07, N = 3SE +/- 4.05, N = 12SE +/- 6.65, N = 15SE +/- 4.22, N = 3SE +/- 4.79, N = 15SE +/- 4.23, N = 9SE +/- 2.01, N = 6978.69931.37913.34911.98885.92824.75647.47618.05583.44498.12357.43331.66327.92279.85277.63185.97175.84
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 LZ4SAS 10x300GB RAID10-zil-cacheSAS 6x76G RAID1SSD 4x1TB RAID10 ZSTDSSD 2x1TB RAID0 zilSAS 4x1TB RAID10-zil ZSTDSSD 4x1TB RAID10-zilSSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=132004006008001000Min: 949.31 / Avg: 978.69 / Max: 1047.45Min: 916.79 / Avg: 931.37 / Max: 942Min: 878.07 / Avg: 913.34 / Max: 940.61Min: 891.76 / Avg: 911.98 / Max: 927.87Min: 771.15 / Avg: 885.92 / Max: 950.6Min: 671.03 / Avg: 824.75 / Max: 864.34Min: 602.44 / Avg: 647.47 / Max: 704.68Min: 599.06 / Avg: 618.05 / Max: 634.46Min: 563.34 / Avg: 583.44 / Max: 603.06Min: 490.9 / Avg: 498.12 / Max: 512.35Min: 352.4 / Avg: 357.43 / Max: 365.49Min: 303.28 / Avg: 331.66 / Max: 344.68Min: 264.16 / Avg: 327.92 / Max: 363.81Min: 271.42 / Avg: 279.85 / Max: 284.46Min: 236.8 / Avg: 277.63 / Max: 296.66Min: 174.94 / Avg: 185.97 / Max: 215.2Min: 169.94 / Avg: 175.84 / Max: 183.76

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1-zil LZ4SAS 10x300GB RAID10-zil-cacheSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 ashift=13SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID0 zilSSD 4x1TB RAID10-zilSAS 6x76G RAID1306090120150SE +/- 0.63, N = 3SE +/- 0.48, N = 3SE +/- 1.03, N = 3SE +/- 1.38, N = 3SE +/- 0.17, N = 3SE +/- 0.70, N = 3SE +/- 0.81, N = 3SE +/- 0.51, N = 3SE +/- 1.70, N = 3SE +/- 0.56, N = 3SE +/- 0.81, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3SE +/- 1.41, N = 3SE +/- 0.44, N = 3SE +/- 0.95, N = 3SE +/- 0.76, N = 3135.82134.41134.15132.97129.80129.66129.04128.61125.33122.93120.31119.38117.68117.36113.07106.5099.56
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSAS 4x1TB RAID10-zil ZSTD(2)SSD 2x1TB RAID1 GZIPSSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1-zil LZ4SAS 10x300GB RAID10-zil-cacheSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 ashift=13SSD 4x1TB RAID10 ZSTDSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1SAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID0 zilSSD 4x1TB RAID10-zilSAS 6x76G RAID1306090120150Min: 135.12 / Avg: 135.82 / Max: 137.08Min: 133.86 / Avg: 134.41 / Max: 135.37Min: 132.42 / Avg: 134.15 / Max: 135.98Min: 131.51 / Avg: 132.97 / Max: 135.73Min: 129.46 / Avg: 129.8 / Max: 129.97Min: 128.7 / Avg: 129.66 / Max: 131.03Min: 128.09 / Avg: 129.04 / Max: 130.64Min: 127.89 / Avg: 128.61 / Max: 129.59Min: 123.08 / Avg: 125.33 / Max: 128.67Min: 122.37 / Avg: 122.93 / Max: 124.05Min: 118.83 / Avg: 120.31 / Max: 121.62Min: 117.67 / Avg: 119.38 / Max: 120.61Min: 116.54 / Avg: 117.68 / Max: 118.85Min: 114.54 / Avg: 117.36 / Max: 118.8Min: 112.41 / Avg: 113.07 / Max: 113.91Min: 105.54 / Avg: 106.5 / Max: 108.4Min: 98.08 / Avg: 99.56 / Max: 100.58

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeSSD 2x1TB RAID1SSD 4x1TB RAID10 ZSTDSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID0 zilSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1SSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10-zilSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 GZIP2004006008001000SE +/- 6.88, N = 3SE +/- 16.60, N = 3SE +/- 46.58, N = 3SE +/- 15.84, N = 3SE +/- 9.36, N = 3SE +/- 26.17, N = 3SE +/- 15.66, N = 3SE +/- 15.40, N = 3SE +/- 8.46, N = 3SE +/- 9.00, N = 3SE +/- 28.81, N = 3SE +/- 18.73, N = 3SE +/- 6.96, N = 3SE +/- 24.36, N = 3SE +/- 51.76, N = 3SE +/- 14.96, N = 3SE +/- 3.16, N = 3828.27822.71817.73799.43795.83788.25783.17776.37760.65756.19745.26710.82698.00657.54635.35599.83590.62
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeSSD 2x1TB RAID1SSD 4x1TB RAID10 ZSTDSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SSD 2x1TB RAID0 zilSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 LZ4SAS 6x76G RAID1SSD 2x1TB RAID1 LZ4SSD 4x1TB RAID10-zilSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 GZIPSAS 4x1TB RAID10-zil ZSTDSSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 GZIP150300450600750Min: 814.64 / Avg: 828.27 / Max: 836.67Min: 805.26 / Avg: 822.71 / Max: 855.9Min: 728.38 / Avg: 817.73 / Max: 885.21Min: 768.01 / Avg: 799.43 / Max: 818.66Min: 779.9 / Avg: 795.83 / Max: 812.3Min: 748.28 / Avg: 788.25 / Max: 837.49Min: 752.16 / Avg: 783.17 / Max: 802.5Min: 748.23 / Avg: 776.37 / Max: 801.29Min: 743.74 / Avg: 760.65 / Max: 769.35Min: 739.08 / Avg: 756.19 / Max: 769.57Min: 693.95 / Avg: 745.26 / Max: 793.61Min: 676.91 / Avg: 710.82 / Max: 741.58Min: 687.69 / Avg: 698 / Max: 711.24Min: 610.3 / Avg: 657.54 / Max: 691.5Min: 562.24 / Avg: 635.35 / Max: 735.38Min: 570.58 / Avg: 599.83 / Max: 619.91Min: 587.32 / Avg: 590.62 / Max: 596.93

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceSSD 2x1TB RAID0 zilSSD 4x1TB RAID10-zil LZ4SAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=135001000150020002500SE +/- 7.67, N = 3SE +/- 26.12, N = 12SE +/- 10.39, N = 3SE +/- 15.25, N = 3SE +/- 18.19, N = 3SE +/- 23.46, N = 3SE +/- 34.52, N = 11SE +/- 7.00, N = 3SE +/- 68.68, N = 10SE +/- 12.29, N = 12SE +/- 38.20, N = 12SE +/- 13.96, N = 7SE +/- 26.72, N = 11SE +/- 53.66, N = 9SE +/- 60.67, N = 9SE +/- 12.58, N = 3SE +/- 17.88, N = 9244222052118209519841969185816191353132313171306125811641154110110121. (CC) gcc options: -O3
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceSSD 2x1TB RAID0 zilSSD 4x1TB RAID10-zil LZ4SAS 10x300GB RAID10-zil-cacheSSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID1 ashift=13 GZIPSAS 6x76G RAID1SSD 2x1TB RAID1-zil LZ4SSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1SSD 2x1TB RAID1 ashift=13400800120016002000Min: 2427 / Avg: 2442.33 / Max: 2450Min: 1923 / Avg: 2204.58 / Max: 2252Min: 2100 / Avg: 2118 / Max: 2136Min: 2066 / Avg: 2094.67 / Max: 2118Min: 1953 / Avg: 1984.33 / Max: 2016Min: 1923 / Avg: 1969 / Max: 2000Min: 1515 / Avg: 1857.73 / Max: 1908Min: 1612 / Avg: 1619 / Max: 1633Min: 838 / Avg: 1353.2 / Max: 1572Min: 1275 / Avg: 1323.33 / Max: 1436Min: 992 / Avg: 1317 / Max: 1428Min: 1237 / Avg: 1306.29 / Max: 1351Min: 992 / Avg: 1258.45 / Max: 1302Min: 757 / Avg: 1164.33 / Max: 1250Min: 739 / Avg: 1154.33 / Max: 1302Min: 1086 / Avg: 1101 / Max: 1126Min: 929 / Avg: 1012.11 / Max: 11161. (CC) gcc options: -O3

27 Results Shown

SQLite
Flexible IO Tester:
  Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
FS-Mark:
  1000 Files, 1MB Size
  5000 Files, 1MB Size, 4 Threads
  4000 Files, 32 Sub Dirs, 1MB Size
  1000 Files, 1MB Size, No Sync/FSync
Dbench:
  12 Clients
  1 Clients
Compile Bench:
  Compile
  Initial Create
  Read Compiled Tree
PostMark