Dell R720 H710 mini IT Mode w/ZSTD

2 x Intel Xeon E5-2667 Dell R720 ZFS 2.0 RAID Testing

HTML result view exported from: https://openbenchmarking.org/result/2012280-FI-2012190TE84&sro&grw.

Dell R720 H710 mini IT Mode w/ZSTDProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSAS 6x76G RAID1SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache2 x Intel Xeon E5-2667 0 @ 3.50GHz (12 Cores / 24 Threads)Dell 0X3D66 (2.9.0 BIOS)Intel Xeon E5/Core190GB10 x 300GB MBD2300RC + 6 x 73GB Seagate ST973452SS + 257GB Flash DriveMatrox G200eR24 x Intel I350Debian 104.19.0-13-amd64 (x86_64)GCC 8.3.0zfs1280x102410 x 300GB MBD2300RC + 4 x 512GB Samsung SSD 840 + 1000GB SanDisk SSD PLUS + 1000GB Samsung SSD 870 + 257GB Flash Drive + 240GB KINGSTON SA400S31024x768256GB PCIe SSD + 10 x 300GB MBD2300RC + 2 x 240GB CT240BX500SSD1 + 3 x 240GB KINGSTON SA400S3 + 1000GB SanDisk SSD PLUS + 1000GB Samsung SSD 870 + 257GB Flash Drive1280x1024256GB PCIe SSD + 10 x 300GB MBD2300RC + 2 x 240GB CT240BX500SSD1 + 1000GB SanDisk SSD PLUS + 3 x 1000GB Samsung SSD 870 + 257GB Flash Drive + 240GB KINGSTON SA400S3GCC 8.3.0 + Clang 7.0.1-8+deb10u2 + LLVM 7.0.1256GB PCIe SSD + 240GB KINGSTON SA400S3 + 10 x 300GB MBD2300RC + 2 x 240GB CT240BX500SSD1 + 3 x 1000GB Samsung SSD 870 + 257GB Flash Drive + 1000GB SanDisk SSD PLUS5.9.0-0.bpo.2-amd64 (x86_64)256GB PCIe SSD + 10 x 300GB MBD2300RC + 1000GB SanDisk SSD PLUS + 2 x 240GB CT240BX500SSD1 + 3 x 1000GB Samsung SSD 870 + 257GB Flash Drive + 240GB KINGSTON SA400S3 + 4001GB VIRTUAL-DISK1024x768OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -vProcessor Details- SAS 6x76G RAID1: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SAS 6x76G RAID1 LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SAS 6x76G RAID1 GZIP: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 GZIP: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 ashift=13: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 ashift=13 GZIP: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1 ashift=13 LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID0 zil: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 2x1TB RAID1-zil LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 4x1TB RAID10-zil LZ4: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 4x1TB RAID10-zil: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x718- SSD 4x1TB RAID10 ZSTD: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718- SAS 4x1TB RAID10-zil ZSTD: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718- SAS 4x1TB RAID10-zil ZSTD(2): Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718- SAS 10x300GB RAID10-zil-cache: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x718Disk Scheduler Details- SAS 6x76G RAID1: MQ-DEADLINE- SAS 6x76G RAID1 LZ4: MQ-DEADLINE- SAS 6x76G RAID1 GZIP: MQ-DEADLINE- SSD 2x1TB RAID1: MQ-DEADLINE- SSD 2x1TB RAID1 LZ4: MQ-DEADLINE- SSD 2x1TB RAID1 GZIP: MQ-DEADLINE- SSD 2x1TB RAID1 ashift=13: MQ-DEADLINE- SSD 2x1TB RAID1 ashift=13 GZIP: MQ-DEADLINE- SSD 2x1TB RAID1 ashift=13 LZ4: MQ-DEADLINE- SSD 2x1TB RAID0 zil: NONE- SSD 2x1TB RAID1-zil LZ4: NONE- SSD 4x1TB RAID10-zil LZ4: NONE- SSD 4x1TB RAID10-zil: NONE- SSD 4x1TB RAID10 ZSTD: NONE- SAS 4x1TB RAID10-zil ZSTD: NONE- SAS 4x1TB RAID10-zil ZSTD(2): NONE- SAS 10x300GB RAID10-zil-cache: NONEPython Details- Python 2.7.16 + Python 3.7.3Security Details- SAS 6x76G RAID1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 6x76G RAID1 LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 6x76G RAID1 GZIP: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 GZIP: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 ashift=13: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 ashift=13 GZIP: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1 ashift=13 LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID0 zil: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 2x1TB RAID1-zil LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 4x1TB RAID10-zil LZ4: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 4x1TB RAID10-zil: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SSD 4x1TB RAID10 ZSTD: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 4x1TB RAID10-zil ZSTD: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 4x1TB RAID10-zil ZSTD(2): itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected- SAS 10x300GB RAID10-zil-cache: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Dell R720 H710 mini IT Mode w/ZSTDcompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treedbench: 12 Clientsdbench: 1 Clientsfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncpostmark: Disk Transaction Performancesqlite: Timed SQLite InsertionsSAS 6x76G RAID1SAS 6x76G RAID1 LZ4SAS 6x76G RAID1 GZIPSSD 2x1TB RAID1SSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10-zil LZ4SSD 4x1TB RAID10-zilSSD 4x1TB RAID10 ZSTDSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 10x300GB RAID10-zil-cache357.4399.56760.65120.58439.8467458022867001793333146157035189920449322438912280003142156744111300023.233.322.1960.41306139.458583.44119.38783.17235.08049.7149475223726981788003036151433285000471323538972296253105154942810960029.647.830.2984.41323138.458647.47125.33657.54221.97648.5708468223386961780003253162334788767474623708822256673365167942510866729.547.630.5995.31619138.381185.97117.68828.27165.18382.42984893244374519066734601726427109000470123479102328753496174448712475025.229.325.1957.2110133.539913.34129.04756.19428.83996.85024808240075219233335561775396101533477123828912283333414170347012000040.351.638.8957.9115455.393911.98134.41590.62436.89897.1405468323387051806673550177138899293467423339012306003487174047312114340.152.139.3958.2135335.031175.84122.93817.73154.46879.96794593229374218966734701732449115000460122979392403333523175851513166723.927.924.4991.8101248.144885.92132.97599.83350.76093.67454710235169017666734871740397101633460422999092326673265162948812500039.347.538.01011.3131745.065824.75128.61776.37336.95791.02354743236873118713335421768416106333463923169052318003524175849412666738.147.537.8967.3116444.080327.92113.07788.25627.125242.89946152304733187750328016374171063334665232993123833334351713493126286305.3251.9271.1955.2244216.676931.37129.80799.431107.83220.1194547227069417766734521722385985134590229190823233334181705478122667294.1567.0288.3938.1125817.246978.69134.15795.83842.178222.8934432221270017900031281560355908134465222988022533332961644454116000364.6767.5365.51230.2220515.912277.63106.50745.26565.198246.8344636231471918400031811587377965004558227587822480031081550416106600338.8173.0262.0927.6209515.857331.66120.31822.71230.74471.9232340416984051037433102154736793900239611947301870002952147341510620032.549.432.5614.9198430.717279.85117.36635.35652.381268.08044482220690176667308515393951008334734236388922766728781436433110867297.0174.5262.4626.8196915.687618.05135.82698.002034.17250.627241912061223132731441569367939202329116174118966731241559431110200298.2752.5292.0668.0185815.942498.12129.66710.82592.880268.210239511941163006527551374313800672292114373418800027791386432110667295.3406.8324.0662.1211814.797OpenBenchmarking.org

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ42004006008001000SE +/- 7.12, N = 3SE +/- 4.22, N = 3SE +/- 10.30, N = 3SE +/- 4.07, N = 3SE +/- 10.24, N = 12SE +/- 8.15, N = 4SE +/- 6.65, N = 15SE +/- 4.23, N = 9SE +/- 10.65, N = 3SE +/- 13.62, N = 4SE +/- 2.01, N = 6SE +/- 11.30, N = 15SE +/- 13.20, N = 15SE +/- 7.54, N = 3SE +/- 4.05, N = 12SE +/- 4.79, N = 15SE +/- 8.79, N = 11498.12279.85618.05357.43647.47583.44327.92185.97911.98913.34175.84885.92824.75931.37331.66277.63978.69

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4306090120150SE +/- 0.70, N = 3SE +/- 1.41, N = 3SE +/- 0.63, N = 3SE +/- 0.76, N = 3SE +/- 1.70, N = 3SE +/- 0.88, N = 3SE +/- 0.44, N = 3SE +/- 0.67, N = 3SE +/- 0.48, N = 3SE +/- 0.81, N = 3SE +/- 0.56, N = 3SE +/- 1.38, N = 3SE +/- 0.51, N = 3SE +/- 0.17, N = 3SE +/- 0.81, N = 3SE +/- 0.95, N = 3SE +/- 1.03, N = 3129.66117.36135.8299.56125.33119.38113.07117.68134.41129.04122.93132.97128.61129.80120.31106.50134.15

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ42004006008001000SE +/- 18.73, N = 3SE +/- 51.76, N = 3SE +/- 6.96, N = 3SE +/- 8.46, N = 3SE +/- 24.36, N = 3SE +/- 15.66, N = 3SE +/- 26.17, N = 3SE +/- 6.88, N = 3SE +/- 3.16, N = 3SE +/- 9.00, N = 3SE +/- 46.58, N = 3SE +/- 14.96, N = 3SE +/- 15.40, N = 3SE +/- 15.84, N = 3SE +/- 16.60, N = 3SE +/- 28.81, N = 3SE +/- 9.36, N = 3710.82635.35698.00760.65657.54783.17788.25828.27590.62756.19817.73599.83776.37799.43822.71745.26795.83

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4400800120016002000SE +/- 22.03, N = 9SE +/- 11.17, N = 3SE +/- 14.14, N = 3SE +/- 1.70, N = 3SE +/- 1.79, N = 3SE +/- 0.52, N = 3SE +/- 7.01, N = 3SE +/- 0.70, N = 3SE +/- 1.58, N = 3SE +/- 3.80, N = 3SE +/- 0.85, N = 3SE +/- 0.52, N = 3SE +/- 3.37, N = 9SE +/- 13.01, N = 3SE +/- 0.54, N = 3SE +/- 7.01, N = 3SE +/- 2.01, N = 3592.88652.382034.17120.58221.98235.08627.13165.18436.90428.84154.47350.76336.961107.83230.74565.20842.181. (CC) gcc options: -lpopt -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ460120180240300SE +/- 2.41, N = 3SE +/- 3.08, N = 3SE +/- 2.30, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 1.59, N = 3SE +/- 0.86, N = 3SE +/- 0.15, N = 3SE +/- 0.61, N = 3SE +/- 0.69, N = 3SE +/- 1.41, N = 3SE +/- 0.60, N = 3SE +/- 0.45, N = 3SE +/- 0.04, N = 3SE +/- 1.24, N = 3SE +/- 1.61, N = 3268.21268.08250.6339.8548.5749.71242.9082.4397.1496.8579.9793.6791.02220.1271.92246.83222.891. (CC) gcc options: -lpopt -O2

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ410002000300040005000SE +/- 7.45, N = 3SE +/- 48.23, N = 3SE +/- 2.31, N = 3SE +/- 48.33, N = 8SE +/- 67.40, N = 4SE +/- 56.64, N = 3SE +/- 38.19, N = 15SE +/- 4.06, N = 3SE +/- 29.70, N = 3SE +/- 35.37, N = 15SE +/- 71.50, N = 3SE +/- 42.88, N = 3SE +/- 39.88, N = 3SE +/- 39.28, N = 15SE +/- 12.39, N = 3SE +/- 18.22, N = 3SE +/- 13.20, N = 323954448241945804682475246154893468348084593471047434547340446364432-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ45001000150020002500SE +/- 3.84, N = 3SE +/- 24.22, N = 3SE +/- 1.15, N = 3SE +/- 24.18, N = 8SE +/- 33.77, N = 4SE +/- 28.35, N = 3SE +/- 19.10, N = 15SE +/- 2.33, N = 3SE +/- 14.89, N = 3SE +/- 17.68, N = 15SE +/- 35.91, N = 3SE +/- 21.61, N = 3SE +/- 19.67, N = 3SE +/- 19.58, N = 15SE +/- 6.23, N = 3SE +/- 9.24, N = 3SE +/- 6.77, N = 311942220120622862338237223042443233824002293235123682270169823142212-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4160320480640800SE +/- 1.79, N = 15SE +/- 10.59, N = 3SE +/- 1.94, N = 15SE +/- 8.40, N = 6SE +/- 10.33, N = 3SE +/- 5.39, N = 15SE +/- 10.41, N = 4SE +/- 10.81, N = 3SE +/- 4.58, N = 3SE +/- 6.01, N = 3SE +/- 9.17, N = 3SE +/- 8.74, N = 3SE +/- 10.31, N = 15SE +/- 11.06, N = 3SE +/- 4.24, N = 7SE +/- 7.51, N = 3SE +/- 9.21, N = 3116690122700696698733745705752742690731694405719700-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ440K80K120K160K200KSE +/- 446.80, N = 17SE +/- 2728.45, N = 3SE +/- 500.81, N = 15SE +/- 2170.51, N = 6SE +/- 2645.75, N = 3SE +/- 1411.52, N = 15SE +/- 2657.54, N = 4SE +/- 2848.00, N = 3SE +/- 1201.85, N = 3SE +/- 1201.85, N = 3SE +/- 2185.81, N = 3SE +/- 2185.81, N = 3SE +/- 2590.95, N = 15SE +/- 2848.00, N = 3SE +/- 1125.22, N = 7SE +/- 2000.00, N = 3SE +/- 2081.67, N = 33006517666731327179333178000178800187750190667180667192333189667176667187133177667103743184000179000-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ48001600240032004000SE +/- 34.05, N = 3SE +/- 64.00, N = 15SE +/- 48.05, N = 15SE +/- 51.32, N = 3SE +/- 51.93, N = 3SE +/- 25.91, N = 3SE +/- 48.38, N = 15SE +/- 45.48, N = 15SE +/- 33.15, N = 10SE +/- 52.80, N = 4SE +/- 20.17, N = 3SE +/- 31.12, N = 15SE +/- 2.19, N = 3SE +/- 34.00, N = 8SE +/- 39.90, N = 15SE +/- 39.53, N = 15SE +/- 51.28, N = 1527553085314431463253303632803460355035563470348735423452310231813128-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4400800120016002000SE +/- 16.70, N = 3SE +/- 32.02, N = 15SE +/- 24.05, N = 15SE +/- 25.66, N = 3SE +/- 25.87, N = 3SE +/- 13.05, N = 3SE +/- 24.21, N = 15SE +/- 22.75, N = 15SE +/- 16.62, N = 10SE +/- 26.43, N = 4SE +/- 9.84, N = 3SE +/- 15.56, N = 15SE +/- 1.33, N = 3SE +/- 17.03, N = 8SE +/- 19.96, N = 15SE +/- 19.78, N = 15SE +/- 25.66, N = 1513741539156915701623151416371726177117751732174017681722154715871560-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4100200300400500SE +/- 3.19, N = 15SE +/- 4.58, N = 3SE +/- 4.20, N = 15SE +/- 4.49, N = 5SE +/- 2.75, N = 15SE +/- 4.36, N = 3SE +/- 3.48, N = 3SE +/- 6.01, N = 3SE +/- 5.41, N = 15SE +/- 3.61, N = 3SE +/- 5.93, N = 3SE +/- 3.61, N = 3SE +/- 5.70, N = 3SE +/- 4.58, N = 15SE +/- 5.32, N = 15SE +/- 4.93, N = 3SE +/- 4.98, N = 15313395367351347332417427388396449397416385367377355-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ420K40K60K80K100KSE +/- 791.42, N = 15SE +/- 1092.91, N = 3SE +/- 1052.26, N = 15SE +/- 1152.56, N = 5SE +/- 686.93, N = 15SE +/- 1135.78, N = 3SE +/- 881.92, N = 3SE +/- 1527.53, N = 3SE +/- 1399.47, N = 15SE +/- 1008.85, N = 3SE +/- 1527.53, N = 3SE +/- 913.48, N = 3SE +/- 1333.33, N = 3SE +/- 1154.16, N = 15SE +/- 1383.92, N = 15SE +/- 1216.55, N = 3SE +/- 1285.26, N = 1580067100833939208992088767850001063331090009929310153311500010163310633398513939009650090813-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ410002000300040005000SE +/- 2.08, N = 3SE +/- 42.67, N = 3SE +/- 4.84, N = 3SE +/- 59.02, N = 5SE +/- 19.81, N = 3SE +/- 40.81, N = 15SE +/- 51.16, N = 7SE +/- 44.31, N = 15SE +/- 53.34, N = 3SE +/- 5.24, N = 3SE +/- 44.77, N = 15SE +/- 43.14, N = 3SE +/- 27.18, N = 3SE +/- 57.37, N = 4SE +/- 15.89, N = 3SE +/- 41.13, N = 15SE +/- 56.46, N = 522924734232944934746471346654701467447714601460446394590239645584465-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ45001000150020002500SE +/- 1.20, N = 3SE +/- 21.17, N = 3SE +/- 2.33, N = 3SE +/- 29.48, N = 5SE +/- 9.91, N = 3SE +/- 20.40, N = 15SE +/- 25.56, N = 7SE +/- 22.18, N = 15SE +/- 26.77, N = 3SE +/- 22.37, N = 15SE +/- 21.40, N = 3SE +/- 13.68, N = 3SE +/- 28.73, N = 4SE +/- 20.60, N = 15SE +/- 28.33, N = 511432363116122432370235323292347233323822297229923162291119422752229-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ42004006008001000SE +/- 6.51, N = 3SE +/- 4.91, N = 3SE +/- 5.90, N = 3SE +/- 10.54, N = 3SE +/- 11.02, N = 3SE +/- 8.89, N = 8SE +/- 3.93, N = 3SE +/- 9.60, N = 8SE +/- 8.39, N = 10SE +/- 10.48, N = 3SE +/- 7.37, N = 3SE +/- 3.51, N = 3SE +/- 8.08, N = 15SE +/- 10.91, N = 3SE +/- 7.94, N = 3SE +/- 7.83, N = 15SE +/- 4.67, N = 3734889741891882897931910901891939909905908730878880-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ450K100K150K200K250KSE +/- 1527.53, N = 3SE +/- 1201.85, N = 3SE +/- 1333.33, N = 3SE +/- 2516.61, N = 3SE +/- 2848.00, N = 3SE +/- 2275.16, N = 8SE +/- 881.92, N = 3SE +/- 2488.81, N = 8SE +/- 2130.21, N = 10SE +/- 2905.93, N = 3SE +/- 1763.83, N = 3SE +/- 881.92, N = 3SE +/- 2088.97, N = 15SE +/- 2728.45, N = 3SE +/- 2081.67, N = 3SE +/- 1990.93, N = 15SE +/- 1201.85, N = 3188000227667189667228000225667229625238333232875230600228333240333232667231800232333187000224800225333-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ48001600240032004000SE +/- 17.57, N = 3SE +/- 31.25, N = 3SE +/- 36.44, N = 12SE +/- 45.04, N = 3SE +/- 30.88, N = 3SE +/- 33.87, N = 3SE +/- 50.30, N = 3SE +/- 34.72, N = 3SE +/- 32.55, N = 15SE +/- 42.61, N = 3SE +/- 34.43, N = 12SE +/- 19.00, N = 3SE +/- 22.41, N = 3SE +/- 17.38, N = 3SE +/- 8.19, N = 3SE +/- 36.95, N = 15SE +/- 28.45, N = 327792878312431423365310534353496348734143523326535243418295231083296-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4400800120016002000SE +/- 8.74, N = 3SE +/- 15.62, N = 3SE +/- 18.23, N = 12SE +/- 22.59, N = 3SE +/- 15.28, N = 3SE +/- 16.90, N = 3SE +/- 25.15, N = 3SE +/- 17.65, N = 3SE +/- 21.15, N = 3SE +/- 17.23, N = 12SE +/- 9.67, N = 3SE +/- 11.36, N = 3SE +/- 8.74, N = 3SE +/- 4.10, N = 3SE +/- 18.49, N = 15SE +/- 14.22, N = 313861436155915671679154917131744174017031758162917581705147315501644-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4110220330440550SE +/- 2.67, N = 3SE +/- 4.52, N = 15SE +/- 5.44, N = 5SE +/- 5.84, N = 3SE +/- 3.22, N = 15SE +/- 5.59, N = 5SE +/- 5.19, N = 7SE +/- 4.84, N = 8SE +/- 5.29, N = 7SE +/- 4.63, N = 3SE +/- 4.73, N = 3SE +/- 1.53, N = 3SE +/- 4.06, N = 3SE +/- 3.53, N = 3SE +/- 4.29, N = 15SE +/- 5.46, N = 5SE +/- 5.13, N = 3432433431441425428493487473470515488494478415416454-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectorySAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ430K60K90K120K150KSE +/- 666.67, N = 3SE +/- 1116.40, N = 15SE +/- 1462.87, N = 5SE +/- 1527.53, N = 3SE +/- 854.49, N = 15SE +/- 1435.27, N = 5SE +/- 1340.12, N = 7SE +/- 1250.00, N = 8SE +/- 1404.56, N = 7SE +/- 1154.70, N = 3SE +/- 1201.85, N = 3SE +/- 577.35, N = 3SE +/- 881.92, N = 3SE +/- 881.92, N = 3SE +/- 1096.31, N = 15SE +/- 1503.33, N = 5SE +/- 1527.53, N = 3110667110867110200113000108667109600126286124750121143120000131667125000126667122667106200106600116000-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto-lnuma -lz -libverbs -lrdmacm -lrados -lrbd -lcurl -lssl -lcrypto1. (CC) gcc options: -rdynamic -lrt -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ480160240320400SE +/- 2.58, N = 3SE +/- 2.45, N = 13SE +/- 4.94, N = 3SE +/- 0.23, N = 3SE +/- 0.44, N = 3SE +/- 0.26, N = 3SE +/- 2.32, N = 3SE +/- 0.37, N = 3SE +/- 0.61, N = 3SE +/- 0.58, N = 3SE +/- 0.32, N = 4SE +/- 0.60, N = 3SE +/- 0.43, N = 3SE +/- 4.74, N = 3SE +/- 0.06, N = 3SE +/- 3.27, N = 3SE +/- 1.68, N = 3295.3297.0298.223.229.529.6305.325.240.140.323.939.338.1294.132.5338.8364.61. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4170340510680850SE +/- 6.85, N = 15SE +/- 0.35, N = 3SE +/- 2.00, N = 3SE +/- 0.22, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 4.41, N = 15SE +/- 0.13, N = 3SE +/- 0.81, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.66, N = 4SE +/- 3.90, N = 3SE +/- 0.27, N = 3SE +/- 1.52, N = 3SE +/- 0.39, N = 3406.8174.5752.533.347.647.8251.929.352.151.627.947.547.5567.049.4173.0767.51. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ480160240320400SE +/- 5.34, N = 3SE +/- 10.08, N = 15SE +/- 1.87, N = 3SE +/- 0.00, N = 3SE +/- 0.15, N = 3SE +/- 0.52, N = 3SE +/- 7.18, N = 15SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.56, N = 3SE +/- 0.07, N = 3SE +/- 11.64, N = 15SE +/- 5.48, N = 3324.0262.4292.022.130.530.2271.125.139.338.824.438.037.8288.332.5262.0365.51. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ430060090012001500SE +/- 9.59, N = 4SE +/- 8.83, N = 4SE +/- 7.05, N = 15SE +/- 12.54, N = 5SE +/- 2.55, N = 3SE +/- 11.63, N = 6SE +/- 3.97, N = 3SE +/- 9.88, N = 3SE +/- 4.72, N = 3SE +/- 3.50, N = 3SE +/- 10.09, N = 15SE +/- 12.20, N = 3SE +/- 12.70, N = 3SE +/- 6.53, N = 3SE +/- 8.92, N = 4SE +/- 9.29, N = 15SE +/- 14.27, N = 6662.1626.8668.0960.4995.3984.4955.2957.2958.2957.9991.81011.3967.3938.1614.9927.61230.21. (CC) gcc options: -static

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ45001000150020002500SE +/- 10.39, N = 3SE +/- 23.46, N = 3SE +/- 34.52, N = 11SE +/- 13.96, N = 7SE +/- 7.00, N = 3SE +/- 12.29, N = 12SE +/- 7.67, N = 3SE +/- 12.58, N = 3SE +/- 68.68, N = 10SE +/- 60.67, N = 9SE +/- 17.88, N = 9SE +/- 38.20, N = 12SE +/- 53.66, N = 9SE +/- 26.72, N = 11SE +/- 18.19, N = 3SE +/- 15.25, N = 3SE +/- 26.12, N = 12211819691858130616191323244211011353115410121317116412581984209522051. (CC) gcc options: -O3

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Timed SQLite InsertionsSAS 10x300GB RAID10-zil-cacheSAS 4x1TB RAID10-zil ZSTDSAS 4x1TB RAID10-zil ZSTD(2)SAS 6x76G RAID1SAS 6x76G RAID1 GZIPSAS 6x76G RAID1 LZ4SSD 2x1TB RAID0 zilSSD 2x1TB RAID1SSD 2x1TB RAID1 GZIPSSD 2x1TB RAID1 LZ4SSD 2x1TB RAID1 ashift=13SSD 2x1TB RAID1 ashift=13 GZIPSSD 2x1TB RAID1 ashift=13 LZ4SSD 2x1TB RAID1-zil LZ4SSD 4x1TB RAID10 ZSTDSSD 4x1TB RAID10-zilSSD 4x1TB RAID10-zil LZ4306090120150SE +/- 0.09, N = 3SE +/- 0.34, N = 15SE +/- 0.31, N = 12SE +/- 0.83, N = 3SE +/- 0.68, N = 3SE +/- 0.30, N = 3SE +/- 0.50, N = 12SE +/- 0.45, N = 3SE +/- 0.59, N = 3SE +/- 4.16, N = 12SE +/- 2.90, N = 15SE +/- 0.20, N = 3SE +/- 0.53, N = 3SE +/- 0.34, N = 15SE +/- 0.95, N = 15SE +/- 0.30, N = 15SE +/- 0.35, N = 1514.8015.6915.94139.46138.38138.4616.6833.5435.0355.3948.1445.0744.0817.2530.7215.8615.91-lz1. (CC) gcc options: -O2 -lm -ldl -lpthread

Phoronix Test Suite v10.8.4