drbd perf

Oracle VMware testing on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2102256-HA-DRBDPERF942&grs&sor.

drbd perfProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layerxfsext4zfszfs on drbdxfs on drbdext4 on drbdAMD Ryzen 5 3600XT 6-Core (4 Cores)Oracle VirtualBox v1.2Intel 440FX 82441FX PMC2048MB21GB VBOX HDD + 3 x 54GB VBOX HDDVMware SVGA IIIntel 82801AA AC 97 AudioIntel 82540EMUbuntu 20.045.4.0-66-generic (x86_64)GCC 9.3.0xfs2048x2048Oracle VMwareext421GB VBOX HDD + 4 x 54GB VBOX HDDzfsxfsext4OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- xfs: MQ-DEADLINE / relatime,rw / Block Size: 4096- ext4: MQ-DEADLINE / relatime,rw / Block Size: 4096- zfs: MQ-DEADLINE / relatime,rw / Block Size: 131072- zfs on drbd: MQ-DEADLINE / relatime,rw / Block Size: 131072- xfs on drbd: MQ-DEADLINE / relatime,rw / Block Size: 4096- ext4 on drbd: MQ-DEADLINE / relatime,rw / Block Size: 4096Processor Details- CPU Microcode: 0x6000626Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

drbd perffio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfs-mark: 1000 Files, 1MB Size, No Sync/FSyncxfsext4zfszfs on drbdxfs on drbdext4 on drbd2643331033402.0832473251090043.1586873413300166138766715148750109475189401845.2231000902351.8770673011120043.860317541346716843910001528528966277849741710.143133168270.5703127.526788104.71020012731747521872847501113340542627783481040.227633108.7104.3309912.0712633310310300128618867235727453310721119141926116.1526.951725202114.92506798.21073341.95343668135001687393000153416932121274160315.24953319498.3271410.61063341.75615702118751488365667142915611961411176.7278.9OpenBenchmarking.org

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4xfs on drbdext4 on drbdzfszfs on drbd60K120K180K240K300KSE +/- 2962.73, N = 3SE +/- 2895.62, N = 13SE +/- 1875.24, N = 12SE +/- 375.65, N = 3SE +/- 33.33, N = 3SE +/- 1062.54, N = 12264333231000517254953343133276331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4xfs on drbdext4 on drbdzfszfs on drbd2004006008001000SE +/- 10.90, N = 3SE +/- 11.52, N = 13SE +/- 7.34, N = 12SE +/- 1.45, N = 3SE +/- 0.33, N = 3SE +/- 4.15, N = 121033.0902.0202.0194.0168.0108.71. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizexfsext4zfsxfs on drbdzfs on drbdext4 on drbd90180270360450SE +/- 3.18, N = 15SE +/- 2.87, N = 3SE +/- 5.25, N = 12SE +/- 1.24, N = 15SE +/- 0.85, N = 15SE +/- 1.05, N = 3402.0351.8270.5114.9104.398.31. (CC) gcc options: -static

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4xfs on drbdzfszfs on drbdext4 on drbd20K40K60K80K100KSE +/- 556.08, N = 15SE +/- 272.85, N = 3SE +/- 515.63, N = 15SE +/- 81.12, N = 4SE +/- 88.61, N = 12SE +/- 28.41, N = 158324777067250677031309927141. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4xfs on drbdzfszfs on drbdext4 on drbd70140210280350SE +/- 2.22, N = 15SE +/- 1.00, N = 3SE +/- 1.99, N = 15SE +/- 0.32, N = 4SE +/- 0.33, N = 12SE +/- 0.11, N = 15325.00301.0098.2027.5012.0710.601. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfszfs on drbdext4xfsxfs on drbdext4 on drbd6K12K18K24K30KSE +/- 242.34, N = 8SE +/- 260.34, N = 3SE +/- 100.00, N = 3SE +/- 203.31, N = 6SE +/- 120.19, N = 3SE +/- 145.30, N = 32678826333112001090010733106331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryzfszfs on drbdext4xfsxfs on drbdext4 on drbd20406080100SE +/- 0.91, N = 8SE +/- 0.44, N = 3SE +/- 0.43, N = 6SE +/- 0.44, N = 3SE +/- 0.55, N = 3104.7103.043.843.141.941.71. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryzfs on drbdzfsext4xfsext4 on drbdxfs on drbd2K4K6K8K10KSE +/- 100.00, N = 3SE +/- 57.74, N = 3SE +/- 39.93, N = 15SE +/- 47.33, N = 15SE +/- 65.72, N = 15SE +/- 36.17, N = 3103001020060315868561553431. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryzfs on drbdzfsext4xfsext4 on drbdxfs on drbd30060090012001500SE +/- 15.52, N = 3SE +/- 9.96, N = 3SE +/- 4.97, N = 15SE +/- 5.90, N = 15SE +/- 8.25, N = 15SE +/- 4.37, N = 3128612737547347026681. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryzfs on drbdzfsxfs on drbdext4xfsext4 on drbd4K8K12K16K20KSE +/- 145.30, N = 3SE +/- 822.26, N = 12SE +/- 100.00, N = 3SE +/- 33.33, N = 3SE +/- 115.47, N = 3SE +/- 143.61, N = 41886717475135001346713300118751. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryzfs on drbdzfsxfs on drbdext4xfsext4 on drbd5001000150020002500SE +/- 20.04, N = 3SE +/- 102.75, N = 12SE +/- 13.98, N = 3SE +/- 5.51, N = 3SE +/- 16.22, N = 3SE +/- 16.07, N = 42357218716871684166114881. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs on drbdext4xfsext4 on drbdzfszfs on drbd80K160K240K320K400KSE +/- 2516.61, N = 3SE +/- 2081.67, N = 3SE +/- 3179.80, N = 3SE +/- 4702.25, N = 3SE +/- 3326.03, N = 4SE +/- 1840.98, N = 153930003910003876673656672847502745331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfs on drbdext4xfsext4 on drbdzfszfs on drbd30060090012001500SE +/- 10.40, N = 3SE +/- 8.33, N = 3SE +/- 11.55, N = 3SE +/- 17.90, N = 3SE +/- 13.07, N = 4SE +/- 7.21, N = 151534152815141429111310721. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfsxfs on drbdext4 on drbdzfs on drbd2K4K6K8K10KSE +/- 46.49, N = 3SE +/- 412.45, N = 12SE +/- 118.45, N = 15SE +/- 18.67, N = 3SE +/- 6.17, N = 3SE +/- 18.91, N = 158750528934051693156111191. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfsxfs on drbdext4 on drbdzfs on drbd2004006008001000SE +/- 5.90, N = 3SE +/- 51.59, N = 12SE +/- 14.81, N = 15SE +/- 2.33, N = 3SE +/- 2.39, N = 1510946624262121961411. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4xfszfsext4 on drbdxfs on drbdzfs on drbd2K4K6K8K10KSE +/- 22.41, N = 3SE +/- 195.13, N = 15SE +/- 96.39, N = 12SE +/- 62.35, N = 12SE +/- 44.50, N = 14SE +/- 66.83, N = 12778475182778141112749261. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4xfszfsext4 on drbdxfs on drbdzfs on drbd2004006008001000SE +/- 2.91, N = 3SE +/- 24.40, N = 15SE +/- 12.06, N = 12SE +/- 7.78, N = 12SE +/- 5.59, N = 14SE +/- 8.38, N = 12974.0940.0348.0176.7160.0116.11. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncxfsext4zfszfs on drbdxfs on drbdext4 on drbd400800120016002000SE +/- 31.43, N = 12SE +/- 41.49, N = 12SE +/- 21.70, N = 15SE +/- 22.14, N = 15SE +/- 5.39, N = 12SE +/- 4.54, N = 121845.21710.11040.2526.9315.2278.91. (CC) gcc options: -static

Phoronix Test Suite v10.8.4