drbd perf

Oracle VMware testing on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2102256-HA-DRBDPERF942&gru.

drbd perfProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layerxfsext4zfszfs on drbdxfs on drbdext4 on drbdAMD Ryzen 5 3600XT 6-Core (4 Cores)Oracle VirtualBox v1.2Intel 440FX 82441FX PMC2048MB21GB VBOX HDD + 3 x 54GB VBOX HDDVMware SVGA IIIntel 82801AA AC 97 AudioIntel 82540EMUbuntu 20.045.4.0-66-generic (x86_64)GCC 9.3.0xfs2048x2048Oracle VMwareext421GB VBOX HDD + 4 x 54GB VBOX HDDzfsxfsext4OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- xfs: MQ-DEADLINE / relatime,rw / Block Size: 4096- ext4: MQ-DEADLINE / relatime,rw / Block Size: 4096- zfs: MQ-DEADLINE / relatime,rw / Block Size: 131072- zfs on drbd: MQ-DEADLINE / relatime,rw / Block Size: 131072- xfs on drbd: MQ-DEADLINE / relatime,rw / Block Size: 4096- ext4 on drbd: MQ-DEADLINE / relatime,rw / Block Size: 4096Processor Details- CPU Microcode: 0x6000626Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

drbd perffs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 128KB - Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd402.01845.210900832475868751838766726433313300875043.13257349401514103316611094351.81710.111200770676031778439100023100013467528943.830175497415289021684662270.51040.226788703110200277828475043133174753405104.727.5127334811131682187426104.3526.9263333099103009262745332763318867111910312.0711286116.11072108.72357141114.9315.21073325067534312743930005172513500169341.998.26681601534202168721298.3278.9106332714561514113656674953311875156141.710.6702176.714291941488196OpenBenchmarking.org

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizexfsext4zfszfs on drbdxfs on drbdext4 on drbd90180270360450SE +/- 3.18, N = 15SE +/- 2.87, N = 3SE +/- 5.25, N = 12SE +/- 0.85, N = 15SE +/- 1.24, N = 15SE +/- 1.05, N = 3402.0351.8270.5104.3114.998.31. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncxfsext4zfszfs on drbdxfs on drbdext4 on drbd400800120016002000SE +/- 31.43, N = 12SE +/- 41.49, N = 12SE +/- 21.70, N = 15SE +/- 22.14, N = 15SE +/- 5.39, N = 12SE +/- 4.54, N = 121845.21710.11040.2526.9315.2278.91. (CC) gcc options: -static

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd6K12K18K24K30KSE +/- 203.31, N = 6SE +/- 100.00, N = 3SE +/- 242.34, N = 8SE +/- 260.34, N = 3SE +/- 120.19, N = 3SE +/- 145.30, N = 31090011200267882633310733106331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd20K40K60K80K100KSE +/- 556.08, N = 15SE +/- 272.85, N = 3SE +/- 81.12, N = 4SE +/- 88.61, N = 12SE +/- 515.63, N = 15SE +/- 28.41, N = 158324777067703130992506727141. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd2K4K6K8K10KSE +/- 47.33, N = 15SE +/- 39.93, N = 15SE +/- 57.74, N = 3SE +/- 100.00, N = 3SE +/- 36.17, N = 3SE +/- 65.72, N = 15586860311020010300534356151. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd2K4K6K8K10KSE +/- 195.13, N = 15SE +/- 22.41, N = 3SE +/- 96.39, N = 12SE +/- 66.83, N = 12SE +/- 44.50, N = 14SE +/- 62.35, N = 12751877842778926127414111. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd80K160K240K320K400KSE +/- 3179.80, N = 3SE +/- 2081.67, N = 3SE +/- 3326.03, N = 4SE +/- 1840.98, N = 15SE +/- 2516.61, N = 3SE +/- 4702.25, N = 33876673910002847502745333930003656671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd60K120K180K240K300KSE +/- 2962.73, N = 3SE +/- 2895.62, N = 13SE +/- 33.33, N = 3SE +/- 1062.54, N = 12SE +/- 1875.24, N = 12SE +/- 375.65, N = 3264333231000431332763351725495331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd4K8K12K16K20KSE +/- 115.47, N = 3SE +/- 33.33, N = 3SE +/- 822.26, N = 12SE +/- 145.30, N = 3SE +/- 100.00, N = 3SE +/- 143.61, N = 41330013467174751886713500118751. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd2K4K6K8K10KSE +/- 46.49, N = 3SE +/- 412.45, N = 12SE +/- 118.45, N = 15SE +/- 18.91, N = 15SE +/- 18.67, N = 3SE +/- 6.17, N = 38750528934051119169315611. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd20406080100SE +/- 0.43, N = 6SE +/- 0.44, N = 3SE +/- 0.91, N = 8SE +/- 0.44, N = 3SE +/- 0.55, N = 343.143.8104.7103.041.941.71. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd70140210280350SE +/- 2.22, N = 15SE +/- 1.00, N = 3SE +/- 0.32, N = 4SE +/- 0.33, N = 12SE +/- 1.99, N = 15SE +/- 0.11, N = 15325.00301.0027.5012.0798.2010.601. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd30060090012001500SE +/- 5.90, N = 15SE +/- 4.97, N = 15SE +/- 9.96, N = 3SE +/- 15.52, N = 3SE +/- 4.37, N = 3SE +/- 8.25, N = 15734754127312866687021. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd2004006008001000SE +/- 24.40, N = 15SE +/- 2.91, N = 3SE +/- 12.06, N = 12SE +/- 8.38, N = 12SE +/- 5.59, N = 14SE +/- 7.78, N = 12940.0974.0348.0116.1160.0176.71. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd30060090012001500SE +/- 11.55, N = 3SE +/- 8.33, N = 3SE +/- 13.07, N = 4SE +/- 7.21, N = 15SE +/- 10.40, N = 3SE +/- 17.90, N = 31514152811131072153414291. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd2004006008001000SE +/- 10.90, N = 3SE +/- 11.52, N = 13SE +/- 0.33, N = 3SE +/- 4.15, N = 12SE +/- 7.34, N = 12SE +/- 1.45, N = 31033.0902.0168.0108.7202.0194.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd5001000150020002500SE +/- 16.22, N = 3SE +/- 5.51, N = 3SE +/- 102.75, N = 12SE +/- 20.04, N = 3SE +/- 13.98, N = 3SE +/- 16.07, N = 41661168421872357168714881. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd2004006008001000SE +/- 5.90, N = 3SE +/- 51.59, N = 12SE +/- 14.81, N = 15SE +/- 2.39, N = 15SE +/- 2.33, N = 310946624261412121961. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Phoronix Test Suite v10.8.4