drbd perf

Oracle VMware testing on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2102256-HA-DRBDPERF942&sro.

drbd perfProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layerxfsext4zfszfs on drbdxfs on drbdext4 on drbdAMD Ryzen 5 3600XT 6-Core (4 Cores)Oracle VirtualBox v1.2Intel 440FX 82441FX PMC2048MB21GB VBOX HDD + 3 x 54GB VBOX HDDVMware SVGA IIIntel 82801AA AC 97 AudioIntel 82540EMUbuntu 20.045.4.0-66-generic (x86_64)GCC 9.3.0xfs2048x2048Oracle VMwareext421GB VBOX HDD + 4 x 54GB VBOX HDDzfsxfsext4OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- xfs: MQ-DEADLINE / relatime,rw / Block Size: 4096- ext4: MQ-DEADLINE / relatime,rw / Block Size: 4096- zfs: MQ-DEADLINE / relatime,rw / Block Size: 131072- zfs on drbd: MQ-DEADLINE / relatime,rw / Block Size: 131072- xfs on drbd: MQ-DEADLINE / relatime,rw / Block Size: 4096- ext4 on drbd: MQ-DEADLINE / relatime,rw / Block Size: 4096Processor Details- CPU Microcode: 0x6000626Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

drbd perffs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - Yes - No - 128KB - Default Test Directoryxfsext4zfszfs on drbdxfs on drbdext4 on drbd402.01845.243.11090032583247734586894075181514387667103326433316611330010948750351.81710.143.811200301770677546031974778415283910009022310001684134676625289270.51040.2104.72678827.5703112731020034827781113284750168431332187174754263405104.3526.91032633312.0713099128610300116.19261072274533108.7276332357188671411119114.9315.241.91073398.22506766853431601274153439300020251725168713500212169398.3278.941.71063310.627147025615176.714111429365667194495331488118751961561OpenBenchmarking.org

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizeext4ext4 on drbdxfsxfs on drbdzfszfs on drbd90180270360450SE +/- 2.87, N = 3SE +/- 1.05, N = 3SE +/- 3.18, N = 15SE +/- 1.24, N = 15SE +/- 5.25, N = 12SE +/- 0.85, N = 15351.898.3402.0114.9270.5104.31. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncext4ext4 on drbdxfsxfs on drbdzfszfs on drbd400800120016002000SE +/- 41.49, N = 12SE +/- 4.54, N = 12SE +/- 31.43, N = 12SE +/- 5.39, N = 12SE +/- 21.70, N = 15SE +/- 22.14, N = 151710.1278.91845.2315.21040.2526.91. (CC) gcc options: -static

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd20406080100SE +/- 0.44, N = 3SE +/- 0.55, N = 3SE +/- 0.43, N = 6SE +/- 0.44, N = 3SE +/- 0.91, N = 843.841.743.141.9104.7103.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd6K12K18K24K30KSE +/- 100.00, N = 3SE +/- 145.30, N = 3SE +/- 203.31, N = 6SE +/- 120.19, N = 3SE +/- 242.34, N = 8SE +/- 260.34, N = 31120010633109001073326788263331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd70140210280350SE +/- 1.00, N = 3SE +/- 0.11, N = 15SE +/- 2.22, N = 15SE +/- 1.99, N = 15SE +/- 0.32, N = 4SE +/- 0.33, N = 12301.0010.60325.0098.2027.5012.071. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd20K40K60K80K100KSE +/- 272.85, N = 3SE +/- 28.41, N = 15SE +/- 556.08, N = 15SE +/- 515.63, N = 15SE +/- 81.12, N = 4SE +/- 88.61, N = 127706727148324725067703130991. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd30060090012001500SE +/- 4.97, N = 15SE +/- 8.25, N = 15SE +/- 5.90, N = 15SE +/- 4.37, N = 3SE +/- 9.96, N = 3SE +/- 15.52, N = 3754702734668127312861. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd2K4K6K8K10KSE +/- 39.93, N = 15SE +/- 65.72, N = 15SE +/- 47.33, N = 15SE +/- 36.17, N = 3SE +/- 57.74, N = 3SE +/- 100.00, N = 3603156155868534310200103001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd2004006008001000SE +/- 2.91, N = 3SE +/- 7.78, N = 12SE +/- 24.40, N = 15SE +/- 5.59, N = 14SE +/- 12.06, N = 12SE +/- 8.38, N = 12974.0176.7940.0160.0348.0116.11. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd2K4K6K8K10KSE +/- 22.41, N = 3SE +/- 62.35, N = 12SE +/- 195.13, N = 15SE +/- 44.50, N = 14SE +/- 96.39, N = 12SE +/- 66.83, N = 12778414117518127427789261. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd30060090012001500SE +/- 8.33, N = 3SE +/- 17.90, N = 3SE +/- 11.55, N = 3SE +/- 10.40, N = 3SE +/- 13.07, N = 4SE +/- 7.21, N = 151528142915141534111310721. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd80K160K240K320K400KSE +/- 2081.67, N = 3SE +/- 4702.25, N = 3SE +/- 3179.80, N = 3SE +/- 2516.61, N = 3SE +/- 3326.03, N = 4SE +/- 1840.98, N = 153910003656673876673930002847502745331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd2004006008001000SE +/- 11.52, N = 13SE +/- 1.45, N = 3SE +/- 10.90, N = 3SE +/- 7.34, N = 12SE +/- 0.33, N = 3SE +/- 4.15, N = 12902.0194.01033.0202.0168.0108.71. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd60K120K180K240K300KSE +/- 2895.62, N = 13SE +/- 375.65, N = 3SE +/- 2962.73, N = 3SE +/- 1875.24, N = 12SE +/- 33.33, N = 3SE +/- 1062.54, N = 12231000495332643335172543133276331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd5001000150020002500SE +/- 5.51, N = 3SE +/- 16.07, N = 4SE +/- 16.22, N = 3SE +/- 13.98, N = 3SE +/- 102.75, N = 12SE +/- 20.04, N = 31684148816611687218723571. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd4K8K12K16K20KSE +/- 33.33, N = 3SE +/- 143.61, N = 4SE +/- 115.47, N = 3SE +/- 100.00, N = 3SE +/- 822.26, N = 12SE +/- 145.30, N = 31346711875133001350017475188671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd2004006008001000SE +/- 51.59, N = 12SE +/- 5.90, N = 3SE +/- 2.33, N = 3SE +/- 14.81, N = 15SE +/- 2.39, N = 1566219610942124261411. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directoryext4ext4 on drbdxfsxfs on drbdzfszfs on drbd2K4K6K8K10KSE +/- 412.45, N = 12SE +/- 6.17, N = 3SE +/- 46.49, N = 3SE +/- 18.67, N = 3SE +/- 118.45, N = 15SE +/- 18.91, N = 155289156187501693340511191. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Phoronix Test Suite v10.8.4