drbd overhead

Oracle VMware testing on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2102266-HA-DRBDOVERH13&sro&gru.

drbd overheadProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layer2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfsAMD Ryzen 5 3600XT 6-Core (2 Cores)Oracle VirtualBox v1.2Intel 440FX 82441FX PMC729MB21GB VBOX HDD + 2 x 11GB VBOX HDDVMware SVGA IIIntel 82801AA AC 97 AudioIntel 82540EMUbuntu 20.045.4.0-66-generic (x86_64)GCC 9.3.0xfs2048x2048Oracle VMwareAMD Ryzen 5 3600XT 6-Core (4 Cores)728MBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- MQ-DEADLINE / relatime,rw / Block Size: 4096Processor Details- CPU Microcode: 0x6000626Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

drbd overheadsysbench: Memorysysbench: CPUfs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs4684365.56171770.232779.7144.692359547468193035.837.3586116.64500949.66311789.0697381.11114.09381267674754454336.71055945695571462.28972734.844995.2133.5977510495504585338.241.36311075185705.67912762.0951386.81467.69704303585265604637.9118.96597565416008.17104147.820698.3150.71033311867501296840.046.46271215352567.52574202.2833387.71568.110467339005260677240.91336588475334350.07694224.0307398.01382.811075374925519711243.31466918897993172.47038379.4702388.81483.210600339925450746141.21336829338149845.28718309.3583378.71487.310900303135533788742.6119.0692986OpenBenchmarking.org

Sysbench

Test: Memory

OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: Memory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2M4M6M8M10MSE +/- 59805.54, N = 15SE +/- 18712.23, N = 3SE +/- 62488.89, N = 3SE +/- 226749.04, N = 12SE +/- 246434.83, N = 15SE +/- 187210.72, N = 15SE +/- 165423.75, N = 15SE +/- 9483.96, N = 3SE +/- 30257.04, N = 35416008.175334350.085352567.534684365.564500949.665571462.295185705.687993172.478149845.291. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=amdfam10 -rdynamic -ldl -laio -lm

Sysbench

Test: CPU

OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: CPU2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2K4K6K8K10KSE +/- 7.61, N = 3SE +/- 2.65, N = 3SE +/- 4.56, N = 3SE +/- 15.38, N = 3SE +/- 2.05, N = 3SE +/- 21.08, N = 3SE +/- 13.35, N = 3SE +/- 10.07, N = 3SE +/- 4.97, N = 34147.824224.034202.281770.231789.072734.842762.108379.478309.361. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=amdfam10 -rdynamic -ldl -laio -lm

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs90180270360450SE +/- 1.03, N = 15SE +/- 4.44, N = 3SE +/- 3.16, N = 9SE +/- 1.56, N = 15SE +/- 3.17, N = 15SE +/- 0.96, N = 3SE +/- 4.26, N = 15SE +/- 5.30, N = 3SE +/- 3.97, N = 498.3398.0387.779.7381.195.2386.8388.8378.71. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSync2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs30060090012001500SE +/- 0.65, N = 3SE +/- 34.63, N = 15SE +/- 19.73, N = 14SE +/- 1.35, N = 15SE +/- 28.52, N = 15SE +/- 0.33, N = 3SE +/- 25.36, N = 15SE +/- 55.31, N = 15SE +/- 34.21, N = 15150.71382.81568.1144.61114.0133.51467.61483.21487.31. (CC) gcc options: -static

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2K4K6K8K10KSE +/- 88.19, N = 3SE +/- 125.00, N = 4SE +/- 133.33, N = 3SE +/- 63.20, N = 3SE +/- 18.26, N = 3SE +/- 80.96, N = 9SE +/- 17.37, N = 3SE +/- 89.97, N = 7103331107510467923593819775970410600109001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs8K16K24K32K40KSE +/- 33.33, N = 3SE +/- 1119.49, N = 12SE +/- 1214.24, N = 15SE +/- 546.57, N = 15SE +/- 33.33, N = 3SE +/- 495.11, N = 12SE +/- 1289.44, N = 12SE +/- 598.92, N = 12SE +/- 1633.89, N = 15118673749233900954726767104953035833992303131. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs12002400360048006000SE +/- 32.84, N = 3SE +/- 62.22, N = 3SE +/- 39.49, N = 3SE +/- 19.37, N = 3SE +/- 47.66, N = 3SE +/- 47.16, N = 3SE +/- 50.64, N = 3SE +/- 37.47, N = 3SE +/- 25.51, N = 35012551952604681475450455265545055331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2K4K6K8K10KSE +/- 11.40, N = 15SE +/- 71.42, N = 3SE +/- 203.38, N = 12SE +/- 32.32, N = 13SE +/- 53.43, N = 15SE +/- 11.61, N = 3SE +/- 53.11, N = 3SE +/- 42.67, N = 3SE +/- 64.67, N = 159687112677293045438536046746178871. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs1020304050SE +/- 0.12, N = 3SE +/- 0.45, N = 4SE +/- 0.48, N = 3SE +/- 0.46, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 9SE +/- 0.09, N = 3SE +/- 0.39, N = 7SE +/- 0.03, N = 340.043.340.935.836.738.237.941.242.61. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs306090120150SE +/- 0.09, N = 3SE +/- 4.38, N = 12SE +/- 4.66, N = 15SE +/- 2.13, N = 15SE +/- 1.98, N = 12SE +/- 4.95, N = 12SE +/- 2.34, N = 12SE +/- 6.47, N = 1546.4146.0133.037.3105.041.3118.9133.0119.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs150300450600750SE +/- 4.04, N = 3SE +/- 7.69, N = 3SE +/- 5.03, N = 3SE +/- 2.33, N = 3SE +/- 6.01, N = 3SE +/- 5.93, N = 3SE +/- 6.36, N = 3SE +/- 4.63, N = 3SE +/- 3.00, N = 36276916585865946316596826921. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-100-768m_drbd.xfs2c-100-768m_drbd.xfs_broken-sync2c-100-768m_sd.xfs2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2004006008001000SE +/- 1.43, N = 15SE +/- 8.84, N = 3SE +/- 25.39, N = 12SE +/- 4.05, N = 13SE +/- 6.68, N = 15SE +/- 1.53, N = 3SE +/- 6.81, N = 3SE +/- 5.51, N = 3SE +/- 8.10, N = 15121.0889.0847.0116.6569.0107.0756.0933.0986.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Phoronix Test Suite v10.8.4