drbd overhead

Oracle VMware testing on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2102266-HA-DRBDOVERH13&grr.

drbd overheadProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layer2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfsAMD Ryzen 5 3600XT 6-Core (2 Cores)Oracle VirtualBox v1.2Intel 440FX 82441FX PMC729MB21GB VBOX HDD + 2 x 11GB VBOX HDDVMware SVGA IIIntel 82801AA AC 97 AudioIntel 82540EMUbuntu 20.045.4.0-66-generic (x86_64)GCC 9.3.0xfs2048x2048Oracle VMwareAMD Ryzen 5 3600XT 6-Core (4 Cores)728MBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- MQ-DEADLINE / relatime,rw / Block Size: 4096Processor Details- CPU Microcode: 0x6000626Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

drbd overheadfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 128KB - Default Test Directorysysbench: Memoryfs-mark: 1000 Files, 1MB Sizesysbench: CPUfs-mark: 1000 Files, 1MB Size, No Sync/FSync2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs954737.3930116.6923535.846815864684365.561779.71770.2327144.6267671054543569938136.747545944500949.6631381.11789.06971114.01049541.3853107977538.250456315571462.289795.22734.8449133.530358118.96046756970437.952656595185705.6791386.82762.09511467.61186746.49681211033340.050126275416008.171098.34147.8206150.73390013367728471046740.952606585352567.5257387.74202.28331568.13749214671128891107543.355196915334350.0769398.04224.03071382.83399213374619331060041.254506827993172.4703388.88379.47021483.230313119.078879861090042.655336928149845.2871378.78309.35831487.3OpenBenchmarking.org

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs8K16K24K32K40KSE +/- 546.57, N = 15SE +/- 33.33, N = 3SE +/- 495.11, N = 12SE +/- 1289.44, N = 12SE +/- 33.33, N = 3SE +/- 1214.24, N = 15SE +/- 1119.49, N = 12SE +/- 598.92, N = 12SE +/- 1633.89, N = 15954726767104953035811867339003749233992303131. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs306090120150SE +/- 2.13, N = 15SE +/- 1.98, N = 12SE +/- 4.95, N = 12SE +/- 0.09, N = 3SE +/- 4.66, N = 15SE +/- 4.38, N = 12SE +/- 2.34, N = 12SE +/- 6.47, N = 1537.3105.041.3118.946.4133.0146.0133.0119.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2K4K6K8K10KSE +/- 32.32, N = 13SE +/- 53.43, N = 15SE +/- 11.61, N = 3SE +/- 53.11, N = 3SE +/- 11.40, N = 15SE +/- 203.38, N = 12SE +/- 71.42, N = 3SE +/- 42.67, N = 3SE +/- 64.67, N = 159304543853604696867727112746178871. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2004006008001000SE +/- 4.05, N = 13SE +/- 6.68, N = 15SE +/- 1.53, N = 3SE +/- 6.81, N = 3SE +/- 1.43, N = 15SE +/- 25.39, N = 12SE +/- 8.84, N = 3SE +/- 5.51, N = 3SE +/- 8.10, N = 15116.6569.0107.0756.0121.0847.0889.0933.0986.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2K4K6K8K10KSE +/- 63.20, N = 3SE +/- 18.26, N = 3SE +/- 80.96, N = 9SE +/- 17.37, N = 3SE +/- 88.19, N = 3SE +/- 133.33, N = 3SE +/- 125.00, N = 4SE +/- 89.97, N = 7923593819775970410333104671107510600109001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs1020304050SE +/- 0.46, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 9SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.48, N = 3SE +/- 0.45, N = 4SE +/- 0.39, N = 7SE +/- 0.03, N = 335.836.738.237.940.040.943.341.242.61. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs12002400360048006000SE +/- 19.37, N = 3SE +/- 47.66, N = 3SE +/- 47.16, N = 3SE +/- 50.64, N = 3SE +/- 32.84, N = 3SE +/- 39.49, N = 3SE +/- 62.22, N = 3SE +/- 37.47, N = 3SE +/- 25.51, N = 34681475450455265501252605519545055331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs150300450600750SE +/- 2.33, N = 3SE +/- 6.01, N = 3SE +/- 5.93, N = 3SE +/- 6.36, N = 3SE +/- 4.04, N = 3SE +/- 5.03, N = 3SE +/- 7.69, N = 3SE +/- 4.63, N = 3SE +/- 3.00, N = 35865946316596276586916826921. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Sysbench

Test: Memory

OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: Memory2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2M4M6M8M10MSE +/- 226749.04, N = 12SE +/- 246434.83, N = 15SE +/- 187210.72, N = 15SE +/- 165423.75, N = 15SE +/- 59805.54, N = 15SE +/- 62488.89, N = 3SE +/- 18712.23, N = 3SE +/- 9483.96, N = 3SE +/- 30257.04, N = 34684365.564500949.665571462.295185705.685416008.175352567.535334350.087993172.478149845.291. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=amdfam10 -rdynamic -ldl -laio -lm

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs90180270360450SE +/- 1.56, N = 15SE +/- 3.17, N = 15SE +/- 0.96, N = 3SE +/- 4.26, N = 15SE +/- 1.03, N = 15SE +/- 3.16, N = 9SE +/- 4.44, N = 3SE +/- 5.30, N = 3SE +/- 3.97, N = 479.7381.195.2386.898.3387.7398.0388.8378.71. (CC) gcc options: -static

Sysbench

Test: CPU

OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: CPU2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs2K4K6K8K10KSE +/- 15.38, N = 3SE +/- 2.05, N = 3SE +/- 21.08, N = 3SE +/- 13.35, N = 3SE +/- 7.61, N = 3SE +/- 4.56, N = 3SE +/- 2.65, N = 3SE +/- 10.07, N = 3SE +/- 4.97, N = 31770.231789.072734.842762.104147.824202.284224.038379.478309.361. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=amdfam10 -rdynamic -ldl -laio -lm

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSync2c-50-768m_drbd.xfs2c-50-768m_sd.xfs2c-75-768m_drbd.xfs2c-75-768m_sd.xfs2c-100-768m_drbd.xfs2c-100-768m_sd.xfs2c-100-768m_drbd.xfs_broken-sync4c-100-768m_drbd.xfs_broken-sync4c-100-768m_sd.xfs30060090012001500SE +/- 1.35, N = 15SE +/- 28.52, N = 15SE +/- 0.33, N = 3SE +/- 25.36, N = 15SE +/- 0.65, N = 3SE +/- 19.73, N = 14SE +/- 34.63, N = 15SE +/- 55.31, N = 15SE +/- 34.21, N = 15144.61114.0133.51467.6150.71568.11382.81483.21487.31. (CC) gcc options: -static

Phoronix Test Suite v10.8.4