20190617-glusterfs 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/1906170-SDS-2019061788 .
20190617-glusterfs Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads) Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) Intel Xeon E7 v4/Xeon 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume Matrox MGA G200e [Pilot] 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ CentOS Linux 7 3.10.0-957.21.2.el7.x86_64 (x86_64) GCC 4.8.5 20150623 fuseblk 1024x768 zfs OpenBenchmarking.org Compiler Details - --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Details - DEADLINE / attr2,inode64,noquota,relatime,rw Processor Details - Scaling Governor: intel_pstate powersave Security Details - l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB
20190617-glusterfs iozone: 128Kb - 2GB - Read Performance iozone: 128Kb - 4GB - Read Performance iozone: 128Kb - 8GB - Read Performance iozone: 128Kb - 2GB - Write Performance iozone: 128Kb - 4GB - Write Performance iozone: 128Kb - 8GB - Write Performance iozone: 128Kb - 512MB - Read Performance iozone: 128Kb - 512MB - Write Performance fs-mark: 1000 Files, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size fs-mark: 1000 Files, 1MB Size, No Sync/FSync Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 574 614 620 255 297 324 583 201 20.63 53.99 19.80 122.35 2149 2034 2172 317 328 383 2666 374 OpenBenchmarking.org
IOzone Record Size: 128Kb - File Size: 2GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Read Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 500 1000 1500 2000 2500 SE +/- 2.25, N = 3 SE +/- 52.15, N = 15 574 2149 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Read Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 400 800 1200 1600 2000 SE +/- 4.81, N = 3 SE +/- 27.18, N = 15 614 2034 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 8GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Read Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 500 1000 1500 2000 2500 SE +/- 7.05, N = 6 SE +/- 25.90, N = 15 620 2172 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 70 140 210 280 350 SE +/- 9.01, N = 15 SE +/- 14.24, N = 12 255 317 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 70 140 210 280 350 SE +/- 5.85, N = 15 SE +/- 2.58, N = 3 297 328 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 80 160 240 320 400 SE +/- 5.10, N = 15 SE +/- 8.33, N = 12 324 383 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Read Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 600 1200 1800 2400 3000 SE +/- 15.81, N = 12 SE +/- 187.64, N = 15 583 2666 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 80 160 240 320 400 SE +/- 5.87, N = 12 SE +/- 21.80, N = 15 201 374 1. (CC) gcc options: -O3
FS-Mark Test: 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 5 10 15 20 25 SE +/- 0.03, N = 3 20.63 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 12 24 36 48 60 SE +/- 0.59, N = 7 53.99 1. (CC) gcc options: -static
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 5 10 15 20 25 SE +/- 0.06, N = 3 19.80 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size, No Sync/FSync OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 30 60 90 120 150 SE +/- 1.09, N = 15 122.35 1. (CC) gcc options: -static
Phoronix Test Suite v10.8.4