20190617-glusterfs 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/1906170-SDS-2019061788&sor .
20190617-glusterfs Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads) Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) Intel Xeon E7 v4/Xeon 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume Matrox MGA G200e [Pilot] 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ CentOS Linux 7 3.10.0-957.21.2.el7.x86_64 (x86_64) GCC 4.8.5 20150623 fuseblk 1024x768 zfs OpenBenchmarking.org Compiler Details - --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Details - DEADLINE / attr2,inode64,noquota,relatime,rw Processor Details - Scaling Governor: intel_pstate powersave Security Details - l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB
20190617-glusterfs iozone: 128Kb - 2GB - Read Performance iozone: 128Kb - 4GB - Read Performance iozone: 128Kb - 8GB - Read Performance iozone: 128Kb - 2GB - Write Performance iozone: 128Kb - 4GB - Write Performance iozone: 128Kb - 8GB - Write Performance iozone: 128Kb - 512MB - Read Performance iozone: 128Kb - 512MB - Write Performance fs-mark: 1000 Files, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size fs-mark: 1000 Files, 1MB Size, No Sync/FSync Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K ZFS RaidZ2 6EA 12TB recordsize 128K 574 614 620 255 297 324 583 201 20.63 53.99 19.80 122.35 2149 2034 2172 317 328 383 2666 374 OpenBenchmarking.org
IOzone Record Size: 128Kb - File Size: 2GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Read Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 500 1000 1500 2000 2500 SE +/- 52.15, N = 15 SE +/- 2.25, N = 3 2149 574 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Read Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 400 800 1200 1600 2000 SE +/- 27.18, N = 15 SE +/- 4.81, N = 3 2034 614 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 8GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Read Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 500 1000 1500 2000 2500 SE +/- 25.90, N = 15 SE +/- 7.05, N = 6 2172 620 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 70 140 210 280 350 SE +/- 14.24, N = 12 SE +/- 9.01, N = 15 317 255 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 70 140 210 280 350 SE +/- 2.58, N = 3 SE +/- 5.85, N = 15 328 297 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 80 160 240 320 400 SE +/- 8.33, N = 12 SE +/- 5.10, N = 15 383 324 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Read Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 600 1200 1800 2400 3000 SE +/- 187.64, N = 15 SE +/- 15.81, N = 12 2666 583 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ2 6EA 12TB recordsize 128K Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 80 160 240 320 400 SE +/- 21.80, N = 15 SE +/- 5.87, N = 12 374 201 1. (CC) gcc options: -O3
FS-Mark Test: 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 5 10 15 20 25 SE +/- 0.03, N = 3 20.63 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 12 24 36 48 60 SE +/- 0.59, N = 7 53.99 1. (CC) gcc options: -static
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 5 10 15 20 25 SE +/- 0.06, N = 3 19.80 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size, No Sync/FSync OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K 30 60 90 120 150 SE +/- 1.09, N = 15 122.35 1. (CC) gcc options: -static
Phoronix Test Suite v10.8.4