20190617-glusterfs

2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1906170-SDS-2019061788
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K
June 17 2019
  1 Hour, 42 Minutes
ZFS RaidZ2 6EA 12TB recordsize 128K
June 17 2019
  39 Minutes
Invert Hiding All Results Option
  1 Hour, 10 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: fuseblk, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

ZFS RaidZ2 6EA 12TB recordsize 128K

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

20190617-glusterfsOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads)Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS)Intel Xeon E7 v4/Xeon4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD11 x 12000GB Seagate ST12000NM0027 + 239GB Logical VolumeMatrox MGA G200e [Pilot]2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+CentOS Linux 73.10.0-957.21.2.el7.x86_64 (x86_64)GCC 4.8.5 20150623fuseblkzfs1024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemsScreen Resolution20190617-glusterfs PerformanceSystem Logs- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - DEADLINE / attr2,inode64,noquota,relatime,rw- Scaling Governor: intel_pstate powersave- l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K vs. ZFS RaidZ2 6EA 12TB recordsize 128K ComparisonPhoronix Test SuiteBaseline+89.3%+89.3%+178.6%+178.6%+267.9%+267.9%+357.2%+357.2%357.3%274.4%250.3%231.3%86.1%24.3%18.2%10.4%128Kb - 512MB - Read Performance128Kb - 2GB - Read Performance128Kb - 8GB - Read Performance128Kb - 4GB - Read Performance128Kb - 512MB - Write Performance128Kb - 2GB - Write Performance128Kb - 8GB - Write Performance128Kb - 4GB - Write PerformanceIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K

20190617-glusterfsiozone: 128Kb - 2GB - Read Performanceiozone: 128Kb - 4GB - Read Performanceiozone: 128Kb - 8GB - Read Performanceiozone: 128Kb - 2GB - Write Performanceiozone: 128Kb - 4GB - Write Performanceiozone: 128Kb - 8GB - Write Performanceiozone: 128Kb - 512MB - Read Performanceiozone: 128Kb - 512MB - Write Performancefs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K57461462025529732458320120.6353.9919.80122.352149203421723173283832666374OpenBenchmarking.org

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K5001000150020002500SE +/- 2.25, N = 3SE +/- 52.15, N = 1557421491. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000Min: 570.65 / Avg: 574.31 / Max: 578.42Min: 1795.95 / Avg: 2149.11 / Max: 2477.161. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000SE +/- 4.81, N = 3SE +/- 27.18, N = 1561420341. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000Min: 608.34 / Avg: 613.93 / Max: 623.51Min: 1879.93 / Avg: 2033.93 / Max: 2222.871. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K5001000150020002500SE +/- 7.05, N = 6SE +/- 25.90, N = 1562021721. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000Min: 588.58 / Avg: 619.75 / Max: 634.45Min: 1946.83 / Avg: 2172.28 / Max: 2334.011. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350SE +/- 9.01, N = 15SE +/- 14.24, N = 122553171. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K60120180240300Min: 217.48 / Avg: 255.1 / Max: 306.29Min: 223.83 / Avg: 317.21 / Max: 436.921. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350SE +/- 5.85, N = 15SE +/- 2.58, N = 32973281. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K60120180240300Min: 254.87 / Avg: 297.19 / Max: 324.47Min: 323.32 / Avg: 328.12 / Max: 332.161. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K80160240320400SE +/- 5.10, N = 15SE +/- 8.33, N = 123243831. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350Min: 287.42 / Avg: 323.69 / Max: 358.51Min: 341.76 / Avg: 382.92 / Max: 448.891. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K6001200180024003000SE +/- 15.81, N = 12SE +/- 187.64, N = 1558326661. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K5001000150020002500Min: 453.03 / Avg: 582.91 / Max: 650Min: 1810.44 / Avg: 2665.66 / Max: 4157.971. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K80160240320400SE +/- 5.87, N = 12SE +/- 21.80, N = 152013741. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350Min: 160.27 / Avg: 201.22 / Max: 229.33Min: 281.91 / Avg: 373.63 / Max: 573.051. (CC) gcc options: -O3

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K510152025SE +/- 0.03, N = 320.631. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K1224364860SE +/- 0.59, N = 753.991. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K510152025SE +/- 0.06, N = 319.801. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K306090120150SE +/- 1.09, N = 15122.351. (CC) gcc options: -static

Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: fuseblk, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 17 June 2019 15:32 by user sds.

ZFS RaidZ2 6EA 12TB recordsize 128K

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 17 June 2019 18:02 by user sds.