20190617-glusterfs

2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1906178-SDS-2019061764
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K
June 17 2019
  1 Hour, 42 Minutes
ZFS RaidZ2 6EA 12TB recordsize 128K
June 17 2019
  39 Minutes
fuck
June 17 2019
 
ZFS RaidZ2 6EA 12TB recordsize 128k
June 17 2019
  32 Minutes
Invert Hiding All Results Option
  43 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: fuseblk, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

ZFS RaidZ2 6EA 12TB recordsize 128K

fuck

ZFS RaidZ2 6EA 12TB recordsize 128k

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

20190617-glusterfsOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads)Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS)Intel Xeon E7 v4/Xeon4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD11 x 12000GB Seagate ST12000NM0027 + 239GB Logical VolumeMatrox MGA G200e [Pilot]2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+CentOS Linux 73.10.0-957.21.2.el7.x86_64 (x86_64)GCC 4.8.5 20150623fuseblkzfs1024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemsScreen Resolution20190617-glusterfs PerformanceSystem Logs- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - DEADLINE / attr2,inode64,noquota,relatime,rw- Scaling Governor: intel_pstate powersave- l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

20190617-glusterfsiozone: 128Kb - 2GB - Read Performanceiozone: 128Kb - 4GB - Read Performanceiozone: 128Kb - 8GB - Read Performanceiozone: 128Kb - 2GB - Write Performanceiozone: 128Kb - 4GB - Write Performanceiozone: 128Kb - 8GB - Write Performanceiozone: 128Kb - 512MB - Read Performanceiozone: 128Kb - 512MB - Write Performancefs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128KfuckZFS RaidZ2 6EA 12TB recordsize 128k57461462025529732458320120.6353.9919.80122214920342172317328383266637438.4341.2037.33759OpenBenchmarking.org

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K5001000150020002500SE +/- 2.25, N = 3SE +/- 52.15, N = 1557421491. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000Min: 570.65 / Avg: 574.31 / Max: 578.42Min: 1795.95 / Avg: 2149.11 / Max: 2477.161. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000SE +/- 4.81, N = 3SE +/- 27.18, N = 1561420341. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000Min: 608.34 / Avg: 613.93 / Max: 623.51Min: 1879.93 / Avg: 2033.93 / Max: 2222.871. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K5001000150020002500SE +/- 7.05, N = 6SE +/- 25.90, N = 1562021721. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K400800120016002000Min: 588.58 / Avg: 619.75 / Max: 634.45Min: 1946.83 / Avg: 2172.28 / Max: 2334.011. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350SE +/- 9.01, N = 15SE +/- 14.24, N = 122553171. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 2GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K60120180240300Min: 217.48 / Avg: 255.1 / Max: 306.29Min: 223.83 / Avg: 317.21 / Max: 436.921. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350SE +/- 5.85, N = 15SE +/- 2.58, N = 32973281. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 4GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K60120180240300Min: 254.87 / Avg: 297.19 / Max: 324.47Min: 323.32 / Avg: 328.12 / Max: 332.161. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K80160240320400SE +/- 5.10, N = 15SE +/- 8.33, N = 123243831. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 8GB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350Min: 287.42 / Avg: 323.69 / Max: 358.51Min: 341.76 / Avg: 382.92 / Max: 448.891. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K6001200180024003000SE +/- 15.81, N = 12SE +/- 187.64, N = 1558326661. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Read PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K5001000150020002500Min: 453.03 / Avg: 582.91 / Max: 650Min: 1810.44 / Avg: 2665.66 / Max: 4157.971. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K80160240320400SE +/- 5.87, N = 12SE +/- 21.80, N = 152013741. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 128Kb - File Size: 512MB - Disk Test: Write PerformanceGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128K70140210280350Min: 160.27 / Avg: 201.22 / Max: 229.33Min: 281.91 / Avg: 373.63 / Max: 573.051. (CC) gcc options: -O3

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k918273645SE +/- 0.03, N = 3SE +/- 0.27, N = 320.6338.431. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k816243240Min: 20.6 / Avg: 20.63 / Max: 20.7Min: 37.9 / Avg: 38.43 / Max: 38.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k1224364860SE +/- 0.59, N = 7SE +/- 0.23, N = 353.9941.201. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k1122334455Min: 52.2 / Avg: 53.99 / Max: 56.5Min: 40.8 / Avg: 41.2 / Max: 41.61. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k918273645SE +/- 0.06, N = 3SE +/- 0.09, N = 319.8037.331. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k816243240Min: 19.7 / Avg: 19.8 / Max: 19.9Min: 37.2 / Avg: 37.33 / Max: 37.51. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k160320480640800SE +/- 1.09, N = 15SE +/- 17.74, N = 151227591. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncGlusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128KZFS RaidZ2 6EA 12TB recordsize 128k130260390520650Min: 115.3 / Avg: 122.35 / Max: 129.3Min: 676 / Avg: 759.11 / Max: 872.11. (CC) gcc options: -static

Glusterfs Distribute-Replicate 2 X 3 / ZFS RaidZ2 6EA 12TB recordsize 128K

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: fuseblk, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 17 June 2019 15:32 by user sds.

ZFS RaidZ2 6EA 12TB recordsize 128K

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 17 June 2019 18:02 by user sds.

fuck

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 17 June 2019 18:51 by user sds.

ZFS RaidZ2 6EA 12TB recordsize 128k

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 17 June 2019 18:58 by user sds.