45_Drives_XL60

Intel Xeon Silver 4216 testing on FreeBSD via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2110229-TJ-45DRIVESX56&rdt.

45_Drives_XL60ProcessorMotherboardMemoryDiskOSKernelCompilerFile-System10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ2Intel Xeon Silver 4216 (32 Cores)45Drives XL60 0123456789256GB648814GBFreeBSD12.2-RELEASE-p10 (x86_64)Clang 10.0.1zfs742118GBOpenBenchmarking.org

45_Drives_XL60fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ269717833346111800014033395400756193667515132000134667941336961780003709470015866770867754193000503128667153667706338858883270217966737295333161667761677701970004941266671563337676795249593OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ2150300450600750SE +/- 3.67, N = 3SE +/- 4.73, N = 3SE +/- 4.10, N = 36936967021. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ240K80K120K160K200KSE +/- 1000.00, N = 3SE +/- 1154.70, N = 3SE +/- 1201.85, N = 31770001780001796671. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ2100200300400500SE +/- 5.31, N = 15SE +/- 2.03, N = 3SE +/- 2.03, N = 34613703721. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ230K60K90K120K150KSE +/- 1369.74, N = 15SE +/- 550.76, N = 3SE +/- 523.87, N = 311800094700953331. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ230K60K90K120K150KSE +/- 333.33, N = 3SE +/- 666.67, N = 3SE +/- 333.33, N = 31403331586671616671. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ220K40K60K80K100KSE +/- 1274.10, N = 3SE +/- 656.59, N = 3SE +/- 384.42, N = 39540070867761671. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ2170340510680850SE +/- 5.00, N = 3SE +/- 4.00, N = 3SE +/- 2.40, N = 37567547701. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ240K80K120K160K200KSE +/- 1333.33, N = 3SE +/- 1000.00, N = 31936671930001970001. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ2110220330440550SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 35155034941. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ230K60K90K120K150KSE +/- 333.33, N = 3SE +/- 333.33, N = 31320001286671266671. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ230K60K90K120K150KSE +/- 666.67, N = 3SE +/- 333.33, N = 3SE +/- 333.33, N = 31346671536671563331. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 VDEV with Six Drives Per VDEV RaidZ26 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ220K40K60K80K100KSE +/- 808.98, N = 3SE +/- 425.57, N = 3SE +/- 66.67, N = 39413370633767671. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory6 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ22K4K6K8K10KSE +/- 82.39, N = 3SE +/- 47.40, N = 3885895241. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory6 VDEV with Ten Drives Per VDEV RaidZ26 VDEVs with Ten Drives Per RaidZ22K4K6K8K10KSE +/- 53.47, N = 3SE +/- 7.86, N = 3883295931. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native


Phoronix Test Suite v10.8.3