45drivesxl60

Intel Xeon Silver 4216 testing on FreeBSD via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2110221-TJ-45DRIVESX73&sor.

45drivesxl60ProcessorMotherboardMemoryDiskOSKernelCompilerFile-System10 Per VDEV RaidZ25 Per VDEV RaidZ2MirrorsIntel Xeon Silver 4216 (32 Cores)45Drives XL60 0123456789256GB742117GBFreeBSD12.2-RELEASE-p10 (x86_64)Clang 10.0.1zfsOpenBenchmarking.org

45drivesxl60fio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 128KB - Default Test Directory10 Per VDEV RaidZ25 Per VDEV RaidZ2Mirrors6851753333609230015666790837270073518800049512700014693391317303369217733343211033315700093500735188000529135667131333913006971783335051293331563339573373918933353713766713260099900OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2150300450600750SE +/- 2.85, N = 3SE +/- 2.67, N = 3SE +/- 3.06, N = 36976926851. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ240K80K120K160K200KSE +/- 666.67, N = 3SE +/- 666.67, N = 3SE +/- 666.67, N = 31786671773331753331. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2110220330440550SE +/- 5.61, N = 3SE +/- 2.33, N = 3SE +/- 1.76, N = 35054323601. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ230K60K90K120K150KSE +/- 1452.97, N = 3SE +/- 881.92, N = 3SE +/- 416.33, N = 3129333110333923001. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory5 Per VDEV RaidZ210 Per VDEV RaidZ2Mirrors30K60K90K120K150KSE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 333.33, N = 31570001566671563331. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ22K4K6K8K10KSE +/- 108.58, N = 390831. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ220K40K60K80K100KSE +/- 517.47, N = 3SE +/- 757.19, N = 3SE +/- 862.17, N = 39573393500727001. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2160320480640800SE +/- 1.67, N = 3SE +/- 1.76, N = 3SE +/- 1.76, N = 37397357351. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ240K80K120K160K200KSE +/- 333.33, N = 3SE +/- 577.35, N = 3SE +/- 577.35, N = 31893331880001880001. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ2120240360480600SE +/- 1.20, N = 35375294951. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ230K60K90K120K150KSE +/- 333.33, N = 3SE +/- 333.33, N = 31376671356671270001. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ2Mirrors5 Per VDEV RaidZ230K60K90K120K150KSE +/- 2369.38, N = 15SE +/- 1400.00, N = 5SE +/- 333.33, N = 31469331326001313331. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory10 Per VDEV RaidZ22K4K6K8K10KSE +/- 114.13, N = 391311. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: Default Test DirectoryMirrors5 Per VDEV RaidZ210 Per VDEV RaidZ220K40K60K80K100KSE +/- 1081.67, N = 3SE +/- 709.46, N = 3SE +/- 924.36, N = 39990091300730331. (CC) clang options: -rdynamic -lfl -lz -lpthread -lm -lrt -libverbs -lrdmacm -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Phoronix Test Suite v10.8.4