2020-06-24-2159 no tuning, compression, or dedup zfs_6x_ssd_in_2x_raidz1: Processor: 2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads), Motherboard: Dell 0CNCJW (2.11.0 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF, Disk: 6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer Fit, Graphics: Matrox G200eR2, Monitor: DELL E196FP, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500 OS: CentOS Linux 8, Kernel: 4.18.0-193.6.3.el8_2.x86_64 (x86_64), Compiler: GCC 8.3.1 20191121, File-System: xfs, Screen Resolution: 1280x1024 Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 946 |================================================ Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 242133 |============================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 2535 |=============================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 162267 |============================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 4553 |=============================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 72773 |============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 211 |================================================ Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 54027 |============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 718 |================================================ Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 45667 |============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 1879 |=============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 30067 |============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 1396 |=============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 357667 |============================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 872 |================================================ Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 223333 |============================================= Flexible IO Tester 3.18 Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 3254 |=============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 208333 |============================================= Flexible IO Tester 3.18 Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 4822 |=============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 77167 |============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 700 |================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 179333 |============================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 2288 |=============================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 146667 |============================================= Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 4092 |=============================================== Flexible IO Tester 3.18 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 65450 |============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 212 |================================================ Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 54133 |============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 1625 |=============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 104000 |============================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 2106 |=============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 33475 |============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 662 |================================================ Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 42225 |============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 1611 |=============================================== Flexible IO Tester 3.18 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 25707 |============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 1086 |=============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 278333 |============================================= Flexible IO Tester 3.18 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 2753 |=============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 176000 |============================================= Flexible IO Tester 3.18 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 4385 |=============================================== Flexible IO Tester 3.18 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 70167 |============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 615 |================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 157333 |============================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 1423 |=============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 91067 |============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 MB/s > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 1811 |=============================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1 IOPS > Higher Is Better zfs_6x_ssd_in_2x_raidz1 . 28967 |==============================================