2022-11-26-2247 ZFS (linux@5.15.79) on nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F (64GB RAM) 3 x 3001GB Western Digital WD30EFRX-68E: Processor: Intel Pentium Silver J5005 @ 2.80GHz (4 Cores), Motherboard: ASRock J5005-ITX (P1.40 BIOS), Memory: 16GB, Disk: 3 x 3001GB Western Digital WD30EFRX-68E + 240GB CT240BX500SSD1 + 500GB Samsung SSD 860, Graphics: (800MHz) OS: Ubuntu 22.04.1 LTS, Kernel: 5.15.79 (x86_64), Compiler: GCC 11.3.0, File-System: zfs, System Layer: Docker ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F: Processor: Intel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads), Motherboard: ASRock B660M-ITX/ac (1.25 BIOS), Memory: 64GB, Disk: 512GB KINGSTON SKC3000S512G, Graphics: EFI VGA, Audio: Realtek ALC897 OS: Ubuntu 22.04.1 LTS, Kernel: 5.15.79 (x86_64), Compiler: GCC 11.3.0, File-System: zfs, Screen Resolution: 800x600, System Layer: Docker SQLite 3.30.1 Threads / Copies: 1 Seconds < Lower Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 273.91 |===================== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 13.72 |= SQLite 3.30.1 Threads / Copies: 8 Seconds < Lower Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 497.14 |===================== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 28.43 |= SQLite 3.30.1 Threads / Copies: 32 Seconds < Lower Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 1144.91 |==================== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 41.64 |= SQLite 3.30.1 Threads / Copies: 64 Seconds < Lower Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 1604.81 |==================== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 55.55 |= SQLite 3.30.1 Threads / Copies: 128 Seconds < Lower Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 2952.14 |==================== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 78.24 |= Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 2135 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 5619 |======================= Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 1064 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2806 |======================= Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 91.9 |====== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 321.0 |====================== Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 23500 |====== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 82133 |====================== Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 235 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 5246 |======================= Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 114 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2620 |======================= Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 11.39 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 827.00 |===================== Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 2898 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 211333 |===================== Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 2138 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 5628 |======================= Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 1065 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2810 |======================= Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 315 |=== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2511 |======================= Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 80700 |=== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 643000 |===================== Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 218 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 5088 |======================= Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 105 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2540 |======================= Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 132 |=== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 1059 |======================= Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 33800 |=== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 271000 |===================== FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 19.5 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 939.3 |====================== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 15.6 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 1381.5 |===================== FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 17.4 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 956.2 |====================== FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync Files/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 497.8 |=== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 3557.4 |===================== Dbench 4.0 12 Clients MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 40.66 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2737.96 |==================== Dbench 4.0 1 Clients MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 18.24 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 641.22 |===================== IOR 3.3.0 Block Size: 2MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 261.50 |============== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 393.34 |===================== IOR 3.3.0 Block Size: 4MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 272.85 |============== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 415.46 |===================== IOR 3.3.0 Block Size: 8MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 282.11 |============= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 445.29 |===================== IOR 3.3.0 Block Size: 16MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 266.82 |============ ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 476.24 |===================== IOR 3.3.0 Block Size: 32MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 256.11 |========== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 515.38 |===================== IOR 3.3.0 Block Size: 64MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 258.73 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 577.63 |===================== IOR 3.3.0 Block Size: 256MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 261.52 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 608.92 |===================== IOR 3.3.0 Block Size: 512MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 274.83 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 635.69 |===================== IOR 3.3.0 Block Size: 1024MB - Disk Target: /pts_data MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 295.80 |========= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 720.64 |===================== IOR 3.3.0 Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 58.97 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2506.87 |==================== IOR 3.3.0 Block Size: 4MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 73.86 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2710.06 |==================== IOR 3.3.0 Block Size: 8MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 83.73 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2896.20 |==================== IOR 3.3.0 Block Size: 16MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 89.98 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2998.09 |==================== IOR 3.3.0 Block Size: 32MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 94.26 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 2940.27 |==================== IOR 3.3.0 Block Size: 64MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 109.65 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 3079.90 |==================== IOR 3.3.0 Block Size: 256MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 100.98 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 3180.94 |==================== IOR 3.3.0 Block Size: 512MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 58.43 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 3153.81 |==================== IOR 3.3.0 Block Size: 1024MB - Disk Target: Default Test Directory MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 84.74 | ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 3682.34 |==================== Compile Bench 0.6 Test: Compile MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 174.14 |= ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 3665.29 |==================== Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 83.61 |=== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 551.10 |===================== Compile Bench 0.6 Test: Read Compiled Tree MB/s > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 169.68 |== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 1997.58 |==================== PostMark 1.51 Disk Transaction Performance TPS > Higher Is Better 3 x 3001GB Western Digital WD30EFRX-68E ......... 622 |== ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F . 5954 |=======================