ZFS + KVM + NTFS Benchmarking Various Record Sizes
This benchmark aims to identify optimal combination of record sizes (i.e., recordsize for ZFS, cluster_size for QCOW2, allocation unit size for NTFS) for a Windows 10 Guest VM running on top of ZFS + KVM.
Host: Dual Intel Xeon 6130 @ 2.10GHz, 384GB RAM, CentOS 7.6 Virtualization Base Environment, ZFS 0.8.0 via EPEL zfs-testing repository
ZFS Config: 4 x RAIDZ2 (5 x 8TB 7.2K HDD) + 2 x OPTANE 900 280GB SLOG MIRROR + OPTANE 900 480GB CACHE
Windows Guest: 2 vCPUs, 4GB RAM, 40 GB QCOW2 (bus:virtio, cache:writeback, io:default, cluster size 4k ~ 128k)
HTML result view exported from: https://openbenchmarking.org/result/1906129-HV-MERGE333894&grs&sor .
ZFS + KVM + NTFS Benchmarking Various Record Sizes Processor Motherboard Memory Disk Graphics OS Kernel Display Driver File-System Screen Resolution ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 2 x Intel Xeon (Skylake IBRS) @ 2.10GHz (2 Cores) (0.5.1 BIOS) 1 x 4096 MB 40GB Red Hat VirtIO Microsoft Basic Display Microsoft Windows 10 Enterprise Evaluation Build 18362 10.0 (x86_64) 10.0.18362.1 NTFS 1024x768 OpenBenchmarking.org
ZFS + KVM + NTFS Benchmarking Various Record Sizes iozone: 64Kb - 8GB - Write Performance fio: Seq Write - Windows AIO - No - Yes - 16KB - Default Test Directory fio: Rand Write - Windows AIO - No - Yes - 16KB - Default Test Directory fio: Seq Write - Windows AIO - No - Yes - 8KB - Default Test Directory fio: Rand Write - Windows AIO - No - Yes - 8KB - Default Test Directory fio: Rand Write - Windows AIO - No - Yes - 4KB - Default Test Directory fio: Seq Write - Windows AIO - No - Yes - 4KB - Default Test Directory fio: Rand Read - Windows AIO - No - Yes - 1MB - Default Test Directory iozone: 4Kb - 8GB - Write Performance fio: Seq Read - Windows AIO - No - Yes - 1MB - Default Test Directory fio: Rand Read - Windows AIO - No - Yes - 8KB - Default Test Directory fio: Rand Read - Windows AIO - No - Yes - 4KB - Default Test Directory iozone: 64Kb - 8GB - Read Performance fio: Rand Read - Windows AIO - No - Yes - 64KB - Default Test Directory fio: Rand Read - Windows AIO - No - Yes - 16KB - Default Test Directory iozone: 4Kb - 8GB - Read Performance fio: Seq Read - Windows AIO - No - Yes - 16KB - Default Test Directory fio: Seq Read - Windows AIO - No - Yes - 4KB - Default Test Directory fio: Seq Read - Windows AIO - No - Yes - 8KB - Default Test Directory fio: Seq Read - Windows AIO - No - Yes - 64KB - Default Test Directory iozone: 1MB - 8GB - Write Performance iozone: 1MB - 8GB - Read Performance fio: Seq Write - Windows AIO - No - Yes - 64KB - Default Test Directory fio: Seq Write - Windows AIO - No - Yes - 1MB - Default Test Directory fio: Rand Write - Windows AIO - No - Yes - 64KB - Default Test Directory fio: Rand Write - Windows AIO - No - Yes - 1MB - Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 947.01 625 446 373 230 119 204 12500 439.51 11700 416 204 807.93 3028 838 561.17 820 212 426 2917 1027.92 1867.17 1360 3393 1342 3225 1154.15 610 447 363 247 125 206 11500 622.91 12133 463 234 833.63 2868 831 563.02 860 225 442 3150 1150.28 1852.57 1500 2678 1354 2743 743.78 415 282 256 155 82.41 159 7675 565.58 10767 288 146 655.99 2058 578 437.64 865 229 446 2997 748.10 1492.24 585 619 617 657 266.34 140 118 102 74.46 42.30 65.83 4191 243.93 5047 198 104.47 408.54 1460 433 296.75 928 228 460 3217 254.89 699.92 187 162 169 166 1293.46 378 299 191 154 76.97 96.37 12160 648.44 12025 408 205 875.13 2715 808 576.96 750 200 374 2755 1364.73 1885.86 3147 1177 3503 951.01 381 321 181 159 76.97 92.61 12533 446.27 12333 416 209 835.14 2917 828 580.74 804 211 402 2906 1016.09 1929.75 1153 3293 1170 3511 1318.79 628 463 369 249 134 199 12554 615.63 12467 410 208 826.00 2851 815 573.83 835 214 423 2944 1326.99 1896.74 1486 3316 1409 3286 808.15 534 454 349 233 123 193 12875 395.38 13233 408 211 792.23 2896 791 561.94 810 212 412 3028 1043.66 1893.33 1190 2574 1164 2695 583.25 373 275 223 142 73.90 130 9830 396.63 11300 252 126 644.41 2002 500 459.38 694 176 364 2626 606.42 1611.63 601 612 601 641 1125.91 503 437 325 238 119 194 12853 552.19 12547 420 211 810.39 2809 830 551.31 839 216 430 2850 1072.11 1901.82 1152 2502 1154 2406 1089.60 519 305 303 165 82.13 171 9859 542.85 11900 324 160 806.79 2460 640 539.59 801 213 417 3082 1133.03 1855.03 1233 2550 904 2573 908.61 231 155 133 79.79 40.23 65.73 5270 426.39 5737 228 110 799.85 1423 397 526.52 841 220 417 2903 925.75 1787.43 633 1548 464 1236 977.73 493 313 291 171 88.98 167 9007 485.37 11740 294 153 786.52 2195 592 571.72 822 208 438 2893 1007.22 1972.18 1210 2533 945 2641 OpenBenchmarking.org
IOzone Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 300 600 900 1200 1500 SE +/- 11.98, N = 3 SE +/- 18.61, N = 4 SE +/- 13.91, N = 15 SE +/- 13.45, N = 5 SE +/- 14.52, N = 5 SE +/- 29.69, N = 15 SE +/- 11.60, N = 6 SE +/- 20.93, N = 12 SE +/- 23.22, N = 13 SE +/- 6.36, N = 3 SE +/- 11.06, N = 15 SE +/- 3.74, N = 3 SE +/- 3.55, N = 4 1318.79 1293.46 1154.15 1125.91 1089.60 977.73 951.01 947.01 908.61 808.15 743.78 583.25 266.34
Flexible IO Tester Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 140 280 420 560 700 SE +/- 7.11, N = 15 SE +/- 10.40, N = 3 SE +/- 8.69, N = 3 SE +/- 6.12, N = 6 SE +/- 4.71, N = 15 SE +/- 5.46, N = 3 SE +/- 7.69, N = 3 SE +/- 3.61, N = 3 SE +/- 5.36, N = 3 SE +/- 4.18, N = 15 SE +/- 6.17, N = 3 SE +/- 3.04, N = 5 SE +/- 2.12, N = 15 628 625 610 534 519 503 493 415 381 378 373 231 140
Flexible IO Tester Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 100 200 300 400 500 SE +/- 6.71, N = 15 SE +/- 4.37, N = 3 SE +/- 4.13, N = 15 SE +/- 4.19, N = 9 SE +/- 3.26, N = 15 SE +/- 2.08, N = 3 SE +/- 4.98, N = 3 SE +/- 2.08, N = 3 SE +/- 3.37, N = 15 SE +/- 3.71, N = 3 SE +/- 0.88, N = 3 SE +/- 1.39, N = 15 463 454 447 446 437 321 313 305 299 282 275 155 118
Flexible IO Tester Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 80 160 240 320 400 SE +/- 3.51, N = 15 SE +/- 2.91, N = 15 SE +/- 2.00, N = 3 SE +/- 4.16, N = 3 SE +/- 4.59, N = 4 SE +/- 2.76, N = 15 SE +/- 4.08, N = 15 SE +/- 2.08, N = 3 SE +/- 2.66, N = 15 SE +/- 3.70, N = 12 SE +/- 1.00, N = 3 SE +/- 1.20, N = 3 373 369 363 349 325 303 291 256 223 191 181 133 102
Flexible IO Tester Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 50 100 150 200 250 SE +/- 2.24, N = 15 SE +/- 3.79, N = 3 SE +/- 1.76, N = 3 SE +/- 3.01, N = 15 SE +/- 2.08, N = 15 SE +/- 2.40, N = 3 SE +/- 3.55, N = 15 SE +/- 1.46, N = 15 SE +/- 0.63, N = 14 SE +/- 1.40, N = 12 249.00 247.00 238.00 233.00 230.00 171.00 165.00 159.00 155.00 154.00 142.00 79.79 74.46
Flexible IO Tester Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 64k - QCOW2 4k - NTFS 4k 30 60 90 120 150 SE +/- 0.88, N = 3 SE +/- 1.41, N = 15 SE +/- 1.76, N = 3 SE +/- 2.03, N = 3 SE +/- 1.41, N = 15 SE +/- 0.95, N = 15 SE +/- 0.71, N = 15 SE +/- 0.83, N = 15 SE +/- 0.34, N = 3 SE +/- 1.04, N = 3 SE +/- 0.25, N = 3 SE +/- 0.15, N = 3 134.00 125.00 123.00 119.00 119.00 88.98 82.41 82.13 76.97 76.97 73.90 42.30 40.23
Flexible IO Tester Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 64k - QCOW2 4k - NTFS 4k 50 100 150 200 250 SE +/- 2.72, N = 4 SE +/- 2.36, N = 15 SE +/- 2.91, N = 3 SE +/- 2.60, N = 3 SE +/- 2.09, N = 15 SE +/- 2.52, N = 3 SE +/- 2.19, N = 3 SE +/- 1.00, N = 15 SE +/- 1.06, N = 15 SE +/- 0.76, N = 15 SE +/- 0.95, N = 3 206.00 204.00 199.00 194.00 193.00 171.00 167.00 159.00 130.00 96.37 92.61 65.83 65.73
Flexible IO Tester Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 3K 6K 9K 12K 15K SE +/- 130.59, N = 8 SE +/- 139.00, N = 15 SE +/- 143.94, N = 13 SE +/- 145.30, N = 3 SE +/- 173.21, N = 3 SE +/- 162.36, N = 15 SE +/- 210.22, N = 15 SE +/- 108.50, N = 3 SE +/- 75.55, N = 3 SE +/- 59.54, N = 3 SE +/- 106.26, N = 4 SE +/- 41.46, N = 3 SE +/- 37.82, N = 3 12875 12853 12554 12533 12500 12160 11500 9859 9830 9007 7675 5270 4191
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 140 280 420 560 700 SE +/- 4.73, N = 3 SE +/- 7.97, N = 3 SE +/- 10.20, N = 3 SE +/- 2.28, N = 3 SE +/- 8.87, N = 15 SE +/- 7.62, N = 15 SE +/- 10.50, N = 15 SE +/- 2.00, N = 3 SE +/- 2.40, N = 3 SE +/- 1.76, N = 3 SE +/- 4.57, N = 3 SE +/- 8.83, N = 15 SE +/- 3.44, N = 3 648.44 622.91 615.63 565.58 552.19 542.85 485.37 446.27 439.51 426.39 396.63 395.38 243.93
Flexible IO Tester Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 3K 6K 9K 12K 15K SE +/- 115.33, N = 15 SE +/- 107.29, N = 15 SE +/- 176.38, N = 3 SE +/- 136.51, N = 15 SE +/- 88.19, N = 3 SE +/- 179.70, N = 4 SE +/- 57.74, N = 3 SE +/- 143.53, N = 5 SE +/- 115.47, N = 3 SE +/- 88.19, N = 3 SE +/- 51.66, N = 10 SE +/- 22.91, N = 3 13233 12547 12467 12333 12133 12025 11900 11740 11700 11300 10767 5737 5047
Flexible IO Tester Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 100 200 300 400 500 SE +/- 7.21, N = 15 SE +/- 5.09, N = 15 SE +/- 6.56, N = 3 SE +/- 5.30, N = 15 SE +/- 2.85, N = 3 SE +/- 3.06, N = 3 SE +/- 4.51, N = 3 SE +/- 3.89, N = 6 SE +/- 2.45, N = 15 SE +/- 2.60, N = 3 SE +/- 3.79, N = 3 SE +/- 1.20, N = 3 SE +/- 2.74, N = 4 463 420 416 416 410 408 408 324 294 288 252 228 198
Flexible IO Tester Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 50 100 150 200 250 SE +/- 3.84, N = 3 SE +/- 2.96, N = 15 SE +/- 2.33, N = 3 SE +/- 1.45, N = 3 SE +/- 2.24, N = 7 SE +/- 1.76, N = 15 SE +/- 3.90, N = 14 SE +/- 2.52, N = 15 SE +/- 2.19, N = 3 SE +/- 2.03, N = 3 SE +/- 1.24, N = 15 SE +/- 1.00, N = 3 SE +/- 1.04, N = 15 234.00 211.00 211.00 209.00 208.00 205.00 204.00 160.00 153.00 146.00 126.00 110.00 104.47
IOzone Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performance ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 200 400 600 800 1000 SE +/- 12.19, N = 3 SE +/- 12.53, N = 3 SE +/- 11.05, N = 3 SE +/- 9.96, N = 5 SE +/- 9.09, N = 15 SE +/- 11.87, N = 3 SE +/- 5.12, N = 3 SE +/- 7.14, N = 3 SE +/- 6.94, N = 11 SE +/- 10.06, N = 4 SE +/- 6.93, N = 3 SE +/- 6.68, N = 3 SE +/- 4.64, N = 15 875.13 835.14 833.63 826.00 810.39 807.93 806.79 799.85 792.23 786.52 655.99 644.41 408.54
Flexible IO Tester Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 64k - QCOW2 4k - NTFS 4k 600 1200 1800 2400 3000 SE +/- 42.72, N = 3 SE +/- 47.81, N = 3 SE +/- 29.53, N = 8 SE +/- 30.89, N = 15 SE +/- 38.74, N = 3 SE +/- 34.30, N = 5 SE +/- 26.54, N = 3 SE +/- 21.63, N = 13 SE +/- 26.34, N = 15 SE +/- 21.48, N = 15 SE +/- 23.87, N = 15 SE +/- 17.41, N = 15 SE +/- 20.58, N = 3 3028 2917 2896 2868 2851 2809 2715 2460 2195 2058 2002 1460 1423
Flexible IO Tester Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 64k - QCOW2 4k - NTFS 4k 200 400 600 800 1000 SE +/- 11.86, N = 3 SE +/- 11.79, N = 3 SE +/- 8.01, N = 15 SE +/- 9.24, N = 15 SE +/- 9.68, N = 3 SE +/- 11.41, N = 15 SE +/- 9.43, N = 15 SE +/- 7.55, N = 3 SE +/- 5.24, N = 3 SE +/- 5.76, N = 15 SE +/- 5.49, N = 15 SE +/- 4.95, N = 15 SE +/- 4.97, N = 15 838 831 830 828 815 808 791 640 592 578 500 433 397
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performance ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k 130 260 390 520 650 SE +/- 8.65, N = 4 SE +/- 6.91, N = 3 SE +/- 8.49, N = 3 SE +/- 5.19, N = 15 SE +/- 1.57, N = 3 SE +/- 6.39, N = 3 SE +/- 8.16, N = 3 SE +/- 6.80, N = 5 SE +/- 4.68, N = 3 SE +/- 6.81, N = 3 SE +/- 5.81, N = 5 SE +/- 3.62, N = 3 SE +/- 5.26, N = 12 580.74 576.96 573.83 571.72 563.02 561.94 561.17 551.31 539.59 526.52 459.38 437.64 296.75
Flexible IO Tester Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 4k 200 400 600 800 1000 SE +/- 7.69, N = 3 SE +/- 7.51, N = 3 SE +/- 10.12, N = 15 SE +/- 10.56, N = 15 SE +/- 9.13, N = 3 SE +/- 7.70, N = 15 SE +/- 5.90, N = 3 SE +/- 4.73, N = 3 SE +/- 12.37, N = 15 SE +/- 6.33, N = 3 SE +/- 7.36, N = 3 SE +/- 5.70, N = 3 SE +/- 3.93, N = 3 928 865 860 841 839 835 822 820 810 804 801 750 694
Flexible IO Tester Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 4k 50 100 150 200 250 SE +/- 2.19, N = 3 SE +/- 2.30, N = 15 SE +/- 3.12, N = 15 SE +/- 2.60, N = 3 SE +/- 2.04, N = 15 SE +/- 2.67, N = 3 SE +/- 1.45, N = 3 SE +/- 2.52, N = 3 SE +/- 2.71, N = 4 SE +/- 2.40, N = 3 SE +/- 1.66, N = 13 SE +/- 1.20, N = 3 229 228 225 220 216 214 213 212 212 211 208 200 176
Flexible IO Tester Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 4k 100 200 300 400 500 SE +/- 5.80, N = 5 SE +/- 4.81, N = 3 SE +/- 5.71, N = 15 SE +/- 1.53, N = 3 SE +/- 2.33, N = 3 SE +/- 1.76, N = 3 SE +/- 3.76, N = 3 SE +/- 6.84, N = 3 SE +/- 6.64, N = 3 SE +/- 1.76, N = 3 SE +/- 5.21, N = 3 SE +/- 6.01, N = 3 SE +/- 3.78, N = 15 460 446 442 438 430 426 423 417 417 412 402 374 364
Flexible IO Tester Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 4k 700 1400 2100 2800 3500 SE +/- 32.24, N = 8 SE +/- 43.44, N = 4 SE +/- 10.33, N = 3 SE +/- 7.45, N = 3 SE +/- 24.67, N = 3 SE +/- 34.87, N = 15 SE +/- 38.07, N = 4 SE +/- 10.58, N = 3 SE +/- 24.31, N = 15 SE +/- 13.65, N = 3 SE +/- 37.55, N = 3 SE +/- 8.50, N = 3 SE +/- 34.35, N = 3 3217 3150 3082 3028 2997 2944 2917 2906 2903 2893 2850 2755 2626
IOzone Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 300 600 900 1200 1500 SE +/- 12.35, N = 10 SE +/- 11.40, N = 3 SE +/- 14.89, N = 15 SE +/- 20.17, N = 15 SE +/- 37.94, N = 15 SE +/- 29.58, N = 12 SE +/- 28.65, N = 15 SE +/- 27.59, N = 14 SE +/- 29.59, N = 15 SE +/- 13.11, N = 15 SE +/- 7.98, N = 15 SE +/- 4.23, N = 3 SE +/- 1.51, N = 3 1364.73 1326.99 1150.28 1133.03 1072.11 1043.66 1027.92 1016.09 1007.22 925.75 748.10 606.42 254.89
IOzone Record Size: 1MB - File Size: 8GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Read Performance ZFS 64k - QCOW2 16k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k 400 800 1200 1600 2000 SE +/- 22.67, N = 3 SE +/- 33.35, N = 15 SE +/- 32.92, N = 15 SE +/- 31.29, N = 3 SE +/- 23.36, N = 5 SE +/- 38.22, N = 15 SE +/- 39.76, N = 15 SE +/- 19.66, N = 15 SE +/- 28.21, N = 3 SE +/- 24.78, N = 3 SE +/- 7.34, N = 3 SE +/- 19.59, N = 15 SE +/- 8.14, N = 3 1972.18 1929.75 1901.82 1896.74 1893.33 1885.86 1867.17 1855.03 1852.57 1787.43 1611.63 1492.24 699.92
Flexible IO Tester Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k 300 600 900 1200 1500 SE +/- 29.00, N = 15 SE +/- 17.89, N = 15 SE +/- 17.28, N = 15 SE +/- 25.11, N = 15 SE +/- 14.28, N = 15 SE +/- 18.33, N = 3 SE +/- 12.77, N = 15 SE +/- 37.86, N = 12 SE +/- 5.91, N = 15 SE +/- 9.40, N = 3 SE +/- 18.13, N = 12 SE +/- 5.51, N = 12 1500 1486 1360 1233 1210 1190 1153 1152 633 601 585 187
Flexible IO Tester Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 700 1400 2100 2800 3500 SE +/- 57.43, N = 15 SE +/- 80.74, N = 15 SE +/- 57.13, N = 15 SE +/- 53.58, N = 15 SE +/- 49.81, N = 15 SE +/- 26.21, N = 3 SE +/- 65.35, N = 12 SE +/- 122.35, N = 12 SE +/- 71.45, N = 15 SE +/- 27.56, N = 15 SE +/- 19.74, N = 15 SE +/- 20.61, N = 15 SE +/- 4.19, N = 15 3393 3316 3293 3147 2678 2574 2550 2533 2502 1548 619 612 162
Flexible IO Tester Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 300 600 900 1200 1500 SE +/- 36.81, N = 15 SE +/- 28.55, N = 15 SE +/- 16.17, N = 3 SE +/- 16.82, N = 15 SE +/- 22.57, N = 12 SE +/- 27.25, N = 15 SE +/- 14.83, N = 5 SE +/- 13.06, N = 15 SE +/- 9.87, N = 3 SE +/- 21.03, N = 15 SE +/- 25.28, N = 15 SE +/- 2.60, N = 3 SE +/- 4.42, N = 15 1409 1354 1342 1177 1170 1164 1154 945 904 617 601 464 169
Flexible IO Tester Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 4k - QCOW2 4k - NTFS - 4k 800 1600 2400 3200 4000 SE +/- 68.97, N = 14 SE +/- 28.62, N = 3 SE +/- 81.14, N = 15 SE +/- 98.84, N = 12 SE +/- 57.14, N = 15 SE +/- 28.67, N = 3 SE +/- 76.03, N = 15 SE +/- 69.43, N = 15 SE +/- 78.39, N = 15 SE +/- 22.28, N = 15 SE +/- 13.92, N = 15 SE +/- 25.74, N = 15 SE +/- 5.04, N = 15 3511 3503 3286 3225 2743 2695 2641 2573 2406 1236 657 641 166
Phoronix Test Suite v10.8.4