ZFS + KVM + NTFS Benchmarking Various Record Sizes This benchmark aims to identify optimal combination of record sizes (i.e., recordsize for ZFS, cluster_size for QCOW2, allocation unit size for NTFS) for a Windows 10 Guest VM running on top of ZFS + KVM. Host: Dual Intel Xeon 6130 @ 2.10GHz, 384GB RAM, CentOS 7.6 Virtualization Base Environment, ZFS 0.8.0 via EPEL zfs-testing repository ZFS Config: 4 x RAIDZ2 (5 x 8TB 7.2K HDD) + 2 x OPTANE 900 280GB SLOG MIRROR + OPTANE 900 480GB CACHE Windows Guest: 2 vCPUs, 4GB RAM, 40 GB QCOW2 (bus:virtio, cache:writeback, io:default, cluster size 4k ~ 128k)
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 1906129-HV-MERGE333894 ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k Processor: 2 x Intel Xeon (Skylake IBRS) @ 2.10GHz (2 Cores), Motherboard: (0.5.1 BIOS), Memory: 1 x 4096 MB, Disk: 40GB Red Hat VirtIO, Graphics: Microsoft Basic Display
OS: Microsoft Windows 10 Enterprise Evaluation Build 18362, Kernel: 10.0 (x86_64), Display Driver: 10.0.18362.1, File-System: NTFS, Screen Resolution: 1024x768
Flexible IO Tester Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 3K 6K 9K 12K 15K SE +/- 173.21, N = 3 SE +/- 210.22, N = 15 SE +/- 106.26, N = 4 SE +/- 37.82, N = 3 SE +/- 162.36, N = 15 SE +/- 145.30, N = 3 SE +/- 143.94, N = 13 SE +/- 130.59, N = 8 SE +/- 75.55, N = 3 SE +/- 139.00, N = 15 SE +/- 108.50, N = 3 SE +/- 41.46, N = 3 SE +/- 59.54, N = 3 12500 11500 7675 4191 12160 12533 12554 12875 9830 12853 9859 5270 9007
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 50 100 150 200 250 SE +/- 3.90, N = 14 SE +/- 3.84, N = 3 SE +/- 2.03, N = 3 SE +/- 1.04, N = 15 SE +/- 1.76, N = 15 SE +/- 1.45, N = 3 SE +/- 2.24, N = 7 SE +/- 2.33, N = 3 SE +/- 1.24, N = 15 SE +/- 2.96, N = 15 SE +/- 2.52, N = 15 SE +/- 1.00, N = 3 SE +/- 2.19, N = 3 204.00 234.00 146.00 104.47 205.00 209.00 208.00 211.00 126.00 211.00 160.00 110.00 153.00
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 100 200 300 400 500 SE +/- 5.30, N = 15 SE +/- 7.21, N = 15 SE +/- 2.60, N = 3 SE +/- 2.74, N = 4 SE +/- 4.51, N = 3 SE +/- 6.56, N = 3 SE +/- 2.85, N = 3 SE +/- 3.06, N = 3 SE +/- 3.79, N = 3 SE +/- 5.09, N = 15 SE +/- 3.89, N = 6 SE +/- 1.20, N = 3 SE +/- 2.45, N = 15 416 463 288 198 408 416 410 408 252 420 324 228 294
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 200 400 600 800 1000 SE +/- 11.86, N = 3 SE +/- 11.79, N = 3 SE +/- 5.76, N = 15 SE +/- 4.95, N = 15 SE +/- 11.41, N = 15 SE +/- 9.24, N = 15 SE +/- 9.68, N = 3 SE +/- 9.43, N = 15 SE +/- 5.49, N = 15 SE +/- 8.01, N = 15 SE +/- 7.55, N = 3 SE +/- 4.97, N = 15 SE +/- 5.24, N = 3 838 831 578 433 808 828 815 791 500 830 640 397 592
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 600 1200 1800 2400 3000 SE +/- 42.72, N = 3 SE +/- 30.89, N = 15 SE +/- 21.48, N = 15 SE +/- 17.41, N = 15 SE +/- 26.54, N = 3 SE +/- 47.81, N = 3 SE +/- 38.74, N = 3 SE +/- 29.53, N = 8 SE +/- 23.87, N = 15 SE +/- 34.30, N = 5 SE +/- 21.63, N = 13 SE +/- 20.58, N = 3 SE +/- 26.34, N = 15 3028 2868 2058 1460 2715 2917 2851 2896 2002 2809 2460 1423 2195
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 800 1600 2400 3200 4000 SE +/- 98.84, N = 12 SE +/- 57.14, N = 15 SE +/- 13.92, N = 15 SE +/- 5.04, N = 15 SE +/- 28.62, N = 3 SE +/- 68.97, N = 14 SE +/- 81.14, N = 15 SE +/- 28.67, N = 3 SE +/- 25.74, N = 15 SE +/- 78.39, N = 15 SE +/- 69.43, N = 15 SE +/- 22.28, N = 15 SE +/- 76.03, N = 15 3225 2743 657 166 3503 3511 3286 2695 641 2406 2573 1236 2641
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 30 60 90 120 150 SE +/- 2.03, N = 3 SE +/- 1.41, N = 15 SE +/- 0.95, N = 15 SE +/- 0.25, N = 3 SE +/- 0.34, N = 3 SE +/- 0.83, N = 15 SE +/- 0.88, N = 3 SE +/- 1.76, N = 3 SE +/- 1.04, N = 3 SE +/- 0.71, N = 15 SE +/- 0.15, N = 3 SE +/- 1.41, N = 15 119.00 125.00 82.41 42.30 76.97 76.97 134.00 123.00 73.90 119.00 82.13 40.23 88.98
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 50 100 150 200 250 SE +/- 2.08, N = 15 SE +/- 3.79, N = 3 SE +/- 1.46, N = 15 SE +/- 1.40, N = 12 SE +/- 3.55, N = 15 SE +/- 2.24, N = 15 SE +/- 3.01, N = 15 SE +/- 1.76, N = 3 SE +/- 2.40, N = 3 SE +/- 0.63, N = 14 230.00 247.00 155.00 74.46 154.00 159.00 249.00 233.00 142.00 238.00 165.00 79.79 171.00
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 100 200 300 400 500 SE +/- 4.13, N = 15 SE +/- 4.37, N = 3 SE +/- 3.37, N = 15 SE +/- 1.39, N = 15 SE +/- 2.08, N = 3 SE +/- 3.26, N = 15 SE +/- 6.71, N = 15 SE +/- 3.71, N = 3 SE +/- 4.19, N = 9 SE +/- 4.98, N = 3 SE +/- 0.88, N = 3 SE +/- 2.08, N = 3 446 447 282 118 299 321 463 454 275 437 305 155 313
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 300 600 900 1200 1500 SE +/- 16.17, N = 3 SE +/- 28.55, N = 15 SE +/- 21.03, N = 15 SE +/- 4.42, N = 15 SE +/- 16.82, N = 15 SE +/- 22.57, N = 12 SE +/- 36.81, N = 15 SE +/- 27.25, N = 15 SE +/- 25.28, N = 15 SE +/- 14.83, N = 5 SE +/- 9.87, N = 3 SE +/- 2.60, N = 3 SE +/- 13.06, N = 15 1342 1354 617 169 1177 1170 1409 1164 601 1154 904 464 945
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 3K 6K 9K 12K 15K SE +/- 88.19, N = 3 SE +/- 88.19, N = 3 SE +/- 22.91, N = 3 SE +/- 179.70, N = 4 SE +/- 136.51, N = 15 SE +/- 176.38, N = 3 SE +/- 115.33, N = 15 SE +/- 115.47, N = 3 SE +/- 107.29, N = 15 SE +/- 57.74, N = 3 SE +/- 51.66, N = 10 SE +/- 143.53, N = 5 11700 12133 10767 5047 12025 12333 12467 13233 11300 12547 11900 5737 11740
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 50 100 150 200 250 SE +/- 2.52, N = 3 SE +/- 3.12, N = 15 SE +/- 2.19, N = 3 SE +/- 2.30, N = 15 SE +/- 1.66, N = 13 SE +/- 2.71, N = 4 SE +/- 2.67, N = 3 SE +/- 1.20, N = 3 SE +/- 2.04, N = 15 SE +/- 1.45, N = 3 SE +/- 2.60, N = 3 SE +/- 2.40, N = 3 212 225 229 228 200 211 214 212 176 216 213 220 208
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 100 200 300 400 500 SE +/- 1.76, N = 3 SE +/- 5.71, N = 15 SE +/- 4.81, N = 3 SE +/- 5.80, N = 5 SE +/- 6.01, N = 3 SE +/- 5.21, N = 3 SE +/- 3.76, N = 3 SE +/- 1.76, N = 3 SE +/- 3.78, N = 15 SE +/- 2.33, N = 3 SE +/- 6.64, N = 3 SE +/- 6.84, N = 3 SE +/- 1.53, N = 3 426 442 446 460 374 402 423 412 364 430 417 417 438
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 200 400 600 800 1000 SE +/- 4.73, N = 3 SE +/- 10.12, N = 15 SE +/- 7.51, N = 3 SE +/- 7.69, N = 3 SE +/- 5.70, N = 3 SE +/- 6.33, N = 3 SE +/- 7.70, N = 15 SE +/- 12.37, N = 15 SE +/- 3.93, N = 3 SE +/- 9.13, N = 3 SE +/- 7.36, N = 3 SE +/- 10.56, N = 15 SE +/- 5.90, N = 3 820 860 865 928 750 804 835 810 694 839 801 841 822
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 700 1400 2100 2800 3500 SE +/- 38.07, N = 4 SE +/- 43.44, N = 4 SE +/- 24.67, N = 3 SE +/- 32.24, N = 8 SE +/- 8.50, N = 3 SE +/- 10.58, N = 3 SE +/- 34.87, N = 15 SE +/- 7.45, N = 3 SE +/- 34.35, N = 3 SE +/- 37.55, N = 3 SE +/- 10.33, N = 3 SE +/- 24.31, N = 15 SE +/- 13.65, N = 3 2917 3150 2997 3217 2755 2906 2944 3028 2626 2850 3082 2903 2893
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 700 1400 2100 2800 3500 SE +/- 57.43, N = 15 SE +/- 49.81, N = 15 SE +/- 19.74, N = 15 SE +/- 4.19, N = 15 SE +/- 53.58, N = 15 SE +/- 57.13, N = 15 SE +/- 80.74, N = 15 SE +/- 26.21, N = 3 SE +/- 20.61, N = 15 SE +/- 71.45, N = 15 SE +/- 65.35, N = 12 SE +/- 27.56, N = 15 SE +/- 122.35, N = 12 3393 2678 619 162 3147 3293 3316 2574 612 2502 2550 1548 2533
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 50 100 150 200 250 SE +/- 2.36, N = 15 SE +/- 2.72, N = 4 SE +/- 0.76, N = 15 SE +/- 1.00, N = 15 SE +/- 1.06, N = 15 SE +/- 2.60, N = 3 SE +/- 2.19, N = 3 SE +/- 2.91, N = 3 SE +/- 2.09, N = 15 SE +/- 0.95, N = 3 SE +/- 2.52, N = 3 204.00 206.00 159.00 65.83 96.37 92.61 199.00 193.00 130.00 194.00 171.00 65.73 167.00
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 80 160 240 320 400 SE +/- 3.51, N = 15 SE +/- 2.00, N = 3 SE +/- 2.08, N = 3 SE +/- 1.20, N = 3 SE +/- 3.70, N = 12 SE +/- 2.91, N = 15 SE +/- 4.16, N = 3 SE +/- 2.66, N = 15 SE +/- 4.59, N = 4 SE +/- 2.76, N = 15 SE +/- 1.00, N = 3 SE +/- 4.08, N = 15 373 363 256 102 191 181 369 349 223 325 303 133 291
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 140 280 420 560 700 SE +/- 10.40, N = 3 SE +/- 8.69, N = 3 SE +/- 3.61, N = 3 SE +/- 2.12, N = 15 SE +/- 4.18, N = 15 SE +/- 5.36, N = 3 SE +/- 7.11, N = 15 SE +/- 6.12, N = 6 SE +/- 6.17, N = 3 SE +/- 5.46, N = 3 SE +/- 4.71, N = 15 SE +/- 3.04, N = 5 SE +/- 7.69, N = 3 625 610 415 140 378 381 628 534 373 503 519 231 493
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test Directory ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 300 600 900 1200 1500 SE +/- 17.28, N = 15 SE +/- 29.00, N = 15 SE +/- 18.13, N = 12 SE +/- 5.51, N = 12 SE +/- 12.77, N = 15 SE +/- 17.89, N = 15 SE +/- 18.33, N = 3 SE +/- 9.40, N = 3 SE +/- 37.86, N = 12 SE +/- 25.11, N = 15 SE +/- 5.91, N = 15 SE +/- 14.28, N = 15 1360 1500 585 187 1153 1486 1190 601 1152 1233 633 1210
IOzone The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Read Performance ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 400 800 1200 1600 2000 SE +/- 39.76, N = 15 SE +/- 28.21, N = 3 SE +/- 19.59, N = 15 SE +/- 8.14, N = 3 SE +/- 38.22, N = 15 SE +/- 33.35, N = 15 SE +/- 31.29, N = 3 SE +/- 23.36, N = 5 SE +/- 7.34, N = 3 SE +/- 32.92, N = 15 SE +/- 19.66, N = 15 SE +/- 24.78, N = 3 SE +/- 22.67, N = 3 1867.17 1852.57 1492.24 699.92 1885.86 1929.75 1896.74 1893.33 1611.63 1901.82 1855.03 1787.43 1972.18
OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performance ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 130 260 390 520 650 SE +/- 8.16, N = 3 SE +/- 1.57, N = 3 SE +/- 3.62, N = 3 SE +/- 5.26, N = 12 SE +/- 6.91, N = 3 SE +/- 8.65, N = 4 SE +/- 8.49, N = 3 SE +/- 6.39, N = 3 SE +/- 5.81, N = 5 SE +/- 6.80, N = 5 SE +/- 4.68, N = 3 SE +/- 6.81, N = 3 SE +/- 5.19, N = 15 561.17 563.02 437.64 296.75 576.96 580.74 573.83 561.94 459.38 551.31 539.59 526.52 571.72
OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 300 600 900 1200 1500 SE +/- 28.65, N = 15 SE +/- 14.89, N = 15 SE +/- 7.98, N = 15 SE +/- 1.51, N = 3 SE +/- 12.35, N = 10 SE +/- 27.59, N = 14 SE +/- 11.40, N = 3 SE +/- 29.58, N = 12 SE +/- 4.23, N = 3 SE +/- 37.94, N = 15 SE +/- 20.17, N = 15 SE +/- 13.11, N = 15 SE +/- 29.59, N = 15 1027.92 1150.28 748.10 254.89 1364.73 1016.09 1326.99 1043.66 606.42 1072.11 1133.03 925.75 1007.22
OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 140 280 420 560 700 SE +/- 2.40, N = 3 SE +/- 7.97, N = 3 SE +/- 2.28, N = 3 SE +/- 3.44, N = 3 SE +/- 4.73, N = 3 SE +/- 2.00, N = 3 SE +/- 10.20, N = 3 SE +/- 8.83, N = 15 SE +/- 4.57, N = 3 SE +/- 8.87, N = 15 SE +/- 7.62, N = 15 SE +/- 1.76, N = 3 SE +/- 10.50, N = 15 439.51 622.91 565.58 243.93 648.44 446.27 615.63 395.38 396.63 552.19 542.85 426.39 485.37
OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performance ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 200 400 600 800 1000 SE +/- 11.87, N = 3 SE +/- 11.05, N = 3 SE +/- 6.93, N = 3 SE +/- 4.64, N = 15 SE +/- 12.19, N = 3 SE +/- 12.53, N = 3 SE +/- 9.96, N = 5 SE +/- 6.94, N = 11 SE +/- 6.68, N = 3 SE +/- 9.09, N = 15 SE +/- 5.12, N = 3 SE +/- 7.14, N = 3 SE +/- 10.06, N = 4 807.93 833.63 655.99 408.54 875.13 835.14 826.00 792.23 644.41 810.39 806.79 799.85 786.52
OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance ZFS 128k - QCOW2 64k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 64k ZFS 16k - QCOW2 16k - NTFS 16k ZFS 4k - QCOW2 4k - NTFS - 4k ZFS 128k - QCOW2 128k - NTFS 64k ZFS 128k - QCOW2 128k - NTFS 4k ZFS 128k - QCOW2 64k - NTFS 64k ZFS 64k - QCOW2 64K - NTFS 4k ZFS 16k - QCOW2 16k - NTFS 4k ZFS 64k - QCOW2 64k - NTFS 16k ZFS 64k - QCOW2 16k - NTFS 16k ZFS 64k - QCOW2 4k - NTFS 4k ZFS 64k - QCOW2 16k - NTFS 4k 300 600 900 1200 1500 SE +/- 20.93, N = 12 SE +/- 13.91, N = 15 SE +/- 11.06, N = 15 SE +/- 3.55, N = 4 SE +/- 18.61, N = 4 SE +/- 11.60, N = 6 SE +/- 11.98, N = 3 SE +/- 6.36, N = 3 SE +/- 3.74, N = 3 SE +/- 13.45, N = 5 SE +/- 14.52, N = 5 SE +/- 23.22, N = 13 SE +/- 29.69, N = 15 947.01 1154.15 743.78 266.34 1293.46 951.01 1318.79 808.15 583.25 1125.91 1089.60 908.61 977.73
ZFS 128k - QCOW2 64k - NTFS 4k Testing initiated at 11 June 2019 11:14 by user PTS Tester.
ZFS 64k - QCOW2 64k - NTFS 64k Testing initiated at 7 June 2019 08:46 by user PTS Tester.
ZFS 16k - QCOW2 16k - NTFS 16k Testing initiated at 10 June 2019 07:53 by user PTS Tester.
ZFS 4k - QCOW2 4k - NTFS - 4k Testing initiated at 7 June 2019 12:31 by user PTS Tester.
ZFS 128k - QCOW2 128k - NTFS 64k Testing initiated at 12 June 2019 10:58 by user PTS Tester.
ZFS 128k - QCOW2 128k - NTFS 4k Testing initiated at 11 June 2019 15:11 by user PTS Tester.
ZFS 128k - QCOW2 64k - NTFS 64k Testing initiated at 12 June 2019 13:57 by user PTS Tester.
ZFS 64k - QCOW2 64K - NTFS 4k Testing initiated at 7 June 2019 22:16 by user PTS Tester.
ZFS 16k - QCOW2 16k - NTFS 4k Testing initiated at 8 June 2019 00:19 by user PTS Tester.
ZFS 64k - QCOW2 64k - NTFS 16k Testing initiated at 10 June 2019 13:50 by user PTS Tester.
ZFS 64k - QCOW2 16k - NTFS 16k Testing initiated at 10 June 2019 16:31 by user PTS Tester.
ZFS 64k - QCOW2 4k - NTFS 4k Testing initiated at 7 June 2019 19:43 by user PTS Tester.
ZFS 64k - QCOW2 16k - NTFS 4k Processor: 2 x Intel Xeon (Skylake IBRS) @ 2.10GHz (2 Cores), Motherboard: (0.5.1 BIOS), Memory: 1 x 4096 MB, Disk: 40GB Red Hat VirtIO, Graphics: Microsoft Basic Display
OS: Microsoft Windows 10 Enterprise Evaluation Build 18362, Kernel: 10.0 (x86_64), Display Driver: 10.0.18362.1, File-System: NTFS, Screen Resolution: 1024x768
Testing initiated at 9 June 2019 13:22 by user PTS Tester.