ZFS + KVM + NTFS Benchmarking Various Record Sizes


This benchmark aims to identify optimal combination of record sizes (i.e., recordsize for ZFS, cluster_size for QCOW2, allocation unit size for NTFS) for a Windows 10 Guest VM running on top of ZFS + KVM.

Host: Dual Intel Xeon 6130 @ 2.10GHz, 384GB RAM, CentOS 7.6 Virtualization Base Environment, ZFS 0.8.0 via EPEL zfs-testing repository

ZFS Config: 4 x RAIDZ2 (5 x 8TB 7.2K HDD) + 2 x OPTANE 900 280GB SLOG MIRROR + OPTANE 900 480GB CACHE

Windows Guest: 2 vCPUs, 4GB RAM, 40 GB QCOW2 (bus:virtio, cache:writeback, io:default, cluster size 4k ~ 64k)

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1906108-HV-MERGE807489
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
ZFS 64k - QCOW2 64k - NTFS 64k
June 07 2019
  1 Hour, 55 Minutes
ZFS 16k - QCOW2 16k - NTFS 16k
June 10 2019
  1 Hour, 56 Minutes
ZFS 4k - QCOW2 4k - NTFS - 4k
June 07 2019
  2 Hours, 55 Minutes
ZFS 64k - QCOW2 64K - NTFS 4k
June 07 2019
  1 Hour, 34 Minutes
ZFS 16k - QCOW2 16k - NTFS 4k
June 08 2019
  1 Hour, 38 Minutes
ZFS 64k - QCOW2 64k - NTFS 16k
June 10 2019
  2 Hours, 4 Minutes
ZFS 64k - QCOW2 16k - NTFS 16k
June 10 2019
  1 Hour, 50 Minutes
ZFS 64k - QCOW2 4k - NTFS 4k
June 07 2019
  1 Hour, 35 Minutes
ZFS 64k - QCOW2 16k - NTFS 4k
June 09 2019
  1 Hour, 55 Minutes
Invert Hiding All Results Option
  1 Hour, 56 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

ZFS 64k - QCOW2 64k - NTFS 64k

ZFS 4k - QCOW2 4k - NTFS - 4k

ZFS 64k - QCOW2 4k - NTFS 4k

ZFS 64k - QCOW2 64K - NTFS 4k

ZFS 16k - QCOW2 16k - NTFS 4k

ZFS 64k - QCOW2 16k - NTFS 4k

ZFS 16k - QCOW2 16k - NTFS 16k

ZFS 64k - QCOW2 64k - NTFS 16k

ZFS 64k - QCOW2 16k - NTFS 16k

Processor: 2 x Intel Xeon (Skylake IBRS) @ 2.10GHz (2 Cores), Motherboard: (0.5.1 BIOS), Memory: 1 x 4096 MB, Disk: 40GB Red Hat VirtIO, Graphics: Microsoft Basic Display

OS: Microsoft Windows 10 Enterprise Evaluation Build 18362, Kernel: 10.0 (x86_64), Display Driver: 10.0.18362.1, File-System: NTFS, Screen Resolution: 1024x768

ZFS + KVM + NTFS Benchmarking Various Record SizesOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon (Skylake IBRS) @ 2.10GHz (2 Cores)(0.5.1 BIOS)1 x 4096 MB40GB Red Hat VirtIOMicrosoft Basic DisplayMicrosoft Windows 10 Enterprise Evaluation Build 1836210.0 (x86_64)10.0.18362.1NTFS1024x768ProcessorMotherboardMemoryDiskGraphicsOSKernelDisplay DriverFile-SystemScreen ResolutionZFS + KVM + NTFS Benchmarking Various Record Sizes PerformanceSystem Logs

ZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kLogarithmic Result OverviewPhoronix Test SuiteFlexible IO TesterFlexible IO TesterIOzoneFlexible IO TesterIOzoneFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterIOzoneFlexible IO TesterIOzoneFlexible IO TesterFlexible IO TesterFlexible IO TesterIOzoneFlexible IO TesterFlexible IO TesterFlexible IO TesterIOzoneFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterSeq Write - Windows AIO - No - Yes - 64KBRand Write - Windows AIO - No - Yes - 64KB1MB - 8GB - Write PerformanceSeq Write - Windows AIO - No - Yes - 16KB64Kb - 8GB - Write PerformanceRand Write - Windows AIO - No - Yes - 16KBSeq Write - Windows AIO - No - Yes - 8KBRand Write - Windows AIO - No - Yes - 8KBSeq Write - Windows AIO - No - Yes - 4KBRand Write - Windows AIO - No - Yes - 4KBRand Read - Windows AIO - No - Yes - 1MB1MB - 8GB - Read PerformanceSeq Read - Windows AIO - No - Yes - 1MB4Kb - 8GB - Write PerformanceRand Read - Windows AIO - No - Yes - 8KBRand Read - Windows AIO - No - Yes - 4KBRand Read - Windows AIO - No - Yes - 16KB64Kb - 8GB - Read PerformanceRand Read - Windows AIO - No - Yes - 64KBSeq Write - Windows AIO - No - Yes - 1MBRand Write - Windows AIO - No - Yes - 1MB4Kb - 8GB - Read PerformanceSeq Read - Windows AIO - No - Yes - 16KBSeq Read - Windows AIO - No - Yes - 4KBSeq Read - Windows AIO - No - Yes - 8KBSeq Read - Windows AIO - No - Yes - 64KB

ZFS + KVM + NTFS Benchmarking Various Record Sizesfio: Rand Read - Windows AIO - No - Yes - 1MBfio: Rand Read - Windows AIO - No - Yes - 4KBfio: Rand Read - Windows AIO - No - Yes - 8KBfio: Rand Read - Windows AIO - No - Yes - 16KBfio: Rand Read - Windows AIO - No - Yes - 64KBfio: Rand Write - Windows AIO - No - Yes - 1MBfio: Rand Write - Windows AIO - No - Yes - 4KBfio: Rand Write - Windows AIO - No - Yes - 8KBfio: Rand Write - Windows AIO - No - Yes - 16KBfio: Rand Write - Windows AIO - No - Yes - 64KBfio: Seq Read - Windows AIO - No - Yes - 1MBfio: Seq Read - Windows AIO - No - Yes - 4KBfio: Seq Read - Windows AIO - No - Yes - 8KBfio: Seq Read - Windows AIO - No - Yes - 16KBfio: Seq Read - Windows AIO - No - Yes - 64KBfio: Seq Write - Windows AIO - No - Yes - 1MBfio: Seq Write - Windows AIO - No - Yes - 4KBfio: Seq Write - Windows AIO - No - Yes - 8KBfio: Seq Write - Windows AIO - No - Yes - 16KBfio: Seq Write - Windows AIO - No - Yes - 64KBiozone: 1MB - 8GB - Read Performanceiozone: 4Kb - 8GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performanceiozone: 64Kb - 8GB - Read Performanceiozone: 64Kb - 8GB - Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k11500234463831286827431252474471354121332254428603150267820636361015001852.57563.021150.28622.91833.631154.154191104.47198433146016642.3074.461181695047228460928321716265.83102140187699.92296.75254.89243.93408.54266.3452701102283971423123640.2379.7915546457372204178412903154865.731332316331787.43526.52925.75426.39799.85908.6112875211408791289626951232334541164132332124128103028257419334953411901893.33561.941043.66395.38792.23808.159830126252500200264173.901422756011130017636469426266121302233736011611.63459.38606.42396.63644.41583.2590071532945922195264188.98171313945117402084388222893253316729149312101972.18571.721007.22485.37786.52977.737675146288578205865782.411552826171076722944686529976191592564155851492.24437.64748.10565.58655.99743.7812853211420830280924061192384371154125472164308392850250219432550311521901.82551.311072.11552.19810.391125.9198591603246402460257382.13165305904119002134178013082255017130351912331855.03539.591133.03542.85806.791089.60OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k3K6K9K12K15KSE +/- 210.22, N = 15SE +/- 37.82, N = 3SE +/- 41.46, N = 3SE +/- 130.59, N = 8SE +/- 75.55, N = 3SE +/- 59.54, N = 3SE +/- 106.26, N = 4SE +/- 139.00, N = 15SE +/- 108.50, N = 3115004191527012875983090077675128539859
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2K4K6K8K10KMin: 10000 / Avg: 11500 / Max: 13300Min: 4126 / Avg: 4191 / Max: 4257Min: 5220 / Avg: 5269.67 / Max: 5352Min: 12400 / Avg: 12875 / Max: 13300Min: 9681 / Avg: 9830.33 / Max: 9925Min: 8891 / Avg: 9006.67 / Max: 9089Min: 7368 / Avg: 7674.5 / Max: 7850Min: 12000 / Avg: 12853.33 / Max: 13600Min: 9644 / Avg: 9859 / Max: 9992

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k50100150200250SE +/- 3.84, N = 3SE +/- 1.04, N = 15SE +/- 1.00, N = 3SE +/- 2.33, N = 3SE +/- 1.24, N = 15SE +/- 2.19, N = 3SE +/- 2.03, N = 3SE +/- 2.96, N = 15SE +/- 2.52, N = 15234.00104.47110.00211.00126.00153.00146.00211.00160.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k4080120160200Min: 230 / Avg: 234.33 / Max: 242Min: 99.2 / Avg: 104.47 / Max: 113Min: 109 / Avg: 110 / Max: 112Min: 207 / Avg: 210.67 / Max: 215Min: 113 / Avg: 125.6 / Max: 132Min: 149 / Avg: 153.33 / Max: 156Min: 143 / Avg: 146.33 / Max: 150Min: 177 / Avg: 210.53 / Max: 220Min: 142 / Avg: 160 / Max: 173

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k100200300400500SE +/- 7.21, N = 15SE +/- 2.74, N = 4SE +/- 1.20, N = 3SE +/- 3.06, N = 3SE +/- 3.79, N = 3SE +/- 2.45, N = 15SE +/- 2.60, N = 3SE +/- 5.09, N = 15SE +/- 3.89, N = 6463198228408252294288420324
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k80160240320400Min: 412 / Avg: 462.53 / Max: 505Min: 191 / Avg: 198 / Max: 204Min: 226 / Avg: 227.67 / Max: 230Min: 404 / Avg: 408 / Max: 414Min: 245 / Avg: 252 / Max: 258Min: 284 / Avg: 294.27 / Max: 316Min: 284 / Avg: 288.33 / Max: 293Min: 384 / Avg: 420.47 / Max: 457Min: 316 / Avg: 324.17 / Max: 340

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000SE +/- 11.79, N = 3SE +/- 4.95, N = 15SE +/- 4.97, N = 15SE +/- 9.43, N = 15SE +/- 5.49, N = 15SE +/- 5.24, N = 3SE +/- 5.76, N = 15SE +/- 8.01, N = 15SE +/- 7.55, N = 3831433397791500592578830640
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k150300450600750Min: 808 / Avg: 831.33 / Max: 846Min: 402 / Avg: 433.4 / Max: 472Min: 350 / Avg: 397.27 / Max: 428Min: 742 / Avg: 791.27 / Max: 864Min: 468 / Avg: 500.27 / Max: 542Min: 582 / Avg: 591.67 / Max: 600Min: 546 / Avg: 578.33 / Max: 618Min: 771 / Avg: 830.27 / Max: 875Min: 631 / Avg: 640 / Max: 655

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k6001200180024003000SE +/- 30.89, N = 15SE +/- 17.41, N = 15SE +/- 20.58, N = 3SE +/- 29.53, N = 8SE +/- 23.87, N = 15SE +/- 26.34, N = 15SE +/- 21.48, N = 15SE +/- 34.30, N = 5SE +/- 21.63, N = 13286814601423289620022195205828092460
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k5001000150020002500Min: 2647 / Avg: 2868.47 / Max: 3095Min: 1354 / Avg: 1460.27 / Max: 1589Min: 1394 / Avg: 1423.33 / Max: 1463Min: 2807 / Avg: 2896.25 / Max: 3023Min: 1856 / Avg: 2002 / Max: 2146Min: 2074 / Avg: 2194.53 / Max: 2409Min: 1925 / Avg: 2058.07 / Max: 2170Min: 2698 / Avg: 2808.6 / Max: 2909Min: 2244 / Avg: 2460.31 / Max: 2535

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k6001200180024003000SE +/- 57.14, N = 15SE +/- 5.04, N = 15SE +/- 22.28, N = 15SE +/- 28.67, N = 3SE +/- 25.74, N = 15SE +/- 76.03, N = 15SE +/- 13.92, N = 15SE +/- 78.39, N = 15SE +/- 69.43, N = 15274316612362695641264165724062573
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k5001000150020002500Min: 2284 / Avg: 2742.53 / Max: 3226Min: 142 / Avg: 165.87 / Max: 201Min: 1043 / Avg: 1235.73 / Max: 1379Min: 2666 / Avg: 2694.67 / Max: 2752Min: 536 / Avg: 641.13 / Max: 907Min: 1982 / Avg: 2640.93 / Max: 3200Min: 561 / Avg: 656.93 / Max: 770Min: 1853 / Avg: 2406.47 / Max: 2922Min: 2026 / Avg: 2573 / Max: 2972

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k306090120150SE +/- 1.41, N = 15SE +/- 0.25, N = 3SE +/- 0.15, N = 3SE +/- 1.76, N = 3SE +/- 1.04, N = 3SE +/- 1.41, N = 15SE +/- 0.95, N = 15SE +/- 0.71, N = 15125.0042.3040.23123.0073.9088.9882.41119.0082.13
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k20406080100Min: 117 / Avg: 124.73 / Max: 136Min: 41.8 / Avg: 42.3 / Max: 42.6Min: 40 / Avg: 40.23 / Max: 40.5Min: 120 / Avg: 122.67 / Max: 126Min: 72.2 / Avg: 73.9 / Max: 75.8Min: 80 / Avg: 88.98 / Max: 94.9Min: 78.2 / Avg: 82.41 / Max: 88.9Min: 77.5 / Avg: 82.13 / Max: 88.3

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k50100150200250SE +/- 3.79, N = 3SE +/- 1.40, N = 12SE +/- 0.63, N = 14SE +/- 3.01, N = 15SE +/- 1.46, N = 15SE +/- 1.76, N = 3SE +/- 2.40, N = 3247.0074.4679.79233.00142.00171.00155.00238.00165.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k4080120160200Min: 240 / Avg: 247 / Max: 253Min: 68.3 / Avg: 74.46 / Max: 83Min: 75.2 / Avg: 79.79 / Max: 83.7Min: 221 / Avg: 232.53 / Max: 255Min: 143 / Avg: 155.33 / Max: 164Min: 235 / Avg: 237.67 / Max: 241Min: 162 / Avg: 165.33 / Max: 170

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k100200300400500SE +/- 4.37, N = 3SE +/- 1.39, N = 15SE +/- 0.88, N = 3SE +/- 3.71, N = 3SE +/- 2.08, N = 3SE +/- 3.37, N = 15SE +/- 4.19, N = 9SE +/- 4.98, N = 3447118155454275313282437305
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k80160240320400Min: 438 / Avg: 446.67 / Max: 452Min: 112 / Avg: 117.53 / Max: 128Min: 153 / Avg: 154.67 / Max: 156Min: 270 / Avg: 274.67 / Max: 282Min: 309 / Avg: 313 / Max: 316Min: 262 / Avg: 281.93 / Max: 304Min: 417 / Avg: 437.44 / Max: 456Min: 297 / Avg: 304.67 / Max: 314

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k30060090012001500SE +/- 28.55, N = 15SE +/- 4.42, N = 15SE +/- 2.60, N = 3SE +/- 27.25, N = 15SE +/- 25.28, N = 15SE +/- 13.06, N = 15SE +/- 21.03, N = 15SE +/- 14.83, N = 5SE +/- 9.87, N = 3135416946411646019456171154904
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000Min: 1124 / Avg: 1353.6 / Max: 1528Min: 145 / Avg: 168.93 / Max: 198Min: 459 / Avg: 463.67 / Max: 468Min: 1007 / Avg: 1163.8 / Max: 1405Min: 491 / Avg: 601 / Max: 879Min: 855 / Avg: 944.93 / Max: 1012Min: 499 / Avg: 616.93 / Max: 725Min: 1107 / Avg: 1153.6 / Max: 1181Min: 884 / Avg: 903.67 / Max: 915

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k3K6K9K12K15KSE +/- 88.19, N = 3SE +/- 22.91, N = 3SE +/- 51.66, N = 10SE +/- 115.33, N = 15SE +/- 115.47, N = 3SE +/- 143.53, N = 5SE +/- 88.19, N = 3SE +/- 107.29, N = 15SE +/- 57.74, N = 31213350475737132331130011740107671254711900
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2K4K6K8K10KMin: 12000 / Avg: 12133.33 / Max: 12300Min: 5010 / Avg: 5047.33 / Max: 5089Min: 5450 / Avg: 5736.7 / Max: 5923Min: 12300 / Avg: 13233.33 / Max: 13900Min: 11100 / Avg: 11300 / Max: 11500Min: 11500 / Avg: 11740 / Max: 12300Min: 10600 / Avg: 10766.67 / Max: 10900Min: 12000 / Avg: 12546.67 / Max: 13300Min: 11800 / Avg: 11900 / Max: 12000

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k50100150200250SE +/- 3.12, N = 15SE +/- 2.30, N = 15SE +/- 2.60, N = 3SE +/- 1.20, N = 3SE +/- 2.40, N = 3SE +/- 2.19, N = 3SE +/- 2.04, N = 15SE +/- 1.45, N = 3225228220212176208229216213
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k4080120160200Min: 209 / Avg: 225.13 / Max: 247Min: 206 / Avg: 228.33 / Max: 241Min: 216 / Avg: 220.33 / Max: 225Min: 174 / Avg: 176.33 / Max: 178Min: 205 / Avg: 208.33 / Max: 213Min: 226 / Avg: 228.67 / Max: 233Min: 205 / Avg: 216.13 / Max: 227Min: 211 / Avg: 213.33 / Max: 216

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k100200300400500SE +/- 5.71, N = 15SE +/- 5.80, N = 5SE +/- 6.84, N = 3SE +/- 1.76, N = 3SE +/- 3.78, N = 15SE +/- 1.53, N = 3SE +/- 4.81, N = 3SE +/- 2.33, N = 3SE +/- 6.64, N = 3442460417412364438446430417
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k80160240320400Min: 414 / Avg: 442.33 / Max: 493Min: 440 / Avg: 460.4 / Max: 473Min: 403 / Avg: 416.67 / Max: 424Min: 409 / Avg: 411.67 / Max: 415Min: 342 / Avg: 364.33 / Max: 390Min: 435 / Avg: 438 / Max: 440Min: 437 / Avg: 446.33 / Max: 453Min: 426 / Avg: 429.67 / Max: 434Min: 405 / Avg: 416.67 / Max: 428

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000SE +/- 10.12, N = 15SE +/- 7.69, N = 3SE +/- 10.56, N = 15SE +/- 12.37, N = 15SE +/- 3.93, N = 3SE +/- 5.90, N = 3SE +/- 7.51, N = 3SE +/- 9.13, N = 3SE +/- 7.36, N = 3860928841810694822865839801
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k160320480640800Min: 806 / Avg: 859.73 / Max: 975Min: 913 / Avg: 927.67 / Max: 939Min: 788 / Avg: 840.8 / Max: 954Min: 711 / Avg: 810 / Max: 900Min: 686 / Avg: 693.67 / Max: 699Min: 810 / Avg: 821.67 / Max: 829Min: 852 / Avg: 865 / Max: 878Min: 825 / Avg: 838.67 / Max: 856Min: 786 / Avg: 800.67 / Max: 809

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k7001400210028003500SE +/- 43.44, N = 4SE +/- 32.24, N = 8SE +/- 24.31, N = 15SE +/- 7.45, N = 3SE +/- 34.35, N = 3SE +/- 13.65, N = 3SE +/- 24.67, N = 3SE +/- 37.55, N = 3SE +/- 10.33, N = 3315032172903302826262893299728503082
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k6001200180024003000Min: 3081 / Avg: 3149.5 / Max: 3264Min: 3085 / Avg: 3216.88 / Max: 3353Min: 2734 / Avg: 2903.47 / Max: 3076Min: 3014 / Avg: 3028.33 / Max: 3039Min: 2577 / Avg: 2625.67 / Max: 2692Min: 2876 / Avg: 2893 / Max: 2920Min: 2948 / Avg: 2996.67 / Max: 3028Min: 2786 / Avg: 2849.67 / Max: 2916Min: 3062 / Avg: 3081.67 / Max: 3097

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k6001200180024003000SE +/- 49.81, N = 15SE +/- 4.19, N = 15SE +/- 27.56, N = 15SE +/- 26.21, N = 3SE +/- 20.61, N = 15SE +/- 122.35, N = 12SE +/- 19.74, N = 15SE +/- 71.45, N = 15SE +/- 65.35, N = 12267816215482574612253361925022550
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k5001000150020002500Min: 2432 / Avg: 2678.07 / Max: 3109Min: 138 / Avg: 162.07 / Max: 201Min: 1277 / Avg: 1547.67 / Max: 1705Min: 2523 / Avg: 2574 / Max: 2610Min: 508 / Avg: 612.47 / Max: 796Min: 1398 / Avg: 2532.67 / Max: 2984Min: 480 / Avg: 618.87 / Max: 714Min: 2002 / Avg: 2501.67 / Max: 3064Min: 2060 / Avg: 2550.25 / Max: 2862

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k50100150200250SE +/- 2.72, N = 4SE +/- 0.76, N = 15SE +/- 0.95, N = 3SE +/- 2.60, N = 3SE +/- 2.19, N = 3SE +/- 2.52, N = 3SE +/- 2.91, N = 3SE +/- 2.09, N = 15206.0065.8365.73193.00130.00167.00159.00194.00171.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k4080120160200Min: 199 / Avg: 206.25 / Max: 212Min: 62.7 / Avg: 65.83 / Max: 72.9Min: 64.5 / Avg: 65.73 / Max: 67.6Min: 188 / Avg: 192.67 / Max: 197Min: 126 / Avg: 130.33 / Max: 133Min: 164 / Avg: 167 / Max: 172Min: 189 / Avg: 194.33 / Max: 199Min: 155 / Avg: 170.87 / Max: 181

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k80160240320400SE +/- 2.00, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 4.16, N = 3SE +/- 2.66, N = 15SE +/- 4.08, N = 15SE +/- 2.08, N = 3SE +/- 4.59, N = 4SE +/- 2.76, N = 15363102133349223291256325303
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k60120180240300Min: 361 / Avg: 363 / Max: 367Min: 100 / Avg: 102.33 / Max: 104Min: 131 / Avg: 133 / Max: 134Min: 343 / Avg: 349 / Max: 357Min: 205 / Avg: 223 / Max: 242Min: 275 / Avg: 290.73 / Max: 330Min: 253 / Avg: 256 / Max: 260Min: 311 / Avg: 324.75 / Max: 330Min: 283 / Avg: 302.8 / Max: 328

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k130260390520650SE +/- 8.69, N = 3SE +/- 2.12, N = 15SE +/- 3.04, N = 5SE +/- 6.12, N = 6SE +/- 6.17, N = 3SE +/- 7.69, N = 3SE +/- 3.61, N = 3SE +/- 5.46, N = 3SE +/- 4.71, N = 15610140231534373493415503519
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k110220330440550Min: 600 / Avg: 609.67 / Max: 627Min: 128 / Avg: 140.13 / Max: 158Min: 225 / Avg: 230.8 / Max: 241Min: 516 / Avg: 534.17 / Max: 554Min: 361 / Avg: 373.33 / Max: 380Min: 482 / Avg: 493.33 / Max: 508Min: 408 / Avg: 415 / Max: 420Min: 492 / Avg: 502.67 / Max: 510Min: 483 / Avg: 518.73 / Max: 549

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k30060090012001500SE +/- 29.00, N = 15SE +/- 5.51, N = 12SE +/- 5.91, N = 15SE +/- 18.33, N = 3SE +/- 9.40, N = 3SE +/- 14.28, N = 15SE +/- 18.13, N = 12SE +/- 37.86, N = 12SE +/- 25.11, N = 1515001876331190601121058511521233
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KBZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k30060090012001500Min: 1301 / Avg: 1499.87 / Max: 1665Min: 161 / Avg: 187.17 / Max: 224Min: 589 / Avg: 633.33 / Max: 671Min: 1153 / Avg: 1189.67 / Max: 1208Min: 582 / Avg: 600.67 / Max: 612Min: 1120 / Avg: 1209.87 / Max: 1310Min: 486 / Avg: 584.5 / Max: 679Min: 914 / Avg: 1151.5 / Max: 1389Min: 1105 / Avg: 1232.6 / Max: 1370

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k400800120016002000SE +/- 28.21, N = 3SE +/- 8.14, N = 3SE +/- 24.78, N = 3SE +/- 23.36, N = 5SE +/- 7.34, N = 3SE +/- 22.67, N = 3SE +/- 19.59, N = 15SE +/- 32.92, N = 15SE +/- 19.66, N = 151852.57699.921787.431893.331611.631972.181492.241901.821855.03
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k30060090012001500Min: 1821.85 / Avg: 1852.57 / Max: 1908.91Min: 690.65 / Avg: 699.92 / Max: 716.14Min: 1750.19 / Avg: 1787.43 / Max: 1834.36Min: 1845.13 / Avg: 1893.33 / Max: 1979.22Min: 1596.95 / Avg: 1611.63 / Max: 1619.33Min: 1938.27 / Avg: 1972.18 / Max: 2015.19Min: 1377.88 / Avg: 1492.24 / Max: 1642.66Min: 1765.84 / Avg: 1901.82 / Max: 2136.59Min: 1766.38 / Avg: 1855.03 / Max: 2065.11

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k120240360480600SE +/- 1.57, N = 3SE +/- 5.26, N = 12SE +/- 6.81, N = 3SE +/- 6.39, N = 3SE +/- 5.81, N = 5SE +/- 5.19, N = 15SE +/- 3.62, N = 3SE +/- 6.80, N = 5SE +/- 4.68, N = 3563.02296.75526.52561.94459.38571.72437.64551.31539.59
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k100200300400500Min: 559.87 / Avg: 563.02 / Max: 564.7Min: 269.77 / Avg: 296.75 / Max: 326.25Min: 514.06 / Avg: 526.52 / Max: 537.53Min: 553.22 / Avg: 561.94 / Max: 574.4Min: 443.96 / Avg: 459.38 / Max: 476.8Min: 541.68 / Avg: 571.72 / Max: 604.4Min: 431.13 / Avg: 437.64 / Max: 443.63Min: 539.01 / Avg: 551.31 / Max: 573.56Min: 530.33 / Avg: 539.59 / Max: 545.39

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000SE +/- 14.89, N = 15SE +/- 1.51, N = 3SE +/- 13.11, N = 15SE +/- 29.58, N = 12SE +/- 4.23, N = 3SE +/- 29.59, N = 15SE +/- 7.98, N = 15SE +/- 37.94, N = 15SE +/- 20.17, N = 151150.28254.89925.751043.66606.421007.22748.101072.111133.03
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000Min: 1032.03 / Avg: 1150.28 / Max: 1240.64Min: 252.55 / Avg: 254.89 / Max: 257.71Min: 862.24 / Avg: 925.75 / Max: 1024.93Min: 862.1 / Avg: 1043.66 / Max: 1215.16Min: 600.04 / Avg: 606.42 / Max: 614.43Min: 825.26 / Avg: 1007.22 / Max: 1207.85Min: 667.84 / Avg: 748.1 / Max: 784.98Min: 750.98 / Avg: 1072.11 / Max: 1241.8Min: 1027.55 / Avg: 1133.03 / Max: 1279.57

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k130260390520650SE +/- 7.97, N = 3SE +/- 3.44, N = 3SE +/- 1.76, N = 3SE +/- 8.83, N = 15SE +/- 4.57, N = 3SE +/- 10.50, N = 15SE +/- 2.28, N = 3SE +/- 8.87, N = 15SE +/- 7.62, N = 15622.91243.93426.39395.38396.63485.37565.58552.19542.85
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k110220330440550Min: 606.97 / Avg: 622.91 / Max: 630.97Min: 237.06 / Avg: 243.93 / Max: 247.45Min: 423.13 / Avg: 426.39 / Max: 429.18Min: 357.84 / Avg: 395.38 / Max: 489.41Min: 388.88 / Avg: 396.63 / Max: 404.7Min: 440.43 / Avg: 485.37 / Max: 540.35Min: 561.69 / Avg: 565.58 / Max: 569.59Min: 467.26 / Avg: 552.19 / Max: 597.58Min: 515.7 / Avg: 542.85 / Max: 588.5

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000SE +/- 11.05, N = 3SE +/- 4.64, N = 15SE +/- 7.14, N = 3SE +/- 6.94, N = 11SE +/- 6.68, N = 3SE +/- 10.06, N = 4SE +/- 6.93, N = 3SE +/- 9.09, N = 15SE +/- 5.12, N = 3833.63408.54799.85792.23644.41786.52655.99810.39806.79
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k150300450600750Min: 811.97 / Avg: 833.63 / Max: 848.22Min: 373.86 / Avg: 408.54 / Max: 434.7Min: 789.3 / Avg: 799.85 / Max: 813.45Min: 744.4 / Avg: 792.23 / Max: 823.62Min: 631.5 / Avg: 644.41 / Max: 653.85Min: 763.88 / Avg: 786.52 / Max: 811.55Min: 646.45 / Avg: 655.99 / Max: 669.46Min: 734.83 / Avg: 810.39 / Max: 858.53Min: 797.96 / Avg: 806.79 / Max: 815.7

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000SE +/- 13.91, N = 15SE +/- 3.55, N = 4SE +/- 23.22, N = 13SE +/- 6.36, N = 3SE +/- 3.74, N = 3SE +/- 29.69, N = 15SE +/- 11.06, N = 15SE +/- 13.45, N = 5SE +/- 14.52, N = 51154.15266.34908.61808.15583.25977.73743.781125.911089.60
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16k2004006008001000Min: 1046.31 / Avg: 1154.15 / Max: 1226.73Min: 259.04 / Avg: 266.34 / Max: 275.85Min: 819.67 / Avg: 908.61 / Max: 1087.6Min: 799.04 / Avg: 808.15 / Max: 820.39Min: 576 / Avg: 583.25 / Max: 588.48Min: 828.95 / Avg: 977.73 / Max: 1152.57Min: 649.22 / Avg: 743.78 / Max: 793Min: 1099.15 / Avg: 1125.91 / Max: 1177.69Min: 1060.21 / Avg: 1089.6 / Max: 1132.88

ZFS 64k - QCOW2 64k - NTFS 64k

Testing initiated at 7 June 2019 08:46 by user PTS Tester.

ZFS 4k - QCOW2 4k - NTFS - 4k

Testing initiated at 7 June 2019 12:31 by user PTS Tester.

ZFS 64k - QCOW2 4k - NTFS 4k

Testing initiated at 7 June 2019 19:43 by user PTS Tester.

ZFS 64k - QCOW2 64K - NTFS 4k

Testing initiated at 7 June 2019 22:16 by user PTS Tester.

ZFS 16k - QCOW2 16k - NTFS 4k

Testing initiated at 8 June 2019 00:19 by user PTS Tester.

ZFS 64k - QCOW2 16k - NTFS 4k

Testing initiated at 9 June 2019 13:22 by user PTS Tester.

ZFS 16k - QCOW2 16k - NTFS 16k

Testing initiated at 10 June 2019 07:53 by user PTS Tester.

ZFS 64k - QCOW2 64k - NTFS 16k

Testing initiated at 10 June 2019 13:50 by user PTS Tester.

ZFS 64k - QCOW2 16k - NTFS 16k

Processor: 2 x Intel Xeon (Skylake IBRS) @ 2.10GHz (2 Cores), Motherboard: (0.5.1 BIOS), Memory: 1 x 4096 MB, Disk: 40GB Red Hat VirtIO, Graphics: Microsoft Basic Display

OS: Microsoft Windows 10 Enterprise Evaluation Build 18362, Kernel: 10.0 (x86_64), Display Driver: 10.0.18362.1, File-System: NTFS, Screen Resolution: 1024x768

Testing initiated at 10 June 2019 16:31 by user PTS Tester.