ZFS + KVM + NTFS Benchmarking Various Record Sizes


This benchmark aims to identify optimal combination of record sizes (i.e., recordsize for ZFS, cluster_size for QCOW2, allocation unit size for NTFS) for a Windows 10 Guest VM running on top of ZFS + KVM.

Host: Dual Intel Xeon 6130 @ 2.10GHz, 384GB RAM, CentOS 7.6 Virtualization Base Environment, ZFS 0.8.0 via EPEL zfs-testing repository

ZFS Config: 4 x RAIDZ2 (5 x 8TB 7.2K HDD) + 2 x OPTANE 900 280GB SLOG MIRROR + OPTANE 900 480GB CACHE

Windows Guest: 2 vCPUs, 4GB RAM, 40 GB QCOW2 (bus:virtio, cache:writeback, io:default, cluster size 4k ~ 128k)

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1906129-HV-MERGE333894
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
ZFS 128k - QCOW2 64k - NTFS 4k
June 11 2019
  1 Hour, 45 Minutes
ZFS 64k - QCOW2 64k - NTFS 64k
June 07 2019
  1 Hour, 55 Minutes
ZFS 16k - QCOW2 16k - NTFS 16k
June 10 2019
  1 Hour, 56 Minutes
ZFS 4k - QCOW2 4k - NTFS - 4k
June 07 2019
  2 Hours, 55 Minutes
ZFS 128k - QCOW2 128k - NTFS 64k
June 12 2019
  1 Hour, 33 Minutes
ZFS 128k - QCOW2 128k - NTFS 4k
June 11 2019
  1 Hour, 55 Minutes
ZFS 128k - QCOW2 64k - NTFS 64k
June 12 2019
  1 Hour, 50 Minutes
ZFS 64k - QCOW2 64K - NTFS 4k
June 07 2019
  1 Hour, 34 Minutes
ZFS 16k - QCOW2 16k - NTFS 4k
June 08 2019
  1 Hour, 38 Minutes
ZFS 64k - QCOW2 64k - NTFS 16k
June 10 2019
  2 Hours, 4 Minutes
ZFS 64k - QCOW2 16k - NTFS 16k
June 10 2019
  1 Hour, 50 Minutes
ZFS 64k - QCOW2 4k - NTFS 4k
June 07 2019
  1 Hour, 35 Minutes
ZFS 64k - QCOW2 16k - NTFS 4k
June 09 2019
  1 Hour, 55 Minutes
Invert Hiding All Results Option
  1 Hour, 53 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ZFS + KVM + NTFS Benchmarking Various Record SizesOpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon (Skylake IBRS) @ 2.10GHz (2 Cores)(0.5.1 BIOS)1 x 4096 MB40GB Red Hat VirtIOMicrosoft Basic DisplayMicrosoft Windows 10 Enterprise Evaluation Build 1836210.0 (x86_64)10.0.18362.1NTFS1024x768ProcessorMotherboardMemoryDiskGraphicsOSKernelDisplay DriverFile-SystemScreen ResolutionZFS + KVM + NTFS Benchmarking Various Record Sizes PerformanceSystem Logs

ZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64kLogarithmic Result OverviewPhoronix Test SuiteFlexible IO TesterIOzoneIOzoneFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterIOzoneIOzoneFlexible IO TesterFlexible IO TesterFlexible IO TesterIOzoneFlexible IO TesterFlexible IO TesterIOzoneFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterRand Write - Windows AIO - No - Yes - 64KB1MB - 8GB - Write Performance64Kb - 8GB - Write PerformanceSeq Write - Windows AIO - No - Yes - 16KBRand Write - Windows AIO - No - Yes - 16KBSeq Write - Windows AIO - No - Yes - 8KBRand Write - Windows AIO - No - Yes - 8KBRand Write - Windows AIO - No - Yes - 4KBSeq Write - Windows AIO - No - Yes - 4KBRand Read - Windows AIO - No - Yes - 1MBRand Write - Windows AIO - No - Yes - 1MBSeq Write - Windows AIO - No - Yes - 1MB1MB - 8GB - Read Performance4Kb - 8GB - Write PerformanceSeq Read - Windows AIO - No - Yes - 1MBRand Read - Windows AIO - No - Yes - 8KBRand Read - Windows AIO - No - Yes - 4KB64Kb - 8GB - Read PerformanceRand Read - Windows AIO - No - Yes - 64KBRand Read - Windows AIO - No - Yes - 16KB4Kb - 8GB - Read PerformanceSeq Read - Windows AIO - No - Yes - 16KBSeq Read - Windows AIO - No - Yes - 4KBSeq Read - Windows AIO - No - Yes - 8KBSeq Read - Windows AIO - No - Yes - 64KB

ZFS + KVM + NTFS Benchmarking Various Record Sizesfio: Rand Read - Windows AIO - No - Yes - 1MB - Default Test Directoryfio: Rand Read - Windows AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Windows AIO - No - Yes - 8KB - Default Test Directoryfio: Rand Read - Windows AIO - No - Yes - 16KB - Default Test Directoryfio: Rand Read - Windows AIO - No - Yes - 64KB - Default Test Directoryfio: Rand Write - Windows AIO - No - Yes - 1MB - Default Test Directoryfio: Rand Write - Windows AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Windows AIO - No - Yes - 8KB - Default Test Directoryfio: Rand Write - Windows AIO - No - Yes - 16KB - Default Test Directoryfio: Rand Write - Windows AIO - No - Yes - 64KB - Default Test Directoryfio: Seq Read - Windows AIO - No - Yes - 1MB - Default Test Directoryfio: Seq Read - Windows AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Windows AIO - No - Yes - 8KB - Default Test Directoryfio: Seq Read - Windows AIO - No - Yes - 16KB - Default Test Directoryfio: Seq Read - Windows AIO - No - Yes - 64KB - Default Test Directoryfio: Seq Write - Windows AIO - No - Yes - 1MB - Default Test Directoryfio: Seq Write - Windows AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Windows AIO - No - Yes - 8KB - Default Test Directoryfio: Seq Write - Windows AIO - No - Yes - 16KB - Default Test Directoryfio: Seq Write - Windows AIO - No - Yes - 64KB - Default Test Directoryiozone: 1MB - 8GB - Read Performanceiozone: 4Kb - 8GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performanceiozone: 64Kb - 8GB - Read Performanceiozone: 64Kb - 8GB - Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k11500234463831286827431252474471354121332254428603150267820636361015001852.57563.021150.28622.91833.631154.154191104.47198433146016642.3074.461181695047228460928321716265.83102140187699.92296.75254.89243.93408.54266.3452701102283971423123640.2379.7915546457372204178412903154865.731332316331787.43526.52925.75426.39799.85908.6112875211408791289626951232334541164132332124128103028257419334953411901893.33561.941043.66395.38792.23808.159830126252500200264173.901422756011130017636469426266121302233736011611.63459.38606.42396.63644.41583.2590071532945922195264188.98171313945117402084388222893253316729149312101972.18571.721007.22485.37786.52977.737675146288578205865782.411552826171076722944686529976191592564155851492.24437.64748.10565.58655.99743.7812853211420830280924061192384371154125472164308392850250219432550311521901.82551.311072.11552.19810.391125.9198591603246402460257382.13165305904119002134178013082255017130351912331855.03539.591133.03542.85806.791089.6012500204416838302832251192304461342117002124268202917339320437362513601867.17561.171027.92439.51807.93947.01125332094168282917351176.971593211170123332114028042906329392.6118138111531929.75580.741016.09446.27835.14951.01121602054088082715350376.971542991177120252003747502755314796.371913781885.86576.961364.73648.44875.131293.4612554208410815285132861342494631409124672144238352944331619936962814861896.74573.831326.99615.63826.001318.79OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k3K6K9K12K15KSE +/- 210.22, N = 15SE +/- 37.82, N = 3SE +/- 41.46, N = 3SE +/- 130.59, N = 8SE +/- 75.55, N = 3SE +/- 59.54, N = 3SE +/- 106.26, N = 4SE +/- 139.00, N = 15SE +/- 108.50, N = 3SE +/- 173.21, N = 3SE +/- 145.30, N = 3SE +/- 162.36, N = 15SE +/- 143.94, N = 1311500419152701287598309007767512853985912500125331216012554
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2K4K6K8K10KMin: 10000 / Avg: 11500 / Max: 13300Min: 4126 / Avg: 4191 / Max: 4257Min: 5220 / Avg: 5269.67 / Max: 5352Min: 12400 / Avg: 12875 / Max: 13300Min: 9681 / Avg: 9830.33 / Max: 9925Min: 8891 / Avg: 9006.67 / Max: 9089Min: 7368 / Avg: 7674.5 / Max: 7850Min: 12000 / Avg: 12853.33 / Max: 13600Min: 9644 / Avg: 9859 / Max: 9992Min: 12200 / Avg: 12500 / Max: 12800Min: 12300 / Avg: 12533.33 / Max: 12800Min: 11100 / Avg: 12160 / Max: 12900Min: 11400 / Avg: 12553.85 / Max: 13300

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k50100150200250SE +/- 3.84, N = 3SE +/- 1.04, N = 15SE +/- 1.00, N = 3SE +/- 2.33, N = 3SE +/- 1.24, N = 15SE +/- 2.19, N = 3SE +/- 2.03, N = 3SE +/- 2.96, N = 15SE +/- 2.52, N = 15SE +/- 3.90, N = 14SE +/- 1.45, N = 3SE +/- 1.76, N = 15SE +/- 2.24, N = 7234.00104.47110.00211.00126.00153.00146.00211.00160.00204.00209.00205.00208.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k4080120160200Min: 230 / Avg: 234.33 / Max: 242Min: 99.2 / Avg: 104.47 / Max: 113Min: 109 / Avg: 110 / Max: 112Min: 207 / Avg: 210.67 / Max: 215Min: 113 / Avg: 125.6 / Max: 132Min: 149 / Avg: 153.33 / Max: 156Min: 143 / Avg: 146.33 / Max: 150Min: 177 / Avg: 210.53 / Max: 220Min: 142 / Avg: 160 / Max: 173Min: 185 / Avg: 204.21 / Max: 236Min: 207 / Avg: 209.33 / Max: 212Min: 192 / Avg: 205.27 / Max: 217Min: 203 / Avg: 208.29 / Max: 220

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k100200300400500SE +/- 7.21, N = 15SE +/- 2.74, N = 4SE +/- 1.20, N = 3SE +/- 3.06, N = 3SE +/- 3.79, N = 3SE +/- 2.45, N = 15SE +/- 2.60, N = 3SE +/- 5.09, N = 15SE +/- 3.89, N = 6SE +/- 5.30, N = 15SE +/- 6.56, N = 3SE +/- 4.51, N = 3SE +/- 2.85, N = 3463198228408252294288420324416416408410
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k80160240320400Min: 412 / Avg: 462.53 / Max: 505Min: 191 / Avg: 198 / Max: 204Min: 226 / Avg: 227.67 / Max: 230Min: 404 / Avg: 408 / Max: 414Min: 245 / Avg: 252 / Max: 258Min: 284 / Avg: 294.27 / Max: 316Min: 284 / Avg: 288.33 / Max: 293Min: 384 / Avg: 420.47 / Max: 457Min: 316 / Avg: 324.17 / Max: 340Min: 387 / Avg: 415.8 / Max: 453Min: 403 / Avg: 416 / Max: 424Min: 399 / Avg: 408 / Max: 413Min: 407 / Avg: 410.33 / Max: 416

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2004006008001000SE +/- 11.79, N = 3SE +/- 4.95, N = 15SE +/- 4.97, N = 15SE +/- 9.43, N = 15SE +/- 5.49, N = 15SE +/- 5.24, N = 3SE +/- 5.76, N = 15SE +/- 8.01, N = 15SE +/- 7.55, N = 3SE +/- 11.86, N = 3SE +/- 9.24, N = 15SE +/- 11.41, N = 15SE +/- 9.68, N = 3831433397791500592578830640838828808815
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k150300450600750Min: 808 / Avg: 831.33 / Max: 846Min: 402 / Avg: 433.4 / Max: 472Min: 350 / Avg: 397.27 / Max: 428Min: 742 / Avg: 791.27 / Max: 864Min: 468 / Avg: 500.27 / Max: 542Min: 582 / Avg: 591.67 / Max: 600Min: 546 / Avg: 578.33 / Max: 618Min: 771 / Avg: 830.27 / Max: 875Min: 631 / Avg: 640 / Max: 655Min: 818 / Avg: 837.67 / Max: 859Min: 766 / Avg: 828 / Max: 879Min: 723 / Avg: 808.33 / Max: 902Min: 804 / Avg: 814.67 / Max: 834

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k6001200180024003000SE +/- 30.89, N = 15SE +/- 17.41, N = 15SE +/- 20.58, N = 3SE +/- 29.53, N = 8SE +/- 23.87, N = 15SE +/- 26.34, N = 15SE +/- 21.48, N = 15SE +/- 34.30, N = 5SE +/- 21.63, N = 13SE +/- 42.72, N = 3SE +/- 47.81, N = 3SE +/- 26.54, N = 3SE +/- 38.74, N = 32868146014232896200221952058280924603028291727152851
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k5001000150020002500Min: 2647 / Avg: 2868.47 / Max: 3095Min: 1354 / Avg: 1460.27 / Max: 1589Min: 1394 / Avg: 1423.33 / Max: 1463Min: 2807 / Avg: 2896.25 / Max: 3023Min: 1856 / Avg: 2002 / Max: 2146Min: 2074 / Avg: 2194.53 / Max: 2409Min: 1925 / Avg: 2058.07 / Max: 2170Min: 2698 / Avg: 2808.6 / Max: 2909Min: 2244 / Avg: 2460.31 / Max: 2535Min: 2943 / Avg: 3028 / Max: 3078Min: 2824 / Avg: 2917.33 / Max: 2982Min: 2662 / Avg: 2715 / Max: 2744Min: 2792 / Avg: 2851 / Max: 2924

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k8001600240032004000SE +/- 57.14, N = 15SE +/- 5.04, N = 15SE +/- 22.28, N = 15SE +/- 28.67, N = 3SE +/- 25.74, N = 15SE +/- 76.03, N = 15SE +/- 13.92, N = 15SE +/- 78.39, N = 15SE +/- 69.43, N = 15SE +/- 98.84, N = 12SE +/- 68.97, N = 14SE +/- 28.62, N = 3SE +/- 81.14, N = 152743166123626956412641657240625733225351135033286
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k6001200180024003000Min: 2284 / Avg: 2742.53 / Max: 3226Min: 142 / Avg: 165.87 / Max: 201Min: 1043 / Avg: 1235.73 / Max: 1379Min: 2666 / Avg: 2694.67 / Max: 2752Min: 536 / Avg: 641.13 / Max: 907Min: 1982 / Avg: 2640.93 / Max: 3200Min: 561 / Avg: 656.93 / Max: 770Min: 1853 / Avg: 2406.47 / Max: 2922Min: 2026 / Avg: 2573 / Max: 2972Min: 2262 / Avg: 3225.42 / Max: 3629Min: 3143 / Avg: 3510.79 / Max: 4051Min: 3470 / Avg: 3503 / Max: 3560Min: 2645 / Avg: 3286 / Max: 3721

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k306090120150SE +/- 1.41, N = 15SE +/- 0.25, N = 3SE +/- 0.15, N = 3SE +/- 1.76, N = 3SE +/- 1.04, N = 3SE +/- 1.41, N = 15SE +/- 0.95, N = 15SE +/- 0.71, N = 15SE +/- 2.03, N = 3SE +/- 0.83, N = 15SE +/- 0.34, N = 3SE +/- 0.88, N = 3125.0042.3040.23123.0073.9088.9882.41119.0082.13119.0076.9776.97134.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k306090120150Min: 117 / Avg: 124.73 / Max: 136Min: 41.8 / Avg: 42.3 / Max: 42.6Min: 40 / Avg: 40.23 / Max: 40.5Min: 120 / Avg: 122.67 / Max: 126Min: 72.2 / Avg: 73.9 / Max: 75.8Min: 80 / Avg: 88.98 / Max: 94.9Min: 78.2 / Avg: 82.41 / Max: 88.9Min: 77.5 / Avg: 82.13 / Max: 88.3Min: 116 / Avg: 119.33 / Max: 123Min: 72.6 / Avg: 76.97 / Max: 83Min: 76.3 / Avg: 76.97 / Max: 77.4Min: 132 / Avg: 133.67 / Max: 135

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k50100150200250SE +/- 3.79, N = 3SE +/- 1.40, N = 12SE +/- 0.63, N = 14SE +/- 3.01, N = 15SE +/- 1.46, N = 15SE +/- 1.76, N = 3SE +/- 2.40, N = 3SE +/- 2.08, N = 15SE +/- 3.55, N = 15SE +/- 2.24, N = 15247.0074.4679.79233.00142.00171.00155.00238.00165.00230.00159.00154.00249.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k50100150200250Min: 240 / Avg: 247 / Max: 253Min: 68.3 / Avg: 74.46 / Max: 83Min: 75.2 / Avg: 79.79 / Max: 83.7Min: 221 / Avg: 232.53 / Max: 255Min: 143 / Avg: 155.33 / Max: 164Min: 235 / Avg: 237.67 / Max: 241Min: 162 / Avg: 165.33 / Max: 170Min: 216 / Avg: 230 / Max: 246Min: 146 / Avg: 158.67 / Max: 200Min: 236 / Avg: 248.53 / Max: 262

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k100200300400500SE +/- 4.37, N = 3SE +/- 1.39, N = 15SE +/- 0.88, N = 3SE +/- 3.71, N = 3SE +/- 2.08, N = 3SE +/- 3.37, N = 15SE +/- 4.19, N = 9SE +/- 4.98, N = 3SE +/- 4.13, N = 15SE +/- 3.26, N = 15SE +/- 2.08, N = 3SE +/- 6.71, N = 15447118155454275313282437305446321299463
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k80160240320400Min: 438 / Avg: 446.67 / Max: 452Min: 112 / Avg: 117.53 / Max: 128Min: 153 / Avg: 154.67 / Max: 156Min: 270 / Avg: 274.67 / Max: 282Min: 309 / Avg: 313 / Max: 316Min: 262 / Avg: 281.93 / Max: 304Min: 417 / Avg: 437.44 / Max: 456Min: 297 / Avg: 304.67 / Max: 314Min: 422 / Avg: 446.4 / Max: 471Min: 306 / Avg: 321.13 / Max: 351Min: 296 / Avg: 299 / Max: 303Min: 403 / Avg: 463.33 / Max: 505

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k30060090012001500SE +/- 28.55, N = 15SE +/- 4.42, N = 15SE +/- 2.60, N = 3SE +/- 27.25, N = 15SE +/- 25.28, N = 15SE +/- 13.06, N = 15SE +/- 21.03, N = 15SE +/- 14.83, N = 5SE +/- 9.87, N = 3SE +/- 16.17, N = 3SE +/- 22.57, N = 12SE +/- 16.82, N = 15SE +/- 36.81, N = 151354169464116460194561711549041342117011771409
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2004006008001000Min: 1124 / Avg: 1353.6 / Max: 1528Min: 145 / Avg: 168.93 / Max: 198Min: 459 / Avg: 463.67 / Max: 468Min: 1007 / Avg: 1163.8 / Max: 1405Min: 491 / Avg: 601 / Max: 879Min: 855 / Avg: 944.93 / Max: 1012Min: 499 / Avg: 616.93 / Max: 725Min: 1107 / Avg: 1153.6 / Max: 1181Min: 884 / Avg: 903.67 / Max: 915Min: 1310 / Avg: 1342.33 / Max: 1359Min: 1062 / Avg: 1170.42 / Max: 1320Min: 1088 / Avg: 1177.13 / Max: 1303Min: 1057 / Avg: 1408.73 / Max: 1589

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k3K6K9K12K15KSE +/- 88.19, N = 3SE +/- 22.91, N = 3SE +/- 51.66, N = 10SE +/- 115.33, N = 15SE +/- 115.47, N = 3SE +/- 143.53, N = 5SE +/- 88.19, N = 3SE +/- 107.29, N = 15SE +/- 57.74, N = 3SE +/- 136.51, N = 15SE +/- 179.70, N = 4SE +/- 176.38, N = 3121335047573713233113001174010767125471190011700123331202512467
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2K4K6K8K10KMin: 12000 / Avg: 12133.33 / Max: 12300Min: 5010 / Avg: 5047.33 / Max: 5089Min: 5450 / Avg: 5736.7 / Max: 5923Min: 12300 / Avg: 13233.33 / Max: 13900Min: 11100 / Avg: 11300 / Max: 11500Min: 11500 / Avg: 11740 / Max: 12300Min: 10600 / Avg: 10766.67 / Max: 10900Min: 12000 / Avg: 12546.67 / Max: 13300Min: 11800 / Avg: 11900 / Max: 12000Min: 11000 / Avg: 12333.33 / Max: 12900Min: 11500 / Avg: 12025 / Max: 12300Min: 12200 / Avg: 12466.67 / Max: 12800

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k50100150200250SE +/- 3.12, N = 15SE +/- 2.30, N = 15SE +/- 2.60, N = 3SE +/- 1.20, N = 3SE +/- 2.40, N = 3SE +/- 2.19, N = 3SE +/- 2.04, N = 15SE +/- 1.45, N = 3SE +/- 2.52, N = 3SE +/- 2.71, N = 4SE +/- 1.66, N = 13SE +/- 2.67, N = 3225228220212176208229216213212211200214
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k4080120160200Min: 209 / Avg: 225.13 / Max: 247Min: 206 / Avg: 228.33 / Max: 241Min: 216 / Avg: 220.33 / Max: 225Min: 174 / Avg: 176.33 / Max: 178Min: 205 / Avg: 208.33 / Max: 213Min: 226 / Avg: 228.67 / Max: 233Min: 205 / Avg: 216.13 / Max: 227Min: 211 / Avg: 213.33 / Max: 216Min: 207 / Avg: 212 / Max: 215Min: 207 / Avg: 211 / Max: 219Min: 190 / Avg: 200.15 / Max: 211Min: 211 / Avg: 213.67 / Max: 219

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k100200300400500SE +/- 5.71, N = 15SE +/- 5.80, N = 5SE +/- 6.84, N = 3SE +/- 1.76, N = 3SE +/- 3.78, N = 15SE +/- 1.53, N = 3SE +/- 4.81, N = 3SE +/- 2.33, N = 3SE +/- 6.64, N = 3SE +/- 1.76, N = 3SE +/- 5.21, N = 3SE +/- 6.01, N = 3SE +/- 3.76, N = 3442460417412364438446430417426402374423
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k80160240320400Min: 414 / Avg: 442.33 / Max: 493Min: 440 / Avg: 460.4 / Max: 473Min: 403 / Avg: 416.67 / Max: 424Min: 409 / Avg: 411.67 / Max: 415Min: 342 / Avg: 364.33 / Max: 390Min: 435 / Avg: 438 / Max: 440Min: 437 / Avg: 446.33 / Max: 453Min: 426 / Avg: 429.67 / Max: 434Min: 405 / Avg: 416.67 / Max: 428Min: 423 / Avg: 426.33 / Max: 429Min: 393 / Avg: 401.67 / Max: 411Min: 366 / Avg: 374.33 / Max: 386Min: 416 / Avg: 422.67 / Max: 429

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2004006008001000SE +/- 10.12, N = 15SE +/- 7.69, N = 3SE +/- 10.56, N = 15SE +/- 12.37, N = 15SE +/- 3.93, N = 3SE +/- 5.90, N = 3SE +/- 7.51, N = 3SE +/- 9.13, N = 3SE +/- 7.36, N = 3SE +/- 4.73, N = 3SE +/- 6.33, N = 3SE +/- 5.70, N = 3SE +/- 7.70, N = 15860928841810694822865839801820804750835
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k160320480640800Min: 806 / Avg: 859.73 / Max: 975Min: 913 / Avg: 927.67 / Max: 939Min: 788 / Avg: 840.8 / Max: 954Min: 711 / Avg: 810 / Max: 900Min: 686 / Avg: 693.67 / Max: 699Min: 810 / Avg: 821.67 / Max: 829Min: 852 / Avg: 865 / Max: 878Min: 825 / Avg: 838.67 / Max: 856Min: 786 / Avg: 800.67 / Max: 809Min: 811 / Avg: 820 / Max: 827Min: 791 / Avg: 803.67 / Max: 810Min: 739 / Avg: 750.33 / Max: 757Min: 794 / Avg: 835.33 / Max: 886

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k7001400210028003500SE +/- 43.44, N = 4SE +/- 32.24, N = 8SE +/- 24.31, N = 15SE +/- 7.45, N = 3SE +/- 34.35, N = 3SE +/- 13.65, N = 3SE +/- 24.67, N = 3SE +/- 37.55, N = 3SE +/- 10.33, N = 3SE +/- 38.07, N = 4SE +/- 10.58, N = 3SE +/- 8.50, N = 3SE +/- 34.87, N = 153150321729033028262628932997285030822917290627552944
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k6001200180024003000Min: 3081 / Avg: 3149.5 / Max: 3264Min: 3085 / Avg: 3216.88 / Max: 3353Min: 2734 / Avg: 2903.47 / Max: 3076Min: 3014 / Avg: 3028.33 / Max: 3039Min: 2577 / Avg: 2625.67 / Max: 2692Min: 2876 / Avg: 2893 / Max: 2920Min: 2948 / Avg: 2996.67 / Max: 3028Min: 2786 / Avg: 2849.67 / Max: 2916Min: 3062 / Avg: 3081.67 / Max: 3097Min: 2870 / Avg: 2917.25 / Max: 3031Min: 2890 / Avg: 2906 / Max: 2926Min: 2738 / Avg: 2755 / Max: 2764Min: 2688 / Avg: 2944 / Max: 3209

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k7001400210028003500SE +/- 49.81, N = 15SE +/- 4.19, N = 15SE +/- 27.56, N = 15SE +/- 26.21, N = 3SE +/- 20.61, N = 15SE +/- 122.35, N = 12SE +/- 19.74, N = 15SE +/- 71.45, N = 15SE +/- 65.35, N = 12SE +/- 57.43, N = 15SE +/- 57.13, N = 15SE +/- 53.58, N = 15SE +/- 80.74, N = 152678162154825746122533619250225503393329331473316
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k6001200180024003000Min: 2432 / Avg: 2678.07 / Max: 3109Min: 138 / Avg: 162.07 / Max: 201Min: 1277 / Avg: 1547.67 / Max: 1705Min: 2523 / Avg: 2574 / Max: 2610Min: 508 / Avg: 612.47 / Max: 796Min: 1398 / Avg: 2532.67 / Max: 2984Min: 480 / Avg: 618.87 / Max: 714Min: 2002 / Avg: 2501.67 / Max: 3064Min: 2060 / Avg: 2550.25 / Max: 2862Min: 2960 / Avg: 3392.87 / Max: 3771Min: 2930 / Avg: 3293 / Max: 3727Min: 2731 / Avg: 3146.8 / Max: 3448Min: 2763 / Avg: 3316.47 / Max: 3749

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k50100150200250SE +/- 2.72, N = 4SE +/- 0.76, N = 15SE +/- 0.95, N = 3SE +/- 2.60, N = 3SE +/- 2.19, N = 3SE +/- 2.52, N = 3SE +/- 2.91, N = 3SE +/- 2.09, N = 15SE +/- 2.36, N = 15SE +/- 1.06, N = 15SE +/- 1.00, N = 15206.0065.8365.73193.00130.00167.00159.00194.00171.00204.0092.6196.37199.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k4080120160200Min: 199 / Avg: 206.25 / Max: 212Min: 62.7 / Avg: 65.83 / Max: 72.9Min: 64.5 / Avg: 65.73 / Max: 67.6Min: 188 / Avg: 192.67 / Max: 197Min: 126 / Avg: 130.33 / Max: 133Min: 164 / Avg: 167 / Max: 172Min: 189 / Avg: 194.33 / Max: 199Min: 155 / Avg: 170.87 / Max: 181Min: 191 / Avg: 204 / Max: 225Min: 85.6 / Avg: 92.61 / Max: 98.9Min: 90 / Avg: 96.37 / Max: 105

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k80160240320400SE +/- 2.00, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 4.16, N = 3SE +/- 2.66, N = 15SE +/- 4.08, N = 15SE +/- 2.08, N = 3SE +/- 4.59, N = 4SE +/- 2.76, N = 15SE +/- 3.51, N = 15SE +/- 3.70, N = 12SE +/- 2.91, N = 15363102133349223291256325303373181191369
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k70140210280350Min: 361 / Avg: 363 / Max: 367Min: 100 / Avg: 102.33 / Max: 104Min: 131 / Avg: 133 / Max: 134Min: 343 / Avg: 349 / Max: 357Min: 205 / Avg: 223 / Max: 242Min: 275 / Avg: 290.73 / Max: 330Min: 253 / Avg: 256 / Max: 260Min: 311 / Avg: 324.75 / Max: 330Min: 283 / Avg: 302.8 / Max: 328Min: 349 / Avg: 373.4 / Max: 394Min: 168 / Avg: 181 / Max: 214Min: 350 / Avg: 368.53 / Max: 384

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k140280420560700SE +/- 8.69, N = 3SE +/- 2.12, N = 15SE +/- 3.04, N = 5SE +/- 6.12, N = 6SE +/- 6.17, N = 3SE +/- 7.69, N = 3SE +/- 3.61, N = 3SE +/- 5.46, N = 3SE +/- 4.71, N = 15SE +/- 10.40, N = 3SE +/- 5.36, N = 3SE +/- 4.18, N = 15SE +/- 7.11, N = 15610140231534373493415503519625381378628
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k110220330440550Min: 600 / Avg: 609.67 / Max: 627Min: 128 / Avg: 140.13 / Max: 158Min: 225 / Avg: 230.8 / Max: 241Min: 516 / Avg: 534.17 / Max: 554Min: 361 / Avg: 373.33 / Max: 380Min: 482 / Avg: 493.33 / Max: 508Min: 408 / Avg: 415 / Max: 420Min: 492 / Avg: 502.67 / Max: 510Min: 483 / Avg: 518.73 / Max: 549Min: 607 / Avg: 625.33 / Max: 643Min: 371 / Avg: 381.33 / Max: 389Min: 344 / Avg: 378 / Max: 404Min: 566 / Avg: 627.6 / Max: 678

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 64k - NTFS 64k30060090012001500SE +/- 29.00, N = 15SE +/- 5.51, N = 12SE +/- 5.91, N = 15SE +/- 18.33, N = 3SE +/- 9.40, N = 3SE +/- 14.28, N = 15SE +/- 18.13, N = 12SE +/- 37.86, N = 12SE +/- 25.11, N = 15SE +/- 17.28, N = 15SE +/- 12.77, N = 15SE +/- 17.89, N = 1515001876331190601121058511521233136011531486
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Windows AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: Default Test DirectoryZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 64k - NTFS 64k30060090012001500Min: 1301 / Avg: 1499.87 / Max: 1665Min: 161 / Avg: 187.17 / Max: 224Min: 589 / Avg: 633.33 / Max: 671Min: 1153 / Avg: 1189.67 / Max: 1208Min: 582 / Avg: 600.67 / Max: 612Min: 1120 / Avg: 1209.87 / Max: 1310Min: 486 / Avg: 584.5 / Max: 679Min: 914 / Avg: 1151.5 / Max: 1389Min: 1105 / Avg: 1232.6 / Max: 1370Min: 1281 / Avg: 1359.8 / Max: 1497Min: 1034 / Avg: 1153 / Max: 1208Min: 1371 / Avg: 1486 / Max: 1599

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k400800120016002000SE +/- 28.21, N = 3SE +/- 8.14, N = 3SE +/- 24.78, N = 3SE +/- 23.36, N = 5SE +/- 7.34, N = 3SE +/- 22.67, N = 3SE +/- 19.59, N = 15SE +/- 32.92, N = 15SE +/- 19.66, N = 15SE +/- 39.76, N = 15SE +/- 33.35, N = 15SE +/- 38.22, N = 15SE +/- 31.29, N = 31852.57699.921787.431893.331611.631972.181492.241901.821855.031867.171929.751885.861896.74
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k30060090012001500Min: 1821.85 / Avg: 1852.57 / Max: 1908.91Min: 690.65 / Avg: 699.92 / Max: 716.14Min: 1750.19 / Avg: 1787.43 / Max: 1834.36Min: 1845.13 / Avg: 1893.33 / Max: 1979.22Min: 1596.95 / Avg: 1611.63 / Max: 1619.33Min: 1938.27 / Avg: 1972.18 / Max: 2015.19Min: 1377.88 / Avg: 1492.24 / Max: 1642.66Min: 1765.84 / Avg: 1901.82 / Max: 2136.59Min: 1766.38 / Avg: 1855.03 / Max: 2065.11Min: 1689.53 / Avg: 1867.17 / Max: 2115.88Min: 1740.92 / Avg: 1929.75 / Max: 2156.04Min: 1657.74 / Avg: 1885.86 / Max: 2139.44Min: 1836.33 / Avg: 1896.74 / Max: 1941.11

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k130260390520650SE +/- 1.57, N = 3SE +/- 5.26, N = 12SE +/- 6.81, N = 3SE +/- 6.39, N = 3SE +/- 5.81, N = 5SE +/- 5.19, N = 15SE +/- 3.62, N = 3SE +/- 6.80, N = 5SE +/- 4.68, N = 3SE +/- 8.16, N = 3SE +/- 8.65, N = 4SE +/- 6.91, N = 3SE +/- 8.49, N = 3563.02296.75526.52561.94459.38571.72437.64551.31539.59561.17580.74576.96573.83
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k100200300400500Min: 559.87 / Avg: 563.02 / Max: 564.7Min: 269.77 / Avg: 296.75 / Max: 326.25Min: 514.06 / Avg: 526.52 / Max: 537.53Min: 553.22 / Avg: 561.94 / Max: 574.4Min: 443.96 / Avg: 459.38 / Max: 476.8Min: 541.68 / Avg: 571.72 / Max: 604.4Min: 431.13 / Avg: 437.64 / Max: 443.63Min: 539.01 / Avg: 551.31 / Max: 573.56Min: 530.33 / Avg: 539.59 / Max: 545.39Min: 546.62 / Avg: 561.17 / Max: 574.87Min: 556.03 / Avg: 580.74 / Max: 594.06Min: 563.13 / Avg: 576.96 / Max: 583.97Min: 558.11 / Avg: 573.83 / Max: 587.23

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k30060090012001500SE +/- 14.89, N = 15SE +/- 1.51, N = 3SE +/- 13.11, N = 15SE +/- 29.58, N = 12SE +/- 4.23, N = 3SE +/- 29.59, N = 15SE +/- 7.98, N = 15SE +/- 37.94, N = 15SE +/- 20.17, N = 15SE +/- 28.65, N = 15SE +/- 27.59, N = 14SE +/- 12.35, N = 10SE +/- 11.40, N = 31150.28254.89925.751043.66606.421007.22748.101072.111133.031027.921016.091364.731326.99
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2004006008001000Min: 1032.03 / Avg: 1150.28 / Max: 1240.64Min: 252.55 / Avg: 254.89 / Max: 257.71Min: 862.24 / Avg: 925.75 / Max: 1024.93Min: 862.1 / Avg: 1043.66 / Max: 1215.16Min: 600.04 / Avg: 606.42 / Max: 614.43Min: 825.26 / Avg: 1007.22 / Max: 1207.85Min: 667.84 / Avg: 748.1 / Max: 784.98Min: 750.98 / Avg: 1072.11 / Max: 1241.8Min: 1027.55 / Avg: 1133.03 / Max: 1279.57Min: 937.14 / Avg: 1027.92 / Max: 1352.97Min: 939.65 / Avg: 1016.09 / Max: 1333.34Min: 1273.94 / Avg: 1364.73 / Max: 1416.11Min: 1304.4 / Avg: 1326.99 / Max: 1340.9

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k140280420560700SE +/- 7.97, N = 3SE +/- 3.44, N = 3SE +/- 1.76, N = 3SE +/- 8.83, N = 15SE +/- 4.57, N = 3SE +/- 10.50, N = 15SE +/- 2.28, N = 3SE +/- 8.87, N = 15SE +/- 7.62, N = 15SE +/- 2.40, N = 3SE +/- 2.00, N = 3SE +/- 4.73, N = 3SE +/- 10.20, N = 3622.91243.93426.39395.38396.63485.37565.58552.19542.85439.51446.27648.44615.63
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k110220330440550Min: 606.97 / Avg: 622.91 / Max: 630.97Min: 237.06 / Avg: 243.93 / Max: 247.45Min: 423.13 / Avg: 426.39 / Max: 429.18Min: 357.84 / Avg: 395.38 / Max: 489.41Min: 388.88 / Avg: 396.63 / Max: 404.7Min: 440.43 / Avg: 485.37 / Max: 540.35Min: 561.69 / Avg: 565.58 / Max: 569.59Min: 467.26 / Avg: 552.19 / Max: 597.58Min: 515.7 / Avg: 542.85 / Max: 588.5Min: 434.71 / Avg: 439.51 / Max: 442.18Min: 442.92 / Avg: 446.27 / Max: 449.83Min: 642.38 / Avg: 648.44 / Max: 657.77Min: 596.18 / Avg: 615.63 / Max: 630.68

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2004006008001000SE +/- 11.05, N = 3SE +/- 4.64, N = 15SE +/- 7.14, N = 3SE +/- 6.94, N = 11SE +/- 6.68, N = 3SE +/- 10.06, N = 4SE +/- 6.93, N = 3SE +/- 9.09, N = 15SE +/- 5.12, N = 3SE +/- 11.87, N = 3SE +/- 12.53, N = 3SE +/- 12.19, N = 3SE +/- 9.96, N = 5833.63408.54799.85792.23644.41786.52655.99810.39806.79807.93835.14875.13826.00
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k150300450600750Min: 811.97 / Avg: 833.63 / Max: 848.22Min: 373.86 / Avg: 408.54 / Max: 434.7Min: 789.3 / Avg: 799.85 / Max: 813.45Min: 744.4 / Avg: 792.23 / Max: 823.62Min: 631.5 / Avg: 644.41 / Max: 653.85Min: 763.88 / Avg: 786.52 / Max: 811.55Min: 646.45 / Avg: 655.99 / Max: 669.46Min: 734.83 / Avg: 810.39 / Max: 858.53Min: 797.96 / Avg: 806.79 / Max: 815.7Min: 792.24 / Avg: 807.93 / Max: 831.2Min: 815.39 / Avg: 835.14 / Max: 858.37Min: 852.08 / Avg: 875.13 / Max: 893.52Min: 787.72 / Avg: 826 / Max: 844.79

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k30060090012001500SE +/- 13.91, N = 15SE +/- 3.55, N = 4SE +/- 23.22, N = 13SE +/- 6.36, N = 3SE +/- 3.74, N = 3SE +/- 29.69, N = 15SE +/- 11.06, N = 15SE +/- 13.45, N = 5SE +/- 14.52, N = 5SE +/- 20.93, N = 12SE +/- 11.60, N = 6SE +/- 18.61, N = 4SE +/- 11.98, N = 31154.15266.34908.61808.15583.25977.73743.781125.911089.60947.01951.011293.461318.79
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceZFS 64k - QCOW2 64k - NTFS 64kZFS 4k - QCOW2 4k - NTFS - 4kZFS 64k - QCOW2 4k - NTFS 4kZFS 64k - QCOW2 64K - NTFS 4kZFS 16k - QCOW2 16k - NTFS 4kZFS 64k - QCOW2 16k - NTFS 4kZFS 16k - QCOW2 16k - NTFS 16kZFS 64k - QCOW2 64k - NTFS 16kZFS 64k - QCOW2 16k - NTFS 16kZFS 128k - QCOW2 64k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 4kZFS 128k - QCOW2 128k - NTFS 64kZFS 128k - QCOW2 64k - NTFS 64k2004006008001000Min: 1046.31 / Avg: 1154.15 / Max: 1226.73Min: 259.04 / Avg: 266.34 / Max: 275.85Min: 819.67 / Avg: 908.61 / Max: 1087.6Min: 799.04 / Avg: 808.15 / Max: 820.39Min: 576 / Avg: 583.25 / Max: 588.48Min: 828.95 / Avg: 977.73 / Max: 1152.57Min: 649.22 / Avg: 743.78 / Max: 793Min: 1099.15 / Avg: 1125.91 / Max: 1177.69Min: 1060.21 / Avg: 1089.6 / Max: 1132.88Min: 861.22 / Avg: 947.01 / Max: 1145.38Min: 922.08 / Avg: 951.01 / Max: 985.78Min: 1244.15 / Avg: 1293.46 / Max: 1333.31Min: 1295.2 / Avg: 1318.79 / Max: 1334.23

26 Results Shown

Flexible IO Tester:
  Rand Read - Windows AIO - No - Yes - 1MB - Default Test Directory
  Rand Read - Windows AIO - No - Yes - 4KB - Default Test Directory
  Rand Read - Windows AIO - No - Yes - 8KB - Default Test Directory
  Rand Read - Windows AIO - No - Yes - 16KB - Default Test Directory
  Rand Read - Windows AIO - No - Yes - 64KB - Default Test Directory
  Rand Write - Windows AIO - No - Yes - 1MB - Default Test Directory
  Rand Write - Windows AIO - No - Yes - 4KB - Default Test Directory
  Rand Write - Windows AIO - No - Yes - 8KB - Default Test Directory
  Rand Write - Windows AIO - No - Yes - 16KB - Default Test Directory
  Rand Write - Windows AIO - No - Yes - 64KB - Default Test Directory
  Seq Read - Windows AIO - No - Yes - 1MB - Default Test Directory
  Seq Read - Windows AIO - No - Yes - 4KB - Default Test Directory
  Seq Read - Windows AIO - No - Yes - 8KB - Default Test Directory
  Seq Read - Windows AIO - No - Yes - 16KB - Default Test Directory
  Seq Read - Windows AIO - No - Yes - 64KB - Default Test Directory
  Seq Write - Windows AIO - No - Yes - 1MB - Default Test Directory
  Seq Write - Windows AIO - No - Yes - 4KB - Default Test Directory
  Seq Write - Windows AIO - No - Yes - 8KB - Default Test Directory
  Seq Write - Windows AIO - No - Yes - 16KB - Default Test Directory
  Seq Write - Windows AIO - No - Yes - 64KB - Default Test Directory
IOzone:
  1MB - 8GB - Read Performance
  4Kb - 8GB - Read Performance
  1MB - 8GB - Write Performance
  4Kb - 8GB - Write Performance
  64Kb - 8GB - Read Performance
  64Kb - 8GB - Write Performance