test-direct

AMD Ryzen 5 1600 Six-Core testing on FreeBSD via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2007037-VE-2007029VE92
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
zfs-direct
July 02 2020
  1 Hour, 3 Minutes
zfs-jail
July 02 2020
  1 Hour, 13 Minutes
zfs-direct-2gb-arc
July 02 2020
  1 Hour, 49 Minutes
btrfs-laptop
July 02 2020
  1 Hour, 3 Minutes
zfs-direct-no-compress
July 02 2020
  1 Hour, 24 Minutes
zfs-direct-2gb-arc-no-compress
July 02 2020
  1 Hour, 5 Minutes
Invert Hiding All Results Option
  1 Hour, 16 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

zfs-direct

zfs-jail

zfs-direct-2gb-arc

Processor: AMD Ryzen 5 1600 Six-Core @ 3.20GHz (12 Cores), Motherboard: MSI MS-7A33 3.0, Memory: 16GB, Disk: 10643GB, Network: Intel PRO/1000 Connection 7.6.1-k

OS: FreeBSD, Kernel: 11.3-RELEASE-p9 (x86_64), Compiler: Clang 10.0.0, File-System: zfs

btrfs-laptop

Processor: Intel Core i7-8750H @ 4.10GHz (6 Cores / 12 Threads), Motherboard: CFL Sienta_CFS (V1.22 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 16GB, Disk: 512GB HFS512G39MND-351, Graphics: Intel UHD 630 6GB, Audio: Realtek ALC255, Network: Realtek RTL8111/8168/8411 + Intel-AC 9560

OS: ManjaroLinux 20.0.3, Kernel: 5.6.16-1-MANJARO (x86_64), Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.6 Mesa 20.0.7, Compiler: Clang 10.0.0 + GCC 10.1.0 + LLVM 10.0.0 + CUDA 10.2, File-System: btrfs, Screen Resolution: 1920x1080

Kernel Notes: i915.enable_psr=0
Environment Notes: NVM_CD_FLAGS=-q
Compiler Notes: Optimized build; Default target: x86_64-pc-linux-gnu; Host CPU: skylake
Disk Notes: MQ-DEADLINE / autodefrag,compress-force=zstd:3,noatime,rw,space_cache,ssd,subvol=/@home,subvolid=258
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0xca
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected

zfs-direct-no-compress

zfs-direct-2gb-arc-no-compress

Processor: AMD Ryzen 5 1600 Six-Core @ 3.20GHz (12 Cores), Motherboard: MSI MS-7A33 3.0, Memory: 16GB, Disk: 10640GB, Network: Intel PRO/1000 Connection 7.6.1-k

OS: FreeBSD, Kernel: 11.3-RELEASE-p9 (x86_64), Compiler: Clang 10.0.0, File-System: zfs

test-directProcessorMotherboardMemoryDiskNetworkChipsetGraphicsAudioOSKernelCompilerFile-SystemDisplay ServerDisplay DriverOpenGLScreen Resolutionzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compressAMD Ryzen 5 1600 Six-Core @ 3.20GHz (12 Cores)MSI MS-7A33 3.016GB10643GBIntel PRO/1000 Connection 7.6.1-kFreeBSD11.3-RELEASE-p9 (x86_64)Clang 10.0.0zfsIntel Core i7-8750H @ 4.10GHz (6 Cores / 12 Threads)CFL Sienta_CFS (V1.22 BIOS)Intel Cannon Lake PCH512GB HFS512G39MND-351Intel UHD 630 6GBRealtek ALC255Realtek RTL8111/8168/8411 + Intel-AC 9560ManjaroLinux 20.0.35.6.16-1-MANJARO (x86_64)X Server 1.20.8modesetting 1.20.84.6 Mesa 20.0.7Clang 10.0.0 + GCC 10.1.0 + LLVM 10.0.0 + CUDA 10.2btrfs1920x1080AMD Ryzen 5 1600 Six-Core @ 3.20GHz (12 Cores)MSI MS-7A33 3.010640GBIntel PRO/1000 Connection 7.6.1-kFreeBSD11.3-RELEASE-p9 (x86_64)Clang 10.0.0zfsOpenBenchmarking.orgKernel Details- btrfs-laptop: i915.enable_psr=0Environment Details- btrfs-laptop: NVM_CD_FLAGS=-qCompiler Details- btrfs-laptop: Optimized build; Default target: x86_64-pc-linux-gnu; Host CPU: skylakeDisk Details- btrfs-laptop: MQ-DEADLINE / autodefrag,compress-force=zstd:3,noatime,rw,space_cache,ssd,subvol=/@home,subvolid=258Processor Details- btrfs-laptop: Scaling Governor: intel_pstate powersave - CPU Microcode: 0xcaSecurity Details- btrfs-laptop: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected

zfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compressLogarithmic Result OverviewPhoronix Test SuiteFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterSeq Write - Sync - No - Yes - 4KBSeq Write - Sync - No - Yes - 4KBRand Write - POSIX AIO - No - Yes - 4KBRand Write - POSIX AIO - No - Yes - 4KBSeq Read - Sync - No - Yes - 4KBSeq Read - Sync - No - Yes - 4KBRand Read - POSIX AIO - No - Yes - 4KBRand Read - POSIX AIO - No - Yes - 4KBSeq Read - POSIX AIO - No - Yes - 4KBSeq Read - POSIX AIO - No - Yes - 4KBRand Read - Sync - No - Yes - 4KBRand Read - Sync - No - Yes - 4KBSeq Write - POSIX AIO - No - Yes - 4KBSeq Write - POSIX AIO - No - Yes - 4KBRand Write - Sync - No - Yes - 4KBRand Write - Sync - No - Yes - 4KB

test-directfio: Rand Read - Sync - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Sync - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Sync - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Sync - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Sync - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Sync - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Sync - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Sync - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress23058867107.5273401712438333355908675141314536181583339292376676671708672305876793.423350169343333335690733415106173479.91229209272373336061552600.6561641.15228794.5242007.1301779352.6902757.739193795724500040.6051033022.7581962.81603324.0616823.9613965.31640064.21640025.7657263.416250204.87252439133.434102170643666735791400616157733574147000933238667664169933230589333.0667661545395667252645505121312257.970200095824533399.925483OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress50100150200250SE +/- 0.114, N = 15SE +/- 0.429, N = 15SE +/- 27.477, N = 12SE +/- 1.528, N = 3230.000230.0000.65622.700204.872230.000-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress4080120160200Min: 0.14 / Avg: 0.66 / Max: 1.7Min: 20.1 / Avg: 22.73 / Max: 25.4Min: 0.86 / Avg: 204.87 / Max: 249Min: 227 / Avg: 230 / Max: 2321. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress13K26K39K52K65KSE +/- 33.33, N = 3SE +/- 33.33, N = 3SE +/- 28.58, N = 15SE +/- 109.88, N = 15SE +/- 7033.78, N = 12SE +/- 371.18, N = 3588675876716458195243958933-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress10K20K30K40K50KMin: 58800 / Avg: 58866.67 / Max: 58900Min: 58700 / Avg: 58766.67 / Max: 58800Min: 35 / Avg: 163.53 / Max: 425Min: 5137 / Avg: 5819.47 / Max: 6494Min: 214 / Avg: 52438.92 / Max: 63700Min: 58200 / Avg: 58933.33 / Max: 594001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress306090120150SE +/- 9.213, N = 15SE +/- 7.135, N = 15SE +/- 0.103, N = 15SE +/- 0.570, N = 3SE +/- 10.000, N = 15SE +/- 0.285, N = 12107.50093.4001.15262.800133.4003.066-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-lgfapi -lglusterfs -lrbd -lrados -lnuma -laio -ldl-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress306090120150Min: 46.1 / Avg: 107.45 / Max: 153Min: 54.2 / Avg: 93.38 / Max: 147Min: 0.29 / Avg: 1.15 / Max: 1.58Min: 62.1 / Avg: 62.77 / Max: 63.9Min: 36.8 / Avg: 133.39 / Max: 179Min: 0.99 / Avg: 3.07 / Max: 4.511. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress7K14K21K28K35KSE +/- 2363.63, N = 15SE +/- 1780.61, N = 16SE +/- 25.70, N = 15SE +/- 133.33, N = 3SE +/- 2554.63, N = 15SE +/- 71.16, N = 1227340233502871603334102766-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-lgfapi -lglusterfs -lrbd -lrados -lnuma -laio -ldl-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress6K12K18K24K30KMin: 11800 / Avg: 27340 / Max: 39100Min: 13900 / Avg: 23350 / Max: 37600Min: 72 / Avg: 287.4 / Max: 394Min: 15900 / Avg: 16033.33 / Max: 16300Min: 9423 / Avg: 34101.53 / Max: 45800Min: 247 / Avg: 765.92 / Max: 11281. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress400800120016002000SE +/- 2.40, N = 3SE +/- 15.50, N = 3SE +/- 4.18, N = 13SE +/- 0.40, N = 15SE +/- 3.38, N = 3SE +/- 4.51, N = 31712.01693.094.524.01706.01545.0-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress30060090012001500Min: 1709 / Avg: 1712.33 / Max: 1717Min: 1662 / Avg: 1693 / Max: 1709Min: 57.7 / Avg: 94.53 / Max: 112Min: 21.7 / Avg: 24.03 / Max: 26.3Min: 1699 / Avg: 1705.67 / Max: 1710Min: 1536 / Avg: 1545 / Max: 15501. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress90K180K270K360K450KSE +/- 333.33, N = 3SE +/- 3666.67, N = 3SE +/- 1069.09, N = 13SE +/- 97.78, N = 15SE +/- 881.92, N = 3SE +/- 1333.33, N = 3438333433333242006168436667395667-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress80K160K240K320K400KMin: 438000 / Avg: 438333.33 / Max: 439000Min: 426000 / Avg: 433333.33 / Max: 437000Min: 14800 / Avg: 24200 / Max: 28800Min: 5542 / Avg: 6167.67 / Max: 6736Min: 435000 / Avg: 436666.67 / Max: 438000Min: 393000 / Avg: 395666.67 / Max: 3970001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress80160240320400SE +/- 1.528, N = 3SE +/- 0.667, N = 3SE +/- 0.082, N = 15SE +/- 0.340, N = 15SE +/- 0.667, N = 3355.000356.0007.13023.900357.000252.000-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress60120180240300Min: 352 / Avg: 355 / Max: 357Min: 355 / Avg: 355.67 / Max: 357Min: 6.49 / Avg: 7.13 / Max: 7.49Min: 21.1 / Avg: 23.87 / Max: 25.9Min: 251 / Avg: 252.33 / Max: 2531. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress20K40K60K80K100KSE +/- 338.30, N = 3SE +/- 384.42, N = 3SE +/- 20.38, N = 15SE +/- 83.82, N = 15SE +/- 86.60, N = 49086790733177961399140064550-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress16K32K48K64K80KMin: 90200 / Avg: 90866.67 / Max: 91300Min: 90000 / Avg: 90733.33 / Max: 91300Min: 1618 / Avg: 1778.93 / Max: 1869Min: 5389 / Avg: 6139.27 / Max: 6616Min: 64400 / Avg: 64550 / Max: 647001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress130260390520650SE +/- 42.60, N = 15SE +/- 34.98, N = 15SE +/- 62.01, N = 12SE +/- 0.65, N = 3SE +/- 34.68, N = 15SE +/- 63.42, N = 12514.0415.0352.665.3616.0512.0-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress110220330440550Min: 267 / Avg: 513.8 / Max: 752Min: 207 / Avg: 414.87 / Max: 750Min: 40.3 / Avg: 352.55 / Max: 732Min: 64.1 / Avg: 65.33 / Max: 66.3Min: 363 / Avg: 615.67 / Max: 763Min: 208 / Avg: 512.42 / Max: 7571. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress30K60K90K120K150KSE +/- 10856.15, N = 15SE +/- 8941.57, N = 15SE +/- 15896.92, N = 12SE +/- 8898.08, N = 15SE +/- 16237.57, N = 121314531061739027516400157733131225-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress30K60K90K120K150KMin: 68400 / Avg: 131453.33 / Max: 192000Min: 53100 / Avg: 106173.33 / Max: 192000Min: 10300 / Avg: 90275 / Max: 188000Min: 93000 / Avg: 157733.33 / Max: 195000Min: 53300 / Avg: 131225 / Max: 1940001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress130260390520650SE +/- 8.718, N = 3SE +/- 58.224, N = 12SE +/- 0.522, N = 14SE +/- 1.033, N = 3SE +/- 15.005, N = 15SE +/- 0.774, N = 12618.000479.9007.73964.200574.0007.970-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress110220330440550Min: 604 / Avg: 618 / Max: 634Min: 20.1 / Avg: 479.93 / Max: 632Min: 5.46 / Avg: 7.74 / Max: 13.7Min: 62.7 / Avg: 64.23 / Max: 66.2Min: 471 / Avg: 573.87 / Max: 721Min: 3.76 / Avg: 7.97 / Max: 13.21. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress30K60K90K120K150KSE +/- 2027.59, N = 3SE +/- 14924.98, N = 12SE +/- 135.29, N = 14SE +/- 264.58, N = 3SE +/- 3840.88, N = 15SE +/- 198.71, N = 121583331229201937164001470002000-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress30K60K90K120K150KMin: 155000 / Avg: 158333.33 / Max: 162000Min: 5140 / Avg: 122920 / Max: 162000Min: 1361 / Avg: 1936.71 / Max: 3496Min: 16000 / Avg: 16400 / Max: 16900Min: 121000 / Avg: 147000 / Max: 185000Min: 936 / Avg: 2000.42 / Max: 33641. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress2004006008001000SE +/- 1.86, N = 3SE +/- 5.24, N = 3SE +/- 0.42, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3929.0927.0957.025.7933.0958.0-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress2004006008001000Min: 925 / Avg: 928.67 / Max: 931Min: 917 / Avg: 927.33 / Max: 934Min: 25.1 / Avg: 25.7 / Max: 26.5Min: 932 / Avg: 933 / Max: 934Min: 956 / Avg: 957.67 / Max: 9601. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress50K100K150K200K250KSE +/- 333.33, N = 3SE +/- 1201.85, N = 3SE +/- 112.11, N = 3SE +/- 333.33, N = 3SE +/- 333.33, N = 32376672373332450006572238667245333-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress40K80K120K160K200KMin: 237000 / Avg: 237666.67 / Max: 238000Min: 235000 / Avg: 237333.33 / Max: 239000Min: 6414 / Avg: 6572.33 / Max: 6789Min: 238000 / Avg: 238666.67 / Max: 239000Min: 245000 / Avg: 245333.33 / Max: 2460001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress140280420560700SE +/- 8.70, N = 15SE +/- 28.99, N = 15SE +/- 4.56, N = 15SE +/- 0.74, N = 3SE +/- 12.15, N = 15SE +/- 7.01, N = 12667.00606.0040.6163.40664.0099.90-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress120240360480600Min: 611 / Avg: 667.2 / Max: 719Min: 359 / Avg: 606.4 / Max: 723Min: 6.9 / Avg: 40.61 / Max: 66.5Min: 62 / Avg: 63.4 / Max: 64.5Min: 566 / Avg: 663.6 / Max: 730Min: 46.5 / Avg: 99.93 / Max: 1421. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress40K80K120K160K200KSE +/- 2203.60, N = 15SE +/- 7421.20, N = 15SE +/- 1167.83, N = 15SE +/- 95.74, N = 4SE +/- 3129.68, N = 15SE +/- 1780.70, N = 12170867155260103301625016993325483-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs-ll -lrdmacm -libverbs1. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryzfs-directzfs-jailzfs-direct-2gb-arcbtrfs-laptopzfs-direct-no-compresszfs-direct-2gb-arc-no-compress30K60K90K120K150KMin: 157000 / Avg: 170866.67 / Max: 184000Min: 91900 / Avg: 155260 / Max: 185000Min: 1721 / Avg: 10330.47 / Max: 17000Min: 16100 / Avg: 16250 / Max: 16500Min: 145000 / Avg: 169933.33 / Max: 187000Min: 11900 / Avg: 25483.33 / Max: 363001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lcurl -lssl -lcrypto -lz -lpthread -lm -lrt

16 Results Shown

Flexible IO Tester:
  Rand Read - Sync - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS

zfs-direct

Testing initiated at 2 July 2020 11:55 by user root.

zfs-jail

Testing initiated at 2 July 2020 12:33 by user root.

zfs-direct-2gb-arc

Processor: AMD Ryzen 5 1600 Six-Core @ 3.20GHz (12 Cores), Motherboard: MSI MS-7A33 3.0, Memory: 16GB, Disk: 10643GB, Network: Intel PRO/1000 Connection 7.6.1-k

OS: FreeBSD, Kernel: 11.3-RELEASE-p9 (x86_64), Compiler: Clang 10.0.0, File-System: zfs

Testing initiated at 2 July 2020 14:34 by user root.

btrfs-laptop

Processor: Intel Core i7-8750H @ 4.10GHz (6 Cores / 12 Threads), Motherboard: CFL Sienta_CFS (V1.22 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 16GB, Disk: 512GB HFS512G39MND-351, Graphics: Intel UHD 630 6GB, Audio: Realtek ALC255, Network: Realtek RTL8111/8168/8411 + Intel-AC 9560

OS: ManjaroLinux 20.0.3, Kernel: 5.6.16-1-MANJARO (x86_64), Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.6 Mesa 20.0.7, Compiler: Clang 10.0.0 + GCC 10.1.0 + LLVM 10.0.0 + CUDA 10.2, File-System: btrfs, Screen Resolution: 1920x1080

Kernel Notes: i915.enable_psr=0
Environment Notes: NVM_CD_FLAGS=-q
Compiler Notes: Optimized build; Default target: x86_64-pc-linux-gnu; Host CPU: skylake
Disk Notes: MQ-DEADLINE / autodefrag,compress-force=zstd:3,noatime,rw,space_cache,ssd,subvol=/@home,subvolid=258
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0xca
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected

Testing initiated at 2 July 2020 16:49 by user bren077s.

zfs-direct-no-compress

Testing initiated at 2 July 2020 19:27 by user root.

zfs-direct-2gb-arc-no-compress

Processor: AMD Ryzen 5 1600 Six-Core @ 3.20GHz (12 Cores), Motherboard: MSI MS-7A33 3.0, Memory: 16GB, Disk: 10640GB, Network: Intel PRO/1000 Connection 7.6.1-k

OS: FreeBSD, Kernel: 11.3-RELEASE-p9 (x86_64), Compiler: Clang 10.0.0, File-System: zfs

Testing initiated at 2 July 2020 21:00 by user root.