TrueNAS HDD

Xen HVM domU 4.13 testing on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2309171-BRYA-230917667
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
truenas default hdd test
September 17 2023
  2 Hours, 17 Minutes
truenas nvme test
September 17 2023
 
truenas nvme
September 17 2023
  3 Hours, 43 Minutes
Plex XCP-ng Local Storage
September 17 2023
  2 Hours, 46 Minutes
Invert Hiding All Results Option
  2 Hours, 12 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

truenas default hdd test

Security Notes: KPTI

truenas nvme test

truenas nvme

Processor: Intel Xeon E3-1230 v6 @ 3.50GHz (8 Cores), Motherboard: Supermicro Super Server 0123456789, Memory: 32GB, Disk: Generic NVMe Device

OS: FreeBSD, Kernel: 13.1-RELEASE-p7 (x86_64), Compiler: Clang 14.0.5, File-System: zfs

Plex XCP-ng Local Storage

Processor: 4 x Intel Xeon Gold 5120 (7 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 48GB, Graphics: NVIDIA Quadro P4000 8GB

OS: Ubuntu 22.04, Kernel: 5.15.0-83-generic (x86_64), Display Server: X Server, Display Driver: NVIDIA, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: madvise
Processor Notes: CPU Microcode: 0x2007006
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown

TrueNAS HDDProcessorMotherboardMemoryDiskChipsetGraphicsOSKernelCompilerFile-SystemDisplay ServerDisplay DriverScreen ResolutionSystem Layertruenas default hdd testtruenas nvme testtruenas nvmePlex XCP-ng Local StorageIntel Xeon E3-1230 v6 @ 3.50GHz (8 Cores)Supermicro Super Server 012345678932GBGeneric NVMe DeviceFreeBSD13.1-RELEASE-p7 (x86_64)Clang 14.0.5zfs4 x Intel Xeon Gold 5120 (7 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC4096MB48GBNVIDIA Quadro P4000 8GBUbuntu 22.045.15.0-83-generic (x86_64)X ServerNVIDIAGCC 11.4.0ext41024x768Xen HVM domU 4.13OpenBenchmarking.orgSecurity Details- truenas default hdd test: KPTI- truenas nvme test: KPTI- truenas nvme: KPTI- Plex XCP-ng Local Storage: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown Kernel Details- Plex XCP-ng Local Storage: Transparent Huge Pages: madviseProcessor Details- Plex XCP-ng Local Storage: CPU Microcode: 0x2007006Disk Mount Options Details- Plex XCP-ng Local Storage: relatime,rwDisk Details Details- Plex XCP-ng Local Storage: Block Size: 4096

TrueNAS HDDfio: Rand Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directorytruenas default hdd testtruenas nvme testtruenas nvmePlex XCP-ng Local Storage6472645756814533364431131145000217513933337651203335421867337850782910992813337810117515033370025600069752790067401350012107742067622166678053129000796563700799231967791615833616361351413361667610525963323334898313333747623933373211170007907786610742750007842122515666770835666772112886770521410012277851771662293338083129333796763733798831967796115933650964805861496676465116614900022351430003890124667550188000736572741077275667727221402736677432594677573303007442149004077261000683521900079401271338062644677934317277878157536172614014183630006109262233566749373160007576242333734011766775227432128933000072452306295333709756767722628900705914100446428566779142530008321133000756260500746329833758815186150667149000143667124000882332766672756675940030267149002596672206671243336270031653151803636673346673153332406671176673233332966675680028900141002830002496671260006122530300148331017512266776633405332136710733200000110333584673026715367166000856674226721333108671120010100123667776004093320967107332030001090005766730133154331693338506742767213331070048449339.351870.9121203324681705479746599466467452634667673709702693973979782994860914947961670672648714669950954961660668680670665669OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14002800420056007000SE +/- 5.93, N = 3SE +/- 4.91, N = 365096472

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14002800420056007000SE +/- 3.38, N = 3SE +/- 3.48, N = 364806457

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test130260390520650SE +/- 0.67, N = 3SE +/- 0.88, N = 3587568

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 25.00, N = 414966714533310175

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14002800420056007000SE +/- 2.85, N = 3SE +/- 10.00, N = 364656443

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30060090012001500SE +/- 0.33, N = 3SE +/- 0.33, N = 311671131

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 0.00, N = 3149000145000

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test5001000150020002500SE +/- 5.84, N = 3SE +/- 3.18, N = 322412175

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 333.33, N = 3143000139333

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test8001600240032004000SE +/- 14.15, N = 3SE +/- 2.08, N = 338903765

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 333.33, N = 3124667120333

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test12002400360048006000SE +/- 8.37, N = 3SE +/- 2.40, N = 355155421

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test20K40K60K80K100KSE +/- 321.46, N = 3SE +/- 66.67, N = 38800086733

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 50.27, N = 3SE +/- 24.33, N = 373657850

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 12.90, N = 3SE +/- 35.75, N = 372747829

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2004006008001000SE +/- 5.86, N = 3SE +/- 3.79, N = 310811099

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 3179.80, N = 3SE +/- 881.92, N = 3SE +/- 333.33, N = 3275667281333122667

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 11.26, N = 3SE +/- 38.30, N = 372727810

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test5001000150020002500SE +/- 15.89, N = 3SE +/- 8.69, N = 321521175

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1452.97, N = 3SE +/- 881.92, N = 3SE +/- 874.33, N = 327366715033376633

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 3.48, N = 3SE +/- 6.49, N = 374327002

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13K26K39K52K65KSE +/- 33.33, N = 3SE +/- 57.74, N = 35946756000

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 5.51, N = 3SE +/- 1.15, N = 375736975

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test6K12K18K24K30KSE +/- 0.00, N = 3SE +/- 0.00, N = 33030027900

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 3.18, N = 3SE +/- 1.00, N = 374446740

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test3K6K9K12K15KSE +/- 0.00, N = 3SE +/- 0.00, N = 31490013500

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test9001800270036004500SE +/- 38.12, N = 3SE +/- 12.91, N = 1540771210

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2645.75, N = 3SE +/- 825.38, N = 15SE +/- 218.58, N = 32610007742040533

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 74.90, N = 3SE +/- 19.64, N = 369066762

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage50K100K150K200K250KSE +/- 1527.53, N = 3SE +/- 666.67, N = 3SE +/- 233.33, N = 321900021666721367

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 80.56, N = 15SE +/- 47.86, N = 379408053

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage30K60K90K120K150KSE +/- 1305.18, N = 15SE +/- 577.35, N = 3SE +/- 33.33, N = 312713312900010733

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 56.54, N = 3SE +/- 50.83, N = 380627965

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14K28K42K56K70KSE +/- 448.45, N = 3SE +/- 404.15, N = 36446763700

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 73.35, N = 15SE +/- 24.57, N = 379347992

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test7K14K21K28K35KSE +/- 295.44, N = 15SE +/- 88.19, N = 33172731967

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 71.41, N = 15SE +/- 22.33, N = 378787916

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test3K6K9K12K15KSE +/- 145.36, N = 15SE +/- 33.33, N = 31575315833

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13002600390052006500SE +/- 1.67, N = 3SE +/- 5.49, N = 361726163

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13002600390052006500SE +/- 3.00, N = 3SE +/- 5.17, N = 361406135

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30060090012001500SE +/- 4.26, N = 3SE +/- 2.65, N = 314211413

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage80K160K240K320K400KSE +/- 577.35, N = 3SE +/- 666.67, N = 3SE +/- 577.35, N = 3363000361667200000

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13002600390052006500SE +/- 1.53, N = 3SE +/- 3.21, N = 361096105

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test6001200180024003000SE +/- 2.19, N = 3SE +/- 1.45, N = 326222596

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage70K140K210K280K350KSE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 666.67, N = 3335667332333110333

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test11002200330044005500SE +/- 16.76, N = 3SE +/- 13.20, N = 349374898

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage70K140K210K280K350KSE +/- 1154.70, N = 3SE +/- 881.92, N = 3SE +/- 202.76, N = 331600031333358467

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 24.11, N = 3SE +/- 12.13, N = 375767476

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage50K100K150K200K250KSE +/- 666.67, N = 3SE +/- 333.33, N = 3SE +/- 88.19, N = 324233323933330267

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 6.39, N = 3SE +/- 10.97, N = 373467321

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 0.00, N = 3SE +/- 33.33, N = 311766711700015367

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 21.26, N = 3SE +/- 26.36, N = 375227907

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 102.76, N = 3SE +/- 26.17, N = 374327866

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30060090012001500SE +/- 15.97, N = 4SE +/- 8.95, N = 312891074

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage70K140K210K280K350KSE +/- 4143.27, N = 4SE +/- 2309.40, N = 3SE +/- 0.00, N = 3330000275000166000

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 52.79, N = 3SE +/- 29.18, N = 372457842

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test5001000150020002500SE +/- 19.40, N = 3SE +/- 2.31, N = 323161225

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1201.85, N = 3SE +/- 333.33, N = 3SE +/- 638.57, N = 329533315666785667

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 4.91, N = 3SE +/- 3.21, N = 371007083

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test12K24K36K48K60KSE +/- 33.33, N = 3SE +/- 33.33, N = 35676756667

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 3.84, N = 3SE +/- 5.36, N = 372297211

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test6K12K18K24K30KSE +/- 0.00, N = 3SE +/- 33.33, N = 32890028867

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 0.88, N = 3SE +/- 4.16, N = 370597052

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test3K6K9K12K15KSE +/- 0.00, N = 3SE +/- 0.00, N = 31410014100

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test10002000300040005000SE +/- 28.81, N = 3SE +/- 12.43, N = 644641227

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1666.67, N = 3SE +/- 797.25, N = 6SE +/- 33.33, N = 32856677851742267

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 97.63, N = 4SE +/- 9.33, N = 379147166

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage50K100K150K200K250KSE +/- 3027.65, N = 4SE +/- 333.33, N = 3SE +/- 33.33, N = 325300022933321333

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 55.97, N = 3SE +/- 31.17, N = 383218083

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage30K60K90K120K150KSE +/- 1000.00, N = 3SE +/- 666.67, N = 3SE +/- 120.19, N = 313300012933310867

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 91.99, N = 4SE +/- 21.18, N = 376537967

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14K28K42K56K70KSE +/- 721.11, N = 3SE +/- 145.30, N = 36050063733

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 33.14, N = 3SE +/- 13.04, N = 375767988

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test7K14K21K28K35KSE +/- 218.58, N = 3SE +/- 33.33, N = 32983331967

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 70.80, N = 7SE +/- 16.52, N = 375887961

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test3K6K9K12K15KSE +/- 145.45, N = 7SE +/- 33.33, N = 31518615933

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 57.74, N = 315066711200

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 0.00, N = 314900010100

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvme30K60K90K120K150KSE +/- 333.33, N = 3143667

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvme30K60K90K120K150KSE +/- 577.35, N = 3124000

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvme20K40K60K80K100KSE +/- 145.30, N = 388233

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1452.97, N = 3SE +/- 333.33, N = 3276667123667

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2027.59, N = 3SE +/- 288.68, N = 327566777600

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme13K26K39K52K65KSE +/- 57.74, N = 359400

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme6K12K18K24K30KSE +/- 33.33, N = 330267

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 0.00, N = 314900

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1855.92, N = 3SE +/- 33.33, N = 325966740933

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage50K100K150K200K250KSE +/- 2403.70, N = 3SE +/- 33.33, N = 322066720967

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 1855.92, N = 3SE +/- 33.33, N = 312433310733

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme13K26K39K52K65KSE +/- 611.01, N = 362700

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme7K14K21K28K35KSE +/- 239.62, N = 1531653

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 139.28, N = 515180

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage80K160K240K320K400KSE +/- 1201.85, N = 3SE +/- 1000.00, N = 3363667203000

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage70K140K210K280K350KSE +/- 666.67, N = 3SE +/- 577.35, N = 3334667109000

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage70K140K210K280K350KSE +/- 666.67, N = 3SE +/- 33.33, N = 331533357667

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage50K100K150K200K250KSE +/- 666.67, N = 3SE +/- 33.33, N = 324066730133

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 33.33, N = 311766715433

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage70K140K210K280K350KSE +/- 1452.97, N = 3SE +/- 666.67, N = 3323333169333

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2333.33, N = 3SE +/- 480.74, N = 329666785067

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme12K24K36K48K60KSE +/- 57.74, N = 356800

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme6K12K18K24K30KSE +/- 0.00, N = 328900

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 0.00, N = 314100

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2516.61, N = 3SE +/- 317.98, N = 328300042767

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage50K100K150K200K250KSE +/- 2185.81, N = 3SE +/- 66.67, N = 324966721333

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 0.00, N = 312600010700

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme13K26K39K52K65KSE +/- 748.75, N = 461225

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme6K12K18K24K30KSE +/- 115.47, N = 330300

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 66.67, N = 314833

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 4.70, N = 3484

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage110220330440550SE +/- 5.84, N = 3493

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage918273645SE +/- 0.61, N = 1539.3

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage110220330440550SE +/- 3.82, N = 15518

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage1632486480SE +/- 1.19, N = 1570.9

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage306090120150SE +/- 0.00, N = 3121

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage4080120160200SE +/- 1.20, N = 3203

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage70140210280350SE +/- 2.34, N = 15324

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 2.85, N = 3681

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 3.84, N = 3705

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 1.73, N = 3483

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage160320480640800SE +/- 5.48, N = 15746

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage130260390520650SE +/- 2.31, N = 3606

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 0.88, N = 3466

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 0.33, N = 3467

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 0.88, N = 3452

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 0.67, N = 3640

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 7.00, N = 3667

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 2.73, N = 3673

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 5.86, N = 3709

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 5.21, N = 3702

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 7.58, N = 4698

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 4.16, N = 3973

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.53, N = 3979

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.67, N = 3794

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.53, N = 3994

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 4.33, N = 3860

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 2.60, N = 3914

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.53, N = 3947

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 2.85, N = 3963

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 0.88, N = 3670

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 1.45, N = 3672

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 2.73, N = 3661

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 1.86, N = 3714

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 5.21, N = 3669

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 2.19, N = 31010

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 11.24, N = 3992

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 11.02, N = 31004

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 4.63, N = 3668

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 1.20, N = 3668

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 8.74, N = 3680

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 0.88, N = 3671

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 2.40, N = 3668

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 2.03, N = 3669

152 Results Shown

Flexible IO Tester:
  Rand Read - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 1MB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 2MB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 4MB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directory
  Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directory

truenas default hdd test

Security Notes: KPTI

Testing initiated at 17 September 2023 14:29 by user bryant8507.

truenas nvme test

Security Notes: KPTI

Testing initiated at 17 September 2023 16:20 by user bryant8507.

truenas nvme

Processor: Intel Xeon E3-1230 v6 @ 3.50GHz (8 Cores), Motherboard: Supermicro Super Server 0123456789, Memory: 32GB, Disk: Generic NVMe Device

OS: FreeBSD, Kernel: 13.1-RELEASE-p7 (x86_64), Compiler: Clang 14.0.5, File-System: zfs

Security Notes: KPTI

Testing initiated at 17 September 2023 16:28 by user bryant8507.

Plex XCP-ng Local Storage

Processor: 4 x Intel Xeon Gold 5120 (7 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 48GB, Graphics: NVIDIA Quadro P4000 8GB

OS: Ubuntu 22.04, Kernel: 5.15.0-83-generic (x86_64), Display Server: X Server, Display Driver: NVIDIA, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: madvise
Processor Notes: CPU Microcode: 0x2007006
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown

Testing initiated at 17 September 2023 21:56 by user bryant8507.