TrueNAS HDD

Xen HVM domU 4.13 testing on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2309171-BRYA-230917667&grt&sor.

TrueNAS HDDProcessorMotherboardMemoryDiskChipsetGraphicsOSKernelCompilerFile-SystemDisplay ServerDisplay DriverScreen ResolutionSystem Layertruenas default hdd testtruenas nvme testtruenas nvmePlex XCP-ng Local StorageIntel Xeon E3-1230 v6 @ 3.50GHz (8 Cores)Supermicro Super Server 012345678932GBGeneric NVMe DeviceFreeBSD13.1-RELEASE-p7 (x86_64)Clang 14.0.5zfs4 x Intel Xeon Gold 5120 (7 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC4096MB48GBNVIDIA Quadro P4000 8GBUbuntu 22.045.15.0-83-generic (x86_64)X ServerNVIDIAGCC 11.4.0ext41024x768Xen HVM domU 4.13OpenBenchmarking.orgSecurity Details- truenas default hdd test: KPTI- truenas nvme test: KPTI- truenas nvme: KPTI- Plex XCP-ng Local Storage: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown Kernel Details- Plex XCP-ng Local Storage: Transparent Huge Pages: madviseProcessor Details- Plex XCP-ng Local Storage: CPU Microcode: 0x2007006Disk Mount Options Details- Plex XCP-ng Local Storage: relatime,rwDisk Details Details- Plex XCP-ng Local Storage: Block Size: 4096

TrueNAS HDDfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 1MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4MB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Rand Write - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 8KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Read - POSIX AIO - Yes - No - 512KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 16KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 32KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 64KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 128KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 256KB - Default Test Directoryfio: Seq Write - POSIX AIO - Yes - No - 512KB - Default Test Directorytruenas default hdd testtruenas nvme testtruenas nvmePlex XCP-ng Local Storage14533314500013933312033386733281333150333560002790013500774202166671290006370031967158333616673323333133332393331170002750001566675666728867141007851722933312933363733319671593364726457568644311312175376554217850782910997810117570026975674012106762805379657992791661636135141361052596489874767321790778661074784212257083721170521227716680837967798879611496671490001430001246678800027566727366759467303001490026100021900012713364467317271575336300033566731600024233311766733000029533356767289001410028566725300013300060500298331518665096480586646511662235389055017365727410777272214074327573744240776835794080627934787861726140141861092622493775767340752274321289724523067097722670594464791483217562746375881506671490001436671240008823327666727566759400302671490025966722066712433362700316531518036366733466731533324066711766732333329666756800289001410028300024966712600061225303001483310175122667766334053321367107332000001103335846730267153671660008566742267213331086748449339.351870.912120332468170547974659946646745263466767370970269397397978299486091494796167067264871466995095496166066868067066566911200101001236677760040933209671073320300010900057667301331543316933385067427672133310700OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 25.00, N = 414966714533310175

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 0.00, N = 3149000145000

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 333.33, N = 3143000139333

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 333.33, N = 3124667120333

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test20K40K60K80K100KSE +/- 321.46, N = 3SE +/- 66.67, N = 38800086733

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 881.92, N = 3SE +/- 3179.80, N = 3SE +/- 333.33, N = 3281333275667122667

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1452.97, N = 3SE +/- 881.92, N = 3SE +/- 874.33, N = 327366715033376633

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13K26K39K52K65KSE +/- 33.33, N = 3SE +/- 57.74, N = 35946756000

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test6K12K18K24K30KSE +/- 0.00, N = 3SE +/- 0.00, N = 33030027900

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test3K6K9K12K15KSE +/- 0.00, N = 3SE +/- 0.00, N = 31490013500

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2645.75, N = 3SE +/- 825.38, N = 15SE +/- 218.58, N = 32610007742040533

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage50K100K150K200K250KSE +/- 1527.53, N = 3SE +/- 666.67, N = 3SE +/- 233.33, N = 321900021666721367

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 577.35, N = 3SE +/- 1305.18, N = 15SE +/- 33.33, N = 312900012713310733

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14K28K42K56K70KSE +/- 448.45, N = 3SE +/- 404.15, N = 36446763700

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme7K14K21K28K35KSE +/- 88.19, N = 3SE +/- 295.44, N = 153196731727

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme3K6K9K12K15KSE +/- 33.33, N = 3SE +/- 145.36, N = 151583315753

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage80K160K240K320K400KSE +/- 577.35, N = 3SE +/- 666.67, N = 3SE +/- 577.35, N = 3363000361667200000

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage70K140K210K280K350KSE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 666.67, N = 3335667332333110333

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage70K140K210K280K350KSE +/- 1154.70, N = 3SE +/- 881.92, N = 3SE +/- 202.76, N = 331600031333358467

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage50K100K150K200K250KSE +/- 666.67, N = 3SE +/- 333.33, N = 3SE +/- 88.19, N = 324233323933330267

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 0.00, N = 3SE +/- 33.33, N = 311766711700015367

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage70K140K210K280K350KSE +/- 4143.27, N = 4SE +/- 2309.40, N = 3SE +/- 0.00, N = 3330000275000166000

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1201.85, N = 3SE +/- 333.33, N = 3SE +/- 638.57, N = 329533315666785667

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test12K24K36K48K60KSE +/- 33.33, N = 3SE +/- 33.33, N = 35676756667

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test6K12K18K24K30KSE +/- 0.00, N = 3SE +/- 33.33, N = 32890028867

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test3K6K9K12K15KSE +/- 0.00, N = 3SE +/- 0.00, N = 31410014100

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1666.67, N = 3SE +/- 797.25, N = 6SE +/- 33.33, N = 32856677851742267

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage50K100K150K200K250KSE +/- 3027.65, N = 4SE +/- 333.33, N = 3SE +/- 33.33, N = 325300022933321333

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd testPlex XCP-ng Local Storage30K60K90K120K150KSE +/- 1000.00, N = 3SE +/- 666.67, N = 3SE +/- 120.19, N = 313300012933310867

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme14K28K42K56K70KSE +/- 145.30, N = 3SE +/- 721.11, N = 36373360500

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme7K14K21K28K35KSE +/- 33.33, N = 3SE +/- 218.58, N = 33196729833

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO TesterType: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme3K6K9K12K15KSE +/- 33.33, N = 3SE +/- 145.45, N = 71593315186

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 4.70, N = 3484

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage110220330440550SE +/- 5.84, N = 3493

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage918273645SE +/- 0.61, N = 1539.3

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage110220330440550SE +/- 3.82, N = 15518

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage1632486480SE +/- 1.19, N = 1570.9

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage306090120150SE +/- 0.00, N = 3121

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage4080120160200SE +/- 1.20, N = 3203

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage70140210280350SE +/- 2.34, N = 15324

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 2.85, N = 3681

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 3.84, N = 3705

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 1.73, N = 3483

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage160320480640800SE +/- 5.48, N = 15746

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage130260390520650SE +/- 2.31, N = 3606

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 0.88, N = 3466

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 0.33, N = 3467

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage100200300400500SE +/- 0.88, N = 3452

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 0.67, N = 3640

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 7.00, N = 3667

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 2.73, N = 3673

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 5.86, N = 3709

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 5.21, N = 3702

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 7.58, N = 4698

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 4.16, N = 3973

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.53, N = 3979

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.67, N = 3794

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.53, N = 3994

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 4.33, N = 3860

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 2.60, N = 3914

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 3.53, N = 3947

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 2.85, N = 3963

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 0.88, N = 3670

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 1.45, N = 3672

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 2.73, N = 3661

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 1.86, N = 3714

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 5.21, N = 3669

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 2.19, N = 31010

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 11.24, N = 3992

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage2004006008001000SE +/- 11.02, N = 31004

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 4.63, N = 3668

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 1.20, N = 3668

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage150300450600750SE +/- 8.74, N = 3680

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 0.88, N = 3671

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 2.40, N = 3668

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.28Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test DirectoryPlex XCP-ng Local Storage140280420560700SE +/- 2.03, N = 3669

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14002800420056007000SE +/- 5.93, N = 3SE +/- 4.91, N = 365096472

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14002800420056007000SE +/- 3.38, N = 3SE +/- 3.48, N = 364806457

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test130260390520650SE +/- 0.67, N = 3SE +/- 0.88, N = 3587568

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test14002800420056007000SE +/- 2.85, N = 3SE +/- 10.00, N = 364656443

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30060090012001500SE +/- 0.33, N = 3SE +/- 0.33, N = 311671131

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test5001000150020002500SE +/- 5.84, N = 3SE +/- 3.18, N = 322412175

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test8001600240032004000SE +/- 14.15, N = 3SE +/- 2.08, N = 338903765

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test12002400360048006000SE +/- 8.37, N = 3SE +/- 2.40, N = 355155421

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 24.33, N = 3SE +/- 50.27, N = 378507365

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 35.75, N = 3SE +/- 12.90, N = 378297274

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2004006008001000SE +/- 3.79, N = 3SE +/- 5.86, N = 310991081

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 38.30, N = 3SE +/- 11.26, N = 378107272

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test5001000150020002500SE +/- 15.89, N = 3SE +/- 8.69, N = 321521175

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 3.48, N = 3SE +/- 6.49, N = 374327002

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 5.51, N = 3SE +/- 1.15, N = 375736975

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 3.18, N = 3SE +/- 1.00, N = 374446740

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test9001800270036004500SE +/- 38.12, N = 3SE +/- 12.91, N = 1540771210

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 74.90, N = 3SE +/- 19.64, N = 369066762

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 47.86, N = 3SE +/- 80.56, N = 1580537940

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 56.54, N = 3SE +/- 50.83, N = 380627965

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 24.57, N = 3SE +/- 73.35, N = 1579927934

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 22.33, N = 3SE +/- 71.41, N = 1579167878

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13002600390052006500SE +/- 1.67, N = 3SE +/- 5.49, N = 361726163

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13002600390052006500SE +/- 3.00, N = 3SE +/- 5.17, N = 361406135

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30060090012001500SE +/- 4.26, N = 3SE +/- 2.65, N = 314211413

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test13002600390052006500SE +/- 1.53, N = 3SE +/- 3.21, N = 361096105

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test6001200180024003000SE +/- 2.19, N = 3SE +/- 1.45, N = 326222596

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test11002200330044005500SE +/- 16.76, N = 3SE +/- 13.20, N = 349374898

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 24.11, N = 3SE +/- 12.13, N = 375767476

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test16003200480064008000SE +/- 6.39, N = 3SE +/- 10.97, N = 373467321

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 1MB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 26.36, N = 3SE +/- 21.26, N = 379077522

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 26.17, N = 3SE +/- 102.76, N = 378667432

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test30060090012001500SE +/- 15.97, N = 4SE +/- 8.95, N = 312891074

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 29.18, N = 3SE +/- 52.79, N = 378427245

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test5001000150020002500SE +/- 19.40, N = 3SE +/- 2.31, N = 323161225

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 4.91, N = 3SE +/- 3.21, N = 371007083

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 3.84, N = 3SE +/- 5.36, N = 372297211

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test15003000450060007500SE +/- 0.88, N = 3SE +/- 4.16, N = 370597052

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test10002000300040005000SE +/- 28.81, N = 3SE +/- 12.43, N = 644641227

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 97.63, N = 4SE +/- 9.33, N = 379147166

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmetruenas default hdd test2K4K6K8K10KSE +/- 55.97, N = 3SE +/- 31.17, N = 383218083

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 21.18, N = 3SE +/- 91.99, N = 479677653

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 13.04, N = 3SE +/- 33.14, N = 379887576

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas default hdd testtruenas nvme2K4K6K8K10KSE +/- 16.52, N = 3SE +/- 70.80, N = 779617588

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 57.74, N = 315066711200

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 0.00, N = 314900010100

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvme30K60K90K120K150KSE +/- 333.33, N = 3143667

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvme30K60K90K120K150KSE +/- 577.35, N = 3124000

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvme20K40K60K80K100KSE +/- 145.30, N = 388233

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1452.97, N = 3SE +/- 333.33, N = 3276667123667

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2027.59, N = 3SE +/- 288.68, N = 327566777600

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme13K26K39K52K65KSE +/- 57.74, N = 359400

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme6K12K18K24K30KSE +/- 33.33, N = 330267

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 0.00, N = 314900

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 1855.92, N = 3SE +/- 33.33, N = 325966740933

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage50K100K150K200K250KSE +/- 2403.70, N = 3SE +/- 33.33, N = 322066720967

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 1855.92, N = 3SE +/- 33.33, N = 312433310733

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme13K26K39K52K65KSE +/- 611.01, N = 362700

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme7K14K21K28K35KSE +/- 239.62, N = 1531653

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 139.28, N = 515180

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage80K160K240K320K400KSE +/- 1201.85, N = 3SE +/- 1000.00, N = 3363667203000

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage70K140K210K280K350KSE +/- 666.67, N = 3SE +/- 577.35, N = 3334667109000

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage70K140K210K280K350KSE +/- 666.67, N = 3SE +/- 33.33, N = 331533357667

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage50K100K150K200K250KSE +/- 666.67, N = 3SE +/- 33.33, N = 324066730133

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 33.33, N = 311766715433

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage70K140K210K280K350KSE +/- 1452.97, N = 3SE +/- 666.67, N = 3323333169333

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2333.33, N = 3SE +/- 480.74, N = 329666785067

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme12K24K36K48K60KSE +/- 57.74, N = 356800

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme6K12K18K24K30KSE +/- 0.00, N = 328900

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 0.00, N = 314100

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage60K120K180K240K300KSE +/- 2516.61, N = 3SE +/- 317.98, N = 328300042767

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 32KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage50K100K150K200K250KSE +/- 2185.81, N = 3SE +/- 66.67, N = 324966721333

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: Default Test Directorytruenas nvmePlex XCP-ng Local Storage30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 0.00, N = 312600010700

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128KB - Disk Target: Default Test Directorytruenas nvme13K26K39K52K65KSE +/- 748.75, N = 461225

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 256KB - Disk Target: Default Test Directorytruenas nvme6K12K18K24K30KSE +/- 115.47, N = 330300

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: Default Test Directorytruenas nvme3K6K9K12K15KSE +/- 66.67, N = 314833

Phoronix Test Suite v10.8.5