sa3400d

PVE-NVME-R10-4DISK-fio

HTML result view exported from: https://openbenchmarking.org/result/2311037-TCST-231001402&grr&rdt.

sa3400dProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayeriSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio2 x AMD Ryzen 9 5900X 12-Core (32 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC16GB29GBbochs-drmdrmfbUbuntu 22.045.15.0-82-generic (x86_64)1.3.238GCC 11.4.0ext41024x768Xen HVM domU 4.132 x Intel Xeon Gold 6152 (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH934GB QEMU HDDIntel 82801IQEMU MonitorRed Hat Virtio device5.15.0-84-generic (x86_64)1280x800KVM3 x AMD EPYC 7402 24-Core (12 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC30GB1024x768Xen HVM domU 4.13AMD EPYC 7543 32-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH934GB QEMU HDDIntel 82801IQEMU MonitorRed Hat Virtio device5.15.0-86-generic (x86_64)1280x800KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- iSCSI XCP-NG: CPU Microcode: 0xa20120a- NFS XCP-NG: CPU Microcode: 0xa20120a- PVE-SAS-SSD-fio: CPU Microcode: 0x2007006- PVE-SATA-SSD-fio: CPU Microcode: 0x2007006- XCP-NVME-R1-fio: CPU Microcode: 0x830107a- PVE-NVME-R10-4DISK-fio: CPU Microcode: 0xa00110dDisk Mount Options Details- iSCSI XCP-NG, NFS XCP-NG, XCP-NVME-R1-fio: relatime,rwDisk Details Details- iSCSI XCP-NG, NFS XCP-NG, XCP-NVME-R1-fio: Block Size: 4096Security Details- iSCSI XCP-NG: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - NFS XCP-NG: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SAS-SSD-fio: gather_data_sampling: Unknown: Dependent on hypervisor status + itlb_multihit: Not affected + l1tf: Mitigation of PTE Inversion; VMX: flush not necessary SMT disabled + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown - PVE-SATA-SSD-fio: gather_data_sampling: Unknown: Dependent on hypervisor status + itlb_multihit: Not affected + l1tf: Mitigation of PTE Inversion; VMX: flush not necessary SMT disabled + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown - XCP-NVME-R1-fio: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-fio: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected Disk Details- PVE-SAS-SSD-fio, PVE-SATA-SSD-fio, PVE-NVME-R10-4DISK-fio: NONE / relatime,rw / Block Size: 4096

sa3400dfio: Seq Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - 1 - Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio152111608445.48104425417699.01216541353.39172976691904.82230521440.7414261426.38184961155.9914081408.40225631410.1714131412.98114883459533.6014211421.57119967479869.1538995155981.56192871205.44128753515012.43218291364.3212331232.61182771142.2914331433.42213201332.5012931292.8378360313440.5814281428.4298926395704.2792847371388.68389642435.24133298533191.80709954437.1825792579.66461842886.5243474303.10634163963.5025552554.68113147452587.8736383637.9075861303445.1672796291184.1115031961989.1082878331512.34263181644.91939961583.6814848950301.2317511751.68262131638.35942964833.1577689310754.7917601760.23115737462947.3174646298582.8916870270225.16117149468597.96191061194.1410571057.4414649937533.0412411241.23201401258.7810511050.9198732394930.2012301229.701069642783.451035041400.863968253974.01206319825277.611411468821.62438449049.274081261184.321720517205.021553499709.30451461886.65206395825579.891467014670.08OpenBenchmarking.org

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio30K60K90K120K150KSE +/- 5903.26, N = 12SE +/- 3728.16, N = 15SE +/- 709.81, N = 3SE +/- 804.62, N = 15SE +/- 6276.07, N = 12SE +/- 26.83, N = 4152111119967989267586111573710696-ll -lz - MIN: 103077.64 / MAX: 172524.33-ll -lz - MIN: 85674.41 / MAX: 134860MIN: 97970.63 / MAX: 100313.05MIN: 70844.74 / MAX: 80423.51MIN: 89048.78 / MAX: 150974.031. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio130K260K390K520K650KSE +/- 23613.03, N = 12SE +/- 14912.65, N = 15SE +/- 2839.24, N = 3SE +/- 3218.47, N = 15SE +/- 25104.31, N = 12SE +/- 107.29, N = 4608445.48479869.15395704.27303445.16462947.3142783.45-ll -lz - MIN: 412310.6 / MAX: 690097.59-ll -lz - MIN: 342697.58 / MAX: 539439.96MIN: 391883.02 / MAX: 401252.52MIN: 283379 / MAX: 321694.32MIN: 356195.36 / MAX: 603896.431. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio20K40K60K80K100KSE +/- 624.88, N = 3SE +/- 742.00, N = 12SE +/- 803.63, N = 3SE +/- 913.82, N = 12SE +/- 1696.14, N = 13SE +/- 57.87, N = 41044253899592847727967464610350-ll -lz - MIN: 103204.38 / MAX: 105268.29-ll -lz - MIN: 34495.97 / MAX: 43391.88MIN: 91490.96 / MAX: 94272.26MIN: 68229.61 / MAX: 78245.37MIN: 67194.39 / MAX: 86221.091. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio90K180K270K360K450KSE +/- 2499.52, N = 3SE +/- 2968.01, N = 12SE +/- 3214.61, N = 3SE +/- 3655.27, N = 12SE +/- 6784.56, N = 13SE +/- 231.48, N = 4417699.01155981.56371388.68291184.11298582.8941400.86-ll -lz - MIN: 412817.57 / MAX: 421073.22-ll -lz - MIN: 137984.09 / MAX: 173567.74MIN: 365963.97 / MAX: 377089.44MIN: 272918.71 / MAX: 312981.77MIN: 268777.81 / MAX: 344884.631. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio8K16K24K32K40KSE +/- 214.28, N = 6SE +/- 154.31, N = 3SE +/- 720.63, N = 15SE +/- 15.36, N = 3SE +/- 254.53, N = 15SE +/- 3.80, N = 421654192873896415031168703968-ll -lz - MIN: 20588.04 / MAX: 21930.05-ll -lz - MIN: 18980.62 / MAX: 19472.58MIN: 34966.58 / MAX: 44257.78MIN: 15005.17 / MAX: 15058.29MIN: 15150.57 / MAX: 18484.55MIN: 3958.54 / MAX: 3976.921. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio200K400K600K800K1000KSE +/- 13.39, N = 6SE +/- 9.65, N = 3SE +/- 45.04, N = 15SE +/- 984.67, N = 3SE +/- 119375.03, N = 15SE +/- 243.95, N = 41353.391205.442435.24961989.10270225.16253974.01MIN: 960336.93 / MAX: 963743.34MIN: 1025.26 / MAX: 1047960.13MIN: 253349.81 / MAX: 254529.671. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio40K80K120K160K200KSE +/- 1799.07, N = 3SE +/- 1758.86, N = 15SE +/- 1409.20, N = 3SE +/- 271.46, N = 3SE +/- 1777.46, N = 15SE +/- 622.34, N = 417297612875313329882878117149206319-ll -lz - MIN: 169871.42 / MAX: 176103.45-ll -lz - MIN: 111689.26 / MAX: 138445.07MIN: 130529.06 / MAX: 135137.88MIN: 82403.55 / MAX: 83343.8MIN: 108826.53 / MAX: 130870.88MIN: 204697.03 / MAX: 207717.761. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio200K400K600K800K1000KSE +/- 7196.24, N = 3SE +/- 7035.45, N = 15SE +/- 5636.73, N = 3SE +/- 1085.66, N = 3SE +/- 7109.83, N = 15SE +/- 2489.36, N = 4691904.82515012.43533191.80331512.34468597.96825277.61-ll -lz - MIN: 679485.78 / MAX: 704413.8-ll -lz - MIN: 446757.07 / MAX: 553780.17MIN: 522116.32 / MAX: 540551.18MIN: 329614.76 / MAX: 333375.1MIN: 435306.38 / MAX: 523483.82MIN: 818788.42 / MAX: 830871.321. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio30K60K90K120K150KSE +/- 162.60, N = 3SE +/- 20.33, N = 3SE +/- 703.79, N = 15SE +/- 81.39, N = 3SE +/- 202.92, N = 5SE +/- 1882.32, N = 42305221829709952631819106141146-ll -lz - MIN: 22831.78 / MAX: 23369.16-ll -lz - MIN: 21790.82 / MAX: 21860.21MIN: 66518.12 / MAX: 75378.1MIN: 26215.38 / MAX: 26479.1MIN: 18613.54 / MAX: 19827.62MIN: 137012.33 / MAX: 145928.531. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio2K4K6K8K10KSE +/- 10.16, N = 3SE +/- 1.27, N = 3SE +/- 43.99, N = 15SE +/- 5.09, N = 3SE +/- 12.68, N = 5SE +/- 117.65, N = 41440.741364.324437.181644.911194.148821.62MIN: 4157.39 / MAX: 4711.14MIN: 1638.47 / MAX: 1654.95MIN: 8563.27 / MAX: 9120.541. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio6001200180024003000SE +/- 4.29, N = 3SE +/- 3.52, N = 3SE +/- 55.39, N = 15SE +/- 2.34, N = 3SE +/- 8.67, N = 3SE +/- 0.90, N = 41426123325799391057438-ll -lz - MIN: 1418.87 / MAX: 1433.73-ll -lz - MIN: 1225.95 / MAX: 1237.98MIN: 2145.02 / MAX: 2879.4MIN: 935.67 / MAX: 943.3MIN: 1044.53 / MAX: 1073.92MIN: 436.22 / MAX: 440.541. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio200K400K600K800K1000KSE +/- 4.29, N = 3SE +/- 3.52, N = 3SE +/- 55.39, N = 15SE +/- 2399.85, N = 3SE +/- 8.67, N = 3SE +/- 928.79, N = 41426.381232.612579.66961583.681057.44449049.27MIN: 958465.17 / MAX: 966302.68MIN: 446726.53 / MAX: 451164.931. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio10K20K30K40K50KSE +/- 105.36, N = 3SE +/- 131.07, N = 15SE +/- 202.40, N = 3SE +/- 46.66, N = 3SE +/- 27.87, N = 3SE +/- 6.27, N = 418496182774618414848146494081-ll -lz - MIN: 18361.65 / MAX: 18703.55-ll -lz - MIN: 17165.66 / MAX: 18956.57MIN: 45856.09 / MAX: 46553.58MIN: 14766.95 / MAX: 14928.59MIN: 14612.21 / MAX: 14703.571. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio200K400K600K800K1000KSE +/- 6.59, N = 3SE +/- 8.19, N = 15SE +/- 12.65, N = 3SE +/- 2986.07, N = 3SE +/- 1783.38, N = 3SE +/- 401.63, N = 41155.991142.292886.52950301.23937533.04261184.32MIN: 945098.68 / MAX: 955442.17MIN: 935186.02 / MAX: 941032.48MIN: 260020.42 / MAX: 261851.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio4K8K12K16K20KSE +/- 2.79, N = 3SE +/- 0.97, N = 3SE +/- 202.37, N = 11SE +/- 5.16, N = 3SE +/- 14.37, N = 3SE +/- 2352.28, N = 41408143343471751124117205MIN: 3664.53 / MAX: 5656.23MIN: 1742.87 / MAX: 1760.72MIN: 14668.4 / MAX: 24257.141. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio4K8K12K16K20KSE +/- 2.79, N = 3SE +/- 0.97, N = 3SE +/- 189.90, N = 12SE +/- 5.15, N = 3SE +/- 14.38, N = 3SE +/- 2352.28, N = 41408.401433.424303.101751.681241.2317205.02MIN: 3664.73 / MAX: 5656.33MIN: 14668.43 / MAX: 24257.21. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio30K60K90K120K150KSE +/- 25.97, N = 3SE +/- 85.97, N = 3SE +/- 2288.28, N = 12SE +/- 54.14, N = 3SE +/- 111.10, N = 3SE +/- 9937.57, N = 42256321320634162621320140155349-ll -lz - MIN: 22518.24 / MAX: 22608.17-ll -lz - MIN: 21154.67 / MAX: 21443.71MIN: 54563.72 / MAX: 84020.6MIN: 26153.77 / MAX: 26321.49MIN: 19977.28 / MAX: 20352.56MIN: 127172.01 / MAX: 172218.081. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio2K4K6K8K10KSE +/- 1.62, N = 3SE +/- 5.37, N = 3SE +/- 143.02, N = 12SE +/- 3.39, N = 3SE +/- 6.94, N = 3SE +/- 621.10, N = 41410.171332.503963.501638.351258.789709.30MIN: 3410.24 / MAX: 5251.29MIN: 1634.62 / MAX: 1645.11MIN: 7948.25 / MAX: 10763.631. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio5001000150020002500SE +/- 7.01, N = 3SE +/- 11.36, N = 3SE +/- 49.92, N = 12SE +/- 7.01, N = 3SE +/- 2.50, N = 3SE +/- 2.28, N = 41413129325559421051451-ll -lz - MIN: 1398.97 / MAX: 1421.33-ll -lz - MIN: 1275.93 / MAX: 1314.38MIN: 2272.82 / MAX: 2796.93MIN: 933.89 / MAX: 955.84MIN: 1047.1 / MAX: 1055.62MIN: 446.96 / MAX: 455.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio200K400K600K800K1000KSE +/- 7.01, N = 3SE +/- 11.37, N = 3SE +/- 49.92, N = 12SE +/- 7165.39, N = 3SE +/- 2.50, N = 3SE +/- 2341.54, N = 41412.981292.832554.68964833.151050.91461886.65MIN: 956687.49 / MAX: 979116.99MIN: 457742.04 / MAX: 466318.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio40K80K120K160K200KSE +/- 1073.46, N = 7SE +/- 315.48, N = 3SE +/- 1046.16, N = 3SE +/- 118.26, N = 3SE +/- 1384.83, N = 3SE +/- 864.83, N = 4114883783601131477768998732206395-ll -lz - MIN: 108466.13 / MAX: 116317.99-ll -lz - MIN: 77739.45 / MAX: 78768.72MIN: 111945.09 / MAX: 115231.11MIN: 77452.21 / MAX: 77812.66MIN: 97011.92 / MAX: 101472.4MIN: 204839.38 / MAX: 208145.781. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio200K400K600K800K1000KSE +/- 4293.82, N = 7SE +/- 1261.94, N = 3SE +/- 4184.69, N = 3SE +/- 472.95, N = 3SE +/- 5539.28, N = 3SE +/- 3459.36, N = 4459533.60313440.58452587.87310754.79394930.20825579.89-ll -lz - MIN: 433864.7 / MAX: 465271.88-ll -lz - MIN: 310957.83 / MAX: 315075MIN: 447780.52 / MAX: 460924.67MIN: 309809.26 / MAX: 311250.69MIN: 388047.96 / MAX: 405889.76MIN: 819357.59 / MAX: 832583.421. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio3K6K9K12K15KSE +/- 10.95, N = 3SE +/- 7.08, N = 3SE +/- 43.79, N = 3SE +/- 6.70, N = 3SE +/- 13.38, N = 3SE +/- 124.48, N = 41421142836381760123014670-ll -lz - MIN: 1409.27 / MAX: 1443.32-ll -lz - MIN: 1414.53 / MAX: 1438.12MIN: 3555.58 / MAX: 3705.08MIN: 1748.42 / MAX: 1771.62MIN: 14466.32 / MAX: 14979.931. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio3K6K9K12K15KSE +/- 10.95, N = 3SE +/- 7.07, N = 3SE +/- 43.81, N = 3SE +/- 6.71, N = 3SE +/- 13.38, N = 3SE +/- 124.47, N = 41421.571428.423637.901760.231229.7014670.08MIN: 3555.69 / MAX: 3705.25MIN: 14466.35 / MAX: 14979.951. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.5