sa3400d

PVE-NVME-R10-4DISK-fio

HTML result view exported from: https://openbenchmarking.org/result/2311037-TCST-231001402&sor.

sa3400dProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayeriSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio2 x AMD Ryzen 9 5900X 12-Core (32 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC16GB29GBbochs-drmdrmfbUbuntu 22.045.15.0-82-generic (x86_64)1.3.238GCC 11.4.0ext41024x768Xen HVM domU 4.132 x Intel Xeon Gold 6152 (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH934GB QEMU HDDIntel 82801IQEMU MonitorRed Hat Virtio device5.15.0-84-generic (x86_64)1280x800KVM3 x AMD EPYC 7402 24-Core (12 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC30GB1024x768Xen HVM domU 4.13AMD EPYC 7543 32-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH934GB QEMU HDDIntel 82801IQEMU MonitorRed Hat Virtio device5.15.0-86-generic (x86_64)1280x800KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- iSCSI XCP-NG: CPU Microcode: 0xa20120a- NFS XCP-NG: CPU Microcode: 0xa20120a- PVE-SAS-SSD-fio: CPU Microcode: 0x2007006- PVE-SATA-SSD-fio: CPU Microcode: 0x2007006- XCP-NVME-R1-fio: CPU Microcode: 0x830107a- PVE-NVME-R10-4DISK-fio: CPU Microcode: 0xa00110dDisk Mount Options Details- iSCSI XCP-NG, NFS XCP-NG, XCP-NVME-R1-fio: relatime,rwDisk Details Details- iSCSI XCP-NG, NFS XCP-NG, XCP-NVME-R1-fio: Block Size: 4096Security Details- iSCSI XCP-NG: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - NFS XCP-NG: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SAS-SSD-fio: gather_data_sampling: Unknown: Dependent on hypervisor status + itlb_multihit: Not affected + l1tf: Mitigation of PTE Inversion; VMX: flush not necessary SMT disabled + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown - PVE-SATA-SSD-fio: gather_data_sampling: Unknown: Dependent on hypervisor status + itlb_multihit: Not affected + l1tf: Mitigation of PTE Inversion; VMX: flush not necessary SMT disabled + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown - XCP-NVME-R1-fio: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-fio: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected Disk Details- PVE-SAS-SSD-fio, PVE-SATA-SSD-fio, PVE-NVME-R10-4DISK-fio: NONE / relatime,rw / Block Size: 4096

sa3400dfio: Rand Read - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - 1 - Default Test DirectoryiSCSI XCP-NGNFS XCP-NGPVE-SAS-SSD-fioPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio1421.571421459533.601148831410.17225631412.981413417699.011044251155.99184961408.401408691904.821729761440.74230521426.381426608445.481521111353.39216541428.421428313440.58783601332.50213201292.831293155981.56389951142.29182771433.421433515012.431287531364.32218291232.611233479869.151199671205.44192873637.903638452587.871131473963.50634162554.682555371388.68928472886.52461844303.104347533191.801332984437.18709952579.662579395704.27989262435.24389641760.231760310754.79776891638.3526213964833.15942291184.1172796950301.23148481751.681751331512.34828781644.9126318961583.68939303445.1675861961989.10150311229.701230394930.20987321258.78201401050.911051298582.8974646937533.04146491241.231241468597.961171491194.14191061057.441057462947.31115737270225.161687014670.0814670825579.892063959709.30155349461886.6545141400.8610350261184.32408117205.0217205825277.612063198821.62141146449049.2743842783.4510696253974.013968OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioNFS XCP-NGiSCSI XCP-NGXCP-NVME-R1-fio3K6K9K12K15KSE +/- 124.47, N = 4SE +/- 43.81, N = 3SE +/- 6.71, N = 3SE +/- 7.07, N = 3SE +/- 10.95, N = 3SE +/- 13.38, N = 314670.083637.901760.231428.421421.571229.70MIN: 14466.35 / MAX: 14979.95MIN: 3555.69 / MAX: 3705.251. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioNFS XCP-NGiSCSI XCP-NGXCP-NVME-R1-fio3K6K9K12K15KSE +/- 124.48, N = 4SE +/- 43.79, N = 3SE +/- 6.70, N = 3SE +/- 7.08, N = 3SE +/- 10.95, N = 3SE +/- 13.38, N = 31467036381760142814211230MIN: 14466.32 / MAX: 14979.93MIN: 3555.58 / MAX: 3705.08MIN: 1748.42 / MAX: 1771.62-ll -lz - MIN: 1414.53 / MAX: 1438.12-ll -lz - MIN: 1409.27 / MAX: 1443.321. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioiSCSI XCP-NGPVE-SAS-SSD-fioXCP-NVME-R1-fioNFS XCP-NGPVE-SATA-SSD-fio200K400K600K800K1000KSE +/- 3459.36, N = 4SE +/- 4293.82, N = 7SE +/- 4184.69, N = 3SE +/- 5539.28, N = 3SE +/- 1261.94, N = 3SE +/- 472.95, N = 3825579.89459533.60452587.87394930.20313440.58310754.79MIN: 819357.59 / MAX: 832583.42-ll -lz - MIN: 433864.7 / MAX: 465271.88MIN: 447780.52 / MAX: 460924.67MIN: 388047.96 / MAX: 405889.76-ll -lz - MIN: 310957.83 / MAX: 315075MIN: 309809.26 / MAX: 311250.691. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioiSCSI XCP-NGPVE-SAS-SSD-fioXCP-NVME-R1-fioNFS XCP-NGPVE-SATA-SSD-fio40K80K120K160K200KSE +/- 864.83, N = 4SE +/- 1073.46, N = 7SE +/- 1046.16, N = 3SE +/- 1384.83, N = 3SE +/- 315.48, N = 3SE +/- 118.26, N = 3206395114883113147987327836077689MIN: 204839.38 / MAX: 208145.78-ll -lz - MIN: 108466.13 / MAX: 116317.99MIN: 111945.09 / MAX: 115231.11MIN: 97011.92 / MAX: 101472.4-ll -lz - MIN: 77739.45 / MAX: 78768.72MIN: 77452.21 / MAX: 77812.661. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fio2K4K6K8K10KSE +/- 621.10, N = 4SE +/- 143.02, N = 12SE +/- 3.39, N = 3SE +/- 1.62, N = 3SE +/- 5.37, N = 3SE +/- 6.94, N = 39709.303963.501638.351410.171332.501258.78MIN: 7948.25 / MAX: 10763.63MIN: 3410.24 / MAX: 5251.29MIN: 1634.62 / MAX: 1645.111. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fio30K60K90K120K150KSE +/- 9937.57, N = 4SE +/- 2288.28, N = 12SE +/- 54.14, N = 3SE +/- 25.97, N = 3SE +/- 85.97, N = 3SE +/- 111.10, N = 31553496341626213225632132020140MIN: 127172.01 / MAX: 172218.08MIN: 54563.72 / MAX: 84020.6MIN: 26153.77 / MAX: 26321.49-ll -lz - MIN: 22518.24 / MAX: 22608.17-ll -lz - MIN: 21154.67 / MAX: 21443.71MIN: 19977.28 / MAX: 20352.561. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-SSD-fioPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fio200K400K600K800K1000KSE +/- 7165.39, N = 3SE +/- 2341.54, N = 4SE +/- 49.92, N = 12SE +/- 7.01, N = 3SE +/- 11.37, N = 3SE +/- 2.50, N = 3964833.15461886.652554.681412.981292.831050.91MIN: 956687.49 / MAX: 979116.99MIN: 457742.04 / MAX: 466318.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fioPVE-SATA-SSD-fioPVE-NVME-R10-4DISK-fio5001000150020002500SE +/- 49.92, N = 12SE +/- 7.01, N = 3SE +/- 11.36, N = 3SE +/- 2.50, N = 3SE +/- 7.01, N = 3SE +/- 2.28, N = 42555141312931051942451MIN: 2272.82 / MAX: 2796.93-ll -lz - MIN: 1398.97 / MAX: 1421.33-ll -lz - MIN: 1275.93 / MAX: 1314.38MIN: 1047.1 / MAX: 1055.62MIN: 933.89 / MAX: 955.84MIN: 446.96 / MAX: 455.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGPVE-SAS-SSD-fioXCP-NVME-R1-fioPVE-SATA-SSD-fioNFS XCP-NGPVE-NVME-R10-4DISK-fio90K180K270K360K450KSE +/- 2499.52, N = 3SE +/- 3214.61, N = 3SE +/- 6784.56, N = 13SE +/- 3655.27, N = 12SE +/- 2968.01, N = 12SE +/- 231.48, N = 4417699.01371388.68298582.89291184.11155981.5641400.86-ll -lz - MIN: 412817.57 / MAX: 421073.22MIN: 365963.97 / MAX: 377089.44MIN: 268777.81 / MAX: 344884.63MIN: 272918.71 / MAX: 312981.77-ll -lz - MIN: 137984.09 / MAX: 173567.741. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGPVE-SAS-SSD-fioXCP-NVME-R1-fioPVE-SATA-SSD-fioNFS XCP-NGPVE-NVME-R10-4DISK-fio20K40K60K80K100KSE +/- 624.88, N = 3SE +/- 803.63, N = 3SE +/- 1696.14, N = 13SE +/- 913.82, N = 12SE +/- 742.00, N = 12SE +/- 57.87, N = 41044259284774646727963899510350-ll -lz - MIN: 103204.38 / MAX: 105268.29MIN: 91490.96 / MAX: 94272.26MIN: 67194.39 / MAX: 86221.09MIN: 68229.61 / MAX: 78245.37-ll -lz - MIN: 34495.97 / MAX: 43391.881. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NG200K400K600K800K1000KSE +/- 2986.07, N = 3SE +/- 1783.38, N = 3SE +/- 401.63, N = 4SE +/- 12.65, N = 3SE +/- 6.59, N = 3SE +/- 8.19, N = 15950301.23937533.04261184.322886.521155.991142.29MIN: 945098.68 / MAX: 955442.17MIN: 935186.02 / MAX: 941032.48MIN: 260020.42 / MAX: 261851.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NGPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fio10K20K30K40K50KSE +/- 202.40, N = 3SE +/- 105.36, N = 3SE +/- 131.07, N = 15SE +/- 46.66, N = 3SE +/- 27.87, N = 3SE +/- 6.27, N = 446184184961827714848146494081MIN: 45856.09 / MAX: 46553.58-ll -lz - MIN: 18361.65 / MAX: 18703.55-ll -lz - MIN: 17165.66 / MAX: 18956.57MIN: 14766.95 / MAX: 14928.59MIN: 14612.21 / MAX: 14703.571. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioNFS XCP-NGiSCSI XCP-NGXCP-NVME-R1-fio4K8K12K16K20KSE +/- 2352.28, N = 4SE +/- 189.90, N = 12SE +/- 5.15, N = 3SE +/- 0.97, N = 3SE +/- 2.79, N = 3SE +/- 14.38, N = 317205.024303.101751.681433.421408.401241.23MIN: 14668.43 / MAX: 24257.2MIN: 3664.73 / MAX: 5656.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioNFS XCP-NGiSCSI XCP-NGXCP-NVME-R1-fio4K8K12K16K20KSE +/- 2352.28, N = 4SE +/- 202.37, N = 11SE +/- 5.16, N = 3SE +/- 0.97, N = 3SE +/- 2.79, N = 3SE +/- 14.37, N = 31720543471751143314081241MIN: 14668.4 / MAX: 24257.14MIN: 3664.53 / MAX: 5656.23MIN: 1742.87 / MAX: 1760.721. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioiSCSI XCP-NGPVE-SAS-SSD-fioNFS XCP-NGXCP-NVME-R1-fioPVE-SATA-SSD-fio200K400K600K800K1000KSE +/- 2489.36, N = 4SE +/- 7196.24, N = 3SE +/- 5636.73, N = 3SE +/- 7035.45, N = 15SE +/- 7109.83, N = 15SE +/- 1085.66, N = 3825277.61691904.82533191.80515012.43468597.96331512.34MIN: 818788.42 / MAX: 830871.32-ll -lz - MIN: 679485.78 / MAX: 704413.8MIN: 522116.32 / MAX: 540551.18-ll -lz - MIN: 446757.07 / MAX: 553780.17MIN: 435306.38 / MAX: 523483.82MIN: 329614.76 / MAX: 333375.11. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioiSCSI XCP-NGPVE-SAS-SSD-fioNFS XCP-NGXCP-NVME-R1-fioPVE-SATA-SSD-fio40K80K120K160K200KSE +/- 622.34, N = 4SE +/- 1799.07, N = 3SE +/- 1409.20, N = 3SE +/- 1758.86, N = 15SE +/- 1777.46, N = 15SE +/- 271.46, N = 320631917297613329812875311714982878MIN: 204697.03 / MAX: 207717.76-ll -lz - MIN: 169871.42 / MAX: 176103.45MIN: 130529.06 / MAX: 135137.88-ll -lz - MIN: 111689.26 / MAX: 138445.07MIN: 108826.53 / MAX: 130870.88MIN: 82403.55 / MAX: 83343.81. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fio2K4K6K8K10KSE +/- 117.65, N = 4SE +/- 43.99, N = 15SE +/- 5.09, N = 3SE +/- 10.16, N = 3SE +/- 1.27, N = 3SE +/- 12.68, N = 58821.624437.181644.911440.741364.321194.14MIN: 8563.27 / MAX: 9120.54MIN: 4157.39 / MAX: 4711.14MIN: 1638.47 / MAX: 1654.951. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fio30K60K90K120K150KSE +/- 1882.32, N = 4SE +/- 703.79, N = 15SE +/- 81.39, N = 3SE +/- 162.60, N = 3SE +/- 20.33, N = 3SE +/- 202.92, N = 51411467099526318230522182919106MIN: 137012.33 / MAX: 145928.53MIN: 66518.12 / MAX: 75378.1MIN: 26215.38 / MAX: 26479.1-ll -lz - MIN: 22831.78 / MAX: 23369.16-ll -lz - MIN: 21790.82 / MAX: 21860.21MIN: 18613.54 / MAX: 19827.621. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-SSD-fioPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fio200K400K600K800K1000KSE +/- 2399.85, N = 3SE +/- 928.79, N = 4SE +/- 55.39, N = 15SE +/- 4.29, N = 3SE +/- 3.52, N = 3SE +/- 8.67, N = 3961583.68449049.272579.661426.381232.611057.44MIN: 958465.17 / MAX: 966302.68MIN: 446726.53 / MAX: 451164.931. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fioPVE-SATA-SSD-fioPVE-NVME-R10-4DISK-fio6001200180024003000SE +/- 55.39, N = 15SE +/- 4.29, N = 3SE +/- 3.52, N = 3SE +/- 8.67, N = 3SE +/- 2.34, N = 3SE +/- 0.90, N = 42579142612331057939438MIN: 2145.02 / MAX: 2879.4-ll -lz - MIN: 1418.87 / MAX: 1433.73-ll -lz - MIN: 1225.95 / MAX: 1237.98MIN: 1044.53 / MAX: 1073.92MIN: 935.67 / MAX: 943.3MIN: 436.22 / MAX: 440.541. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioPVE-NVME-R10-4DISK-fio130K260K390K520K650KSE +/- 23613.03, N = 12SE +/- 14912.65, N = 15SE +/- 25104.31, N = 12SE +/- 2839.24, N = 3SE +/- 3218.47, N = 15SE +/- 107.29, N = 4608445.48479869.15462947.31395704.27303445.1642783.45-ll -lz - MIN: 412310.6 / MAX: 690097.59-ll -lz - MIN: 342697.58 / MAX: 539439.96MIN: 356195.36 / MAX: 603896.43MIN: 391883.02 / MAX: 401252.52MIN: 283379 / MAX: 321694.321. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fioPVE-SAS-SSD-fioPVE-SATA-SSD-fioPVE-NVME-R10-4DISK-fio30K60K90K120K150KSE +/- 5903.26, N = 12SE +/- 3728.16, N = 15SE +/- 6276.07, N = 12SE +/- 709.81, N = 3SE +/- 804.62, N = 15SE +/- 26.83, N = 4152111119967115737989267586110696-ll -lz - MIN: 103077.64 / MAX: 172524.33-ll -lz - MIN: 85674.41 / MAX: 134860MIN: 89048.78 / MAX: 150974.03MIN: 97970.63 / MAX: 100313.05MIN: 70844.74 / MAX: 80423.511. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-SSD-fioXCP-NVME-R1-fioPVE-NVME-R10-4DISK-fioPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NG200K400K600K800K1000KSE +/- 984.67, N = 3SE +/- 119375.03, N = 15SE +/- 243.95, N = 4SE +/- 45.04, N = 15SE +/- 13.39, N = 6SE +/- 9.65, N = 3961989.10270225.16253974.012435.241353.391205.44MIN: 960336.93 / MAX: 963743.34MIN: 1025.26 / MAX: 1047960.13MIN: 253349.81 / MAX: 254529.671. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SAS-SSD-fioiSCSI XCP-NGNFS XCP-NGXCP-NVME-R1-fioPVE-SATA-SSD-fioPVE-NVME-R10-4DISK-fio8K16K24K32K40KSE +/- 720.63, N = 15SE +/- 214.28, N = 6SE +/- 154.31, N = 3SE +/- 254.53, N = 15SE +/- 15.36, N = 3SE +/- 3.80, N = 438964216541928716870150313968MIN: 34966.58 / MAX: 44257.78-ll -lz - MIN: 20588.04 / MAX: 21930.05-ll -lz - MIN: 18980.62 / MAX: 19472.58MIN: 15150.57 / MAX: 18484.55MIN: 15005.17 / MAX: 15058.29MIN: 3958.54 / MAX: 3976.921. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.4