NVMe IO Queue Test

Intel Core i9-7980XE testing with a ASUS PRIME X299-A (1704 BIOS) and NVIDIA NV120 12GB on Ubuntu 19.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1909043-AS-NVMEIOQUE76&grr.

NVMe IO Queue TestProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 1Intel Core i9-7980XE @ 4.20GHz (18 Cores / 36 Threads)ASUS PRIME X299-A (1704 BIOS)Intel Sky Lake-E DMI3 Registers4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16Samsung SSD 970 EVO 500GBNVIDIA NV120 12GBRealtek ALC1220ASUS PB278Intel I219-VUbuntu 19.045.3.0-999-generic (x86_64) 20190901GNOME Shell 3.32.0X Server4.3 Mesa 19.0.2GCC 8.3.0ext42560x1440OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- NONE / errors=remount-ro,relatime,rwProcessor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.16 + Python 3.7.3Security Details- l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

NVMe IO Queue Testblogbench: Readbuild-gcc: Time To Compilestartup-time: Seq Reads + Writes - GNOME Terminal - Default Test Directorystartup-time: Seq Reads + Writes - xterm - Default Test Directorystartup-time: Seq Reads + Writes - LibreOffice Writer - Default Test Directoryfs-mark: 5000 Files, 1MB Size, 4 Threadsstartup-time: Only Seq Reads - xterm - Default Test Directorystartup-time: Only Seq Reads - GNOME Terminal - Default Test Directorystartup-time: Only Seq Reads - LibreOffice Writer - Default Test Directoryfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeiozone: 1MB - 8GB - Write Performanceapache-siege: 250pgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Heavy Contention - Read Writepgbench: Buffer Test - Normal Load - Read Writepgbench: Buffer Test - Heavy Contention - Read Onlyapache-siege: 200build-llvm: Time To Compilefio: Seq Read - Linux AIO - Yes - No - 4MB - Default Test Directorysqlite: Timed SQLite Insertionsfio: Seq Write - Linux AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Write - Linux AIO - Yes - No - 4MB - Default Test Directoryfio: Rand Read - Linux AIO - Yes - No - 4MB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncblogbench: WriteDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 1383355957.473.970.913.22247.440.602.442.05136.80371.93129041.48473710.254964.254914.27445624.2669396.83212.88740538.78476348527861189.332265.6322136805089955.425.331.274.02160.640.612.462.0779.80754.30133107.35480362.704965.104985.78445911.12117277.30205.15742140.26480449108147186.102319.6310344718225958.205.161.264.02187.730.622.432.0484.44738.94125477.33482492.294813.694742.38447586.9094951.54212.27745740.44475048937951184.872280.9711185549951954.145.021.243.96195.730.642.452.06119.70738.23136825.74473938.945000.815074.25446008.94117515.79204.51758940.26481948868046183.802261.1012602533788957.615.151.223.93195.710.632.462.06124.04708.02131142.79476063.734942.435024.06444280.06126084.15201.93743140.19476748937996185.932268.3713257631157955.245.061.203.80198.390.632.472.08120.47775.6096726.82480049.245045.045044.41446034.09102939.05200.25736340.24475948967983184.202276.3012846OpenBenchmarking.org

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 1200K400K600K800K1000KSE +/- 14999.20, N = 9SE +/- 57973.20, N = 9SE +/- 61629.98, N = 9SE +/- 20873.38, N = 9SE +/- 30080.02, N = 9SE +/- 41744.34, N = 93833558050897182255499515337886311571. (CC) gcc options: -O2 -pthread

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 8.2Time To CompileDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 12004006008001000SE +/- 1.57, N = 3SE +/- 2.17, N = 3SE +/- 1.93, N = 3SE +/- 4.56, N = 3SE +/- 1.00, N = 3SE +/- 2.08, N = 3957.47955.42958.20954.14957.61955.24

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 11.19932.39863.59794.79725.9965SE +/- 0.06, N = 12SE +/- 0.17, N = 12SE +/- 0.12, N = 12SE +/- 0.07, N = 12SE +/- 0.11, N = 12SE +/- 0.12, N = 123.975.335.165.025.155.06

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 10.28580.57160.85741.14321.429SE +/- 0.02, N = 12SE +/- 0.04, N = 12SE +/- 0.02, N = 3SE +/- 0.05, N = 12SE +/- 0.07, N = 12SE +/- 0.04, N = 120.911.271.261.241.221.20

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 10.90451.8092.71353.6184.5225SE +/- 0.03, N = 3SE +/- 0.09, N = 12SE +/- 0.11, N = 9SE +/- 0.08, N = 12SE +/- 0.09, N = 12SE +/- 0.07, N = 123.224.024.023.963.933.80

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 150100150200250SE +/- 22.16, N = 15SE +/- 8.74, N = 9SE +/- 9.11, N = 12SE +/- 6.60, N = 15SE +/- 5.84, N = 15SE +/- 8.14, N = 12247.44160.64187.73195.73195.71198.391. (CC) gcc options: -static

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 10.1440.2880.4320.5760.72SE +/- 0.02, N = 11SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 5SE +/- 0.00, N = 50.600.610.620.640.630.63

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 10.55581.11161.66742.22322.779SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 32.442.462.432.452.462.47

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 10.4680.9361.4041.8722.34SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.052.072.042.062.062.08

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 1306090120150SE +/- 3.14, N = 15SE +/- 3.51, N = 15SE +/- 2.01, N = 15SE +/- 0.74, N = 3SE +/- 1.49, N = 5SE +/- 0.49, N = 3136.8079.8084.44119.70124.04120.471. (CC) gcc options: -static

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 12004006008001000SE +/- 31.80, N = 15SE +/- 7.58, N = 15SE +/- 10.70, N = 4SE +/- 16.71, N = 15SE +/- 27.09, N = 12SE +/- 8.09, N = 8371.93754.30738.94738.23708.02775.601. (CC) gcc options: -O3

Apache Siege

Concurrent Users: 250

OpenBenchmarking.orgTransactions Per Second, More Is BetterApache Siege 2.4.29Concurrent Users: 250Default 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 130K60K90K120K150KSE +/- 1693.22, N = 12SE +/- 3052.97, N = 15SE +/- 2694.16, N = 15SE +/- 2782.42, N = 15SE +/- 1291.21, N = 12SE +/- 3923.30, N = 12129041.48133107.35125477.33136825.74131142.7996726.821. (CC) gcc options: -O2 -lpthread -ldl -lssl -lcrypto

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 1100K200K300K400K500KSE +/- 2025.22, N = 3SE +/- 1242.49, N = 3SE +/- 1509.22, N = 3SE +/- 1456.11, N = 3SE +/- 2682.21, N = 3SE +/- 2109.43, N = 3473710.25480362.70482492.29473938.94476063.73480049.241. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Heavy Contention - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Heavy Contention - Mode: Read WriteDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 111002200330044005500SE +/- 53.29, N = 3SE +/- 7.45, N = 3SE +/- 39.90, N = 3SE +/- 64.95, N = 3SE +/- 14.49, N = 3SE +/- 35.50, N = 34964.254965.104813.695000.814942.435045.041. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 111002200330044005500SE +/- 79.67, N = 3SE +/- 38.42, N = 3SE +/- 54.04, N = 3SE +/- 33.16, N = 3SE +/- 27.64, N = 3SE +/- 45.67, N = 34914.274985.784742.385074.255024.065044.411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Heavy Contention - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Heavy Contention - Mode: Read OnlyDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 1100K200K300K400K500KSE +/- 503.95, N = 3SE +/- 459.85, N = 3SE +/- 972.82, N = 3SE +/- 752.51, N = 3SE +/- 1032.03, N = 3SE +/- 442.81, N = 3445624.26445911.12447586.90446008.94444280.06446034.091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Apache Siege

Concurrent Users: 200

OpenBenchmarking.orgTransactions Per Second, More Is BetterApache Siege 2.4.29Concurrent Users: 200Default 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 130K60K90K120K150KSE +/- 1061.37, N = 3SE +/- 3742.58, N = 12SE +/- 2998.25, N = 15SE +/- 3454.37, N = 12SE +/- 5163.91, N = 15SE +/- 4405.12, N = 1569396.83117277.3094951.54117515.79126084.15102939.051. (CC) gcc options: -O2 -lpthread -ldl -lssl -lcrypto

Timed LLVM Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 6.0.1Time To CompileDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 150100150200250212.88205.15212.27204.51201.93200.25

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 116003200480064008000SE +/- 63.45, N = 12SE +/- 6.49, N = 3SE +/- 97.50, N = 3SE +/- 79.59, N = 15SE +/- 92.13, N = 3SE +/- 2.96, N = 37405742174577589743173631. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 1918273645SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 338.7840.2640.4440.2640.1940.241. (CC) gcc options: -O2 -lz -ldl -lpthread

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 110002000300040005000SE +/- 18.89, N = 3SE +/- 33.58, N = 3SE +/- 62.51, N = 5SE +/- 16.70, N = 3SE +/- 27.54, N = 3SE +/- 77.17, N = 34763480447504819476747591. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 111002200330044005500SE +/- 11.53, N = 3SE +/- 30.67, N = 3SE +/- 37.88, N = 3SE +/- 22.58, N = 3SE +/- 22.55, N = 3SE +/- 39.00, N = 34852491048934886489348961. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4MB - Disk Target: Default Test DirectoryDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 12K4K6K8K10KSE +/- 20.53, N = 3SE +/- 1.67, N = 3SE +/- 20.19, N = 3SE +/- 3.79, N = 3SE +/- 24.52, N = 3SE +/- 19.10, N = 37861814779518046799679831. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 14080120160200SE +/- 0.53, N = 3SE +/- 0.06, N = 3SE +/- 0.93, N = 3SE +/- 1.70, N = 3SE +/- 0.23, N = 3SE +/- 1.51, N = 3189.33186.10184.87183.80185.93184.201. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 15001000150020002500SE +/- 6.10, N = 3SE +/- 23.57, N = 3SE +/- 32.82, N = 3SE +/- 6.57, N = 3SE +/- 34.23, N = 3SE +/- 35.05, N = 32265.632319.632280.972261.102268.372276.301. (CC) gcc options: -static

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteDefault 0Poll Queues: 18Poll Queues: 8Poll Queues: 4Poll Queues: 2Poll Queues: 15K10K15K20K25KSE +/- 540.69, N = 3SE +/- 728.76, N = 3SE +/- 888.94, N = 3SE +/- 619.91, N = 3SE +/- 690.89, N = 3SE +/- 695.50, N = 32213610344111851260213257128461. (CC) gcc options: -O2 -pthread

Phoronix Test Suite v10.8.4