Linux 4.17 IO Scheduler Testing

Tests by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1806021-AR-LINUX417I05
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Database Test Suite 2 Tests
Disk Test Suite 5 Tests
Server 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
HDD: BFQ
May 31 2018
  3 Hours, 28 Minutes
HDD: BFQ low_latency
May 31 2018
  3 Hours, 23 Minutes
HDD: CFQ
May 30 2018
  3 Hours, 34 Minutes
HDD: DEADLINE
May 30 2018
  3 Hours, 54 Minutes
HDD: Kyber
May 31 2018
  2 Hours, 44 Minutes
HDD: MQ-DEADLINE
May 31 2018
  2 Hours, 38 Minutes
HDD: Noop
May 31 2018
  3 Hours, 7 Minutes
SSD: BFQ
June 02 2018
  2 Hours, 59 Minutes
SSD: BFQ low_latency
June 01 2018
  2 Hours, 52 Minutes
SSD: CFQ
June 01 2018
  3 Hours, 1 Minute
SSD: DEADLINE
June 01 2018
  3 Hours, 32 Minutes
SSD: Kyber
June 01 2018
  3 Hours, 1 Minute
SSD: MQ-DEADLINE
June 02 2018
  3 Hours, 32 Minutes
SSD: Noop
June 01 2018
  3 Hours, 36 Minutes
Invert Hiding All Results Option
  3 Hours, 14 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Linux 4.17 IO Scheduler Testing - Phoronix Test Suite

Linux 4.17 IO Scheduler Testing

Tests by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1806021-AR-LINUX417I05&grr&rdt.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionHDDSSD CFQ DEADLINE Noop Kyber BFQ low_latency BFQ MQ-DEADLINE CFQ DEADLINE Noop Kyber BFQ low_latency BFQ MQ-DEADLINE2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.00 BIOS)Intel Sky Lake-E DMI3 Registers12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyVE228Intel I210 Gigabit ConnectionUbuntu 18.044.17.0-999-generic (x86_64) 20180529GNOME Shell 3.28.1GCC 7.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- HDD: CFQ: CFQ / relatime,rw- HDD: DEADLINE: DEADLINE / relatime,rw- HDD: Noop: NOOP / relatime,rw- HDD: Kyber: KYBER / relatime,rw- HDD: BFQ low_latency: BFQ / relatime,rw- HDD: BFQ: BFQ / relatime,rw- HDD: MQ-DEADLINE: MQ-DEADLINE / relatime,rw- SSD: CFQ: CFQ / relatime,rw- SSD: DEADLINE: DEADLINE / relatime,rw- SSD: Noop: NOOP / relatime,rw- SSD: Kyber: KYBER / relatime,rw- SSD: BFQ low_latency: BFQ / relatime,rw- SSD: BFQ: BFQ / relatime,rw- SSD: MQ-DEADLINE: MQ-DEADLINE / relatime,rwProcessor Details- Scaling Governor: intel_pstate powersaveSecurity Details- KPTI + __user pointer sanitization + Full generic retpoline Protection

dbench: 12sqlite: Timed SQLite Insertionsfs-mark: 5000 Files, 1MB Size, 4 Threadspgbench: Buffer Test - Normal Load - Read Writestartup-time: Seq Reads + Writes - GNOME Terminaliozone: 1MB - 8GB - Write Performancefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizestartup-time: Only Seq Reads - GNOME Terminalfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test DirectoryHDDSSD CFQ DEADLINE Noop Kyber BFQ low_latency BFQ MQ-DEADLINE CFQ DEADLINE Noop Kyber BFQ low_latency BFQ MQ-DEADLINE30.53769.0447.87320.9646.07182.5517.335.471.0517.471961.5730.56707.3048.67245.0939.27184.4017.335.481.0517.401961.5830.49708.3848.67253.0456.56183.6217.405.481.0617.371981.5527.48698.8247.73511.815.22174.8217.376.511.0417.371681.5629.60790.1948.40354.985.24181.5817.306.671.0817.2360.681.5730.43705.1548.40301.025.02179.0917.376.751.0617.401881.5727.81716.5148.53522.595.66183.7217.377.041.0417.331851.56560.4041.5950.402264.9640.8897.1241.425.5028158.05416224538.5542.5447.672289.3254.70103.7541.055.34175.7855.45411227570.9343.4448.532329.0953.68105.5940.985.2313351.15400206517.2344.5149.331970.865.5096.0040.986.8618255.82412224486.7150.68471961.435.2694.1840.746.9524047.62417213486.6845.1349.472301.405.23102.5941.226.8697.5355.73416233547.1942.9445.801757.425.4898.6935.807.0717156.20414236OpenBenchmarking.org

Dbench

Client Count: 12

HDDSSDOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12CFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE120240360480600SE +/- 0.20, N = 3SE +/- 0.59, N = 6SE +/- 0.44, N = 5SE +/- 0.41, N = 3SE +/- 0.31, N = 3SE +/- 0.55, N = 3SE +/- 0.38, N = 3SE +/- 23.57, N = 6SE +/- 21.64, N = 6SE +/- 23.68, N = 6SE +/- 14.65, N = 6SE +/- 14.01, N = 6SE +/- 11.71, N = 6SE +/- 16.76, N = 630.5330.5630.4927.4829.6030.4327.81560.40538.55570.93517.23486.71486.68547.191. (CC) gcc options: -lpopt -O2

SQLite

Timed SQLite Insertions

HDDSSDOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE2004006008001000SE +/- 60.15, N = 6SE +/- 27.02, N = 6SE +/- 7.08, N = 3SE +/- 10.48, N = 3SE +/- 27.29, N = 6SE +/- 11.30, N = 6SE +/- 2.21, N = 3SE +/- 1.02, N = 6SE +/- 1.06, N = 6SE +/- 1.30, N = 6SE +/- 1.30, N = 6SE +/- 1.37, N = 6SE +/- 0.75, N = 4SE +/- 1.15, N = 6769.04707.30708.38698.82790.19705.15716.5141.5942.5443.4444.5150.6845.1342.941. (CC) gcc options: -O2 -lz -ldl -lpthread

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

HDDSSDOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE1122334455SE +/- 0.93, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.48, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.13, N = 3SE +/- 0.40, N = 3SE +/- 1.74, N = 6SE +/- 0.84, N = 6SE +/- 0.48, N = 3SE +/- 0.67, N = 3SE +/- 0.27, N = 3SE +/- 0.94, N = 647.8748.6748.6747.7348.4048.4048.5350.4047.6748.5349.3347.0049.4745.801. (CC) gcc options: -static

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

HDDSSDOpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE5001000150020002500SE +/- 4.46, N = 6SE +/- 2.62, N = 3SE +/- 2.69, N = 3SE +/- 15.05, N = 6SE +/- 30.15, N = 6SE +/- 4.63, N = 5SE +/- 8.51, N = 6SE +/- 8.35, N = 3SE +/- 16.17, N = 3SE +/- 13.76, N = 3SE +/- 62.04, N = 6SE +/- 39.09, N = 3SE +/- 55.20, N = 6SE +/- 94.63, N = 6320.96245.09253.04511.81354.98301.02522.592264.962289.322329.091970.861961.432301.401757.421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal

HDDSSDOpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 2.3.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME TerminalCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE1326395265SE +/- 4.33, N = 6SE +/- 2.58, N = 6SE +/- 1.83, N = 6SE +/- 0.09, N = 4SE +/- 0.11, N = 3SE +/- 0.13, N = 6SE +/- 0.06, N = 3SE +/- 1.02, N = 6SE +/- 2.23, N = 6SE +/- 1.76, N = 6SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 346.0739.2756.565.225.245.025.6640.8854.7053.685.505.265.235.48

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

HDDSSDOpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE4080120160200SE +/- 0.66, N = 3SE +/- 0.56, N = 3SE +/- 0.27, N = 3SE +/- 0.46, N = 3SE +/- 0.36, N = 3SE +/- 0.46, N = 3SE +/- 0.67, N = 3SE +/- 7.29, N = 6SE +/- 2.83, N = 6SE +/- 2.02, N = 6SE +/- 4.48, N = 6SE +/- 6.06, N = 6SE +/- 2.09, N = 6SE +/- 3.97, N = 6182.55184.40183.62174.82181.58179.09183.7297.12103.75105.5996.0094.18102.5998.691. (CC) gcc options: -O3

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

HDDSSDOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE918273645SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.65, N = 6SE +/- 0.56, N = 6SE +/- 0.56, N = 6SE +/- 0.60, N = 5SE +/- 0.62, N = 5SE +/- 0.63, N = 5SE +/- 3.00, N = 617.3317.3317.4017.3717.3017.3717.3741.4241.0540.9840.9840.7441.2235.801. (CC) gcc options: -static

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal

HDDSSDOpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 2.3.0Background I/O Mix: Only Sequential Reads - Application To Start: GNOME TerminalCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE246810SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 6SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 35.475.485.486.516.676.757.045.505.345.236.866.956.867.07

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

HDDSSDOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE60120180240300SE +/- 0.05, N = 6SE +/- 0.04, N = 6SE +/- 0.06, N = 6SE +/- 0.04, N = 6SE +/- 0.05, N = 6SE +/- 0.03, N = 6SE +/- 0.04, N = 6SE +/- 0.67, N = 3SE +/- 21.77, N = 6SE +/- 3.68, N = 6SE +/- 17.24, N = 6SE +/- 27.29, N = 6SE +/- 10.50, N = 6SE +/- 26.68, N = 61.051.051.061.041.081.061.04281.00175.78133.00182.00240.0097.53171.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE15K30K45K60K75KSE +/- 133.33, N = 3SE +/- 5582.04, N = 6SE +/- 964.51, N = 6SE +/- 4413.84, N = 6SE +/- 7128.44, N = 6SE +/- 2655.36, N = 6SE +/- 6847.96, N = 6720674505033817466006130024783436501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

HDDSSDOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE1326395265SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 11.06, N = 6SE +/- 10.83, N = 6SE +/- 12.52, N = 6SE +/- 10.65, N = 6SE +/- 10.66, N = 6SE +/- 10.95, N = 6SE +/- 11.35, N = 617.4717.4017.3717.3717.2317.4017.3358.0555.4551.1555.8247.6255.7356.201. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

HDDSSDOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE20K40K60K80K100KSE +/- 290.59, N = 3SE +/- 1472.64, N = 6SE +/- 635.96, N = 3SE +/- 2204.39, N = 6SE +/- 1342.80, N = 6SE +/- 681.99, N = 6SE +/- 554.78, N = 3SE +/- 333.33, N = 3SE +/- 1589.08, N = 6SE +/- 333.33, N = 3SE +/- 666.67, N = 3SE +/- 1641.46, N = 5502675000050533429001553347867472671063331050001022501060001066671063331061201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

HDDSSDOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE90180270360450SE +/- 5.70, N = 6SE +/- 8.75, N = 6SE +/- 5.23, N = 6SE +/- 2.79, N = 6SE +/- 2.33, N = 3SE +/- 6.23, N = 6SE +/- 1.00, N = 3SE +/- 2.00, N = 3SE +/- 6.25, N = 5196.00196.00198.00168.0060.68188.00185.00416.00411.00400.00412.00417.00416.00414.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

HDDSSDOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE50100150200250SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.88, N = 31.571.581.551.561.571.571.56224.00227.00206.00224.00213.00233.00236.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryCFQDEADLINENoopKyberBFQ low_latencyBFQMQ-DEADLINE13K26K39K52K65KSE +/- 208.17, N = 3SE +/- 33.33, N = 3573005800052700572335460059700605001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.4