KPTI + Full Retpoline Underflow File-Systems

2 x Intel Xeon Gold 6138 testing with a TYAN S7106 (V1.00 BIOS) and ASPEED ASPEED Family on Ubuntu 17.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1801195-FO-KPTIFULLR53&sor&grw.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.00 BIOS)Intel Device 202012 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyVE228Intel I210 Gigabit ConnectionUbuntu 17.104.15.0-rc8-retpo-underflow (x86_64) 20180115GNOME Shell 3.26.1GCC 7.2.0ext41920x1080xfsbtrfsf2fsext4xfsbtrfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- KPTI + Full Retpo Underflow: EXT4: CFQ / data=ordered,relatime,rw- KPTI + Full Retpo Underflow: XFS: CFQ / attr2,inode64,noquota,relatime,rw- KPTI + Full Retpo Underflow: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- KPTI + Full Retpo Underflow: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: EXT4: CFQ / data=ordered,relatime,rw- No KPTI Or Retpo: XFS: CFQ / attr2,inode64,noquota,relatime,rw- No KPTI Or Retpo: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.14 + Python 3.6.3Security Details- KPTI + Full Retpo Underflow: EXT4, KPTI + Full Retpo Underflow: XFS, KPTI + Full Retpo Underflow: Btrfs, KPTI + Full Retpo Underflow: F2FS: KPTI + Full retpoline with underflow protection Protection

compilebench: Initial Createdbench: 6dbench: 12fio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeiozone: 4Kb - 8GB - Write Performanceblogbench: Writesqlite: Default Test DirectoryKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs472.79360.67579.18211.34286.91235.86419.0052.3837.9329.5568.17854541.69358.00450.57704.84224.77284.28238.91366.6977.3038.2736.9268.36351435.58107.31236.52249.05196.2258.73200.7661.5941.6240.1335.8872.31319284.48560.86252.02286.84212.66286.05239.48423.1353.6541.2736.6843.59784540.53606.94262.95296.21214.93277.91240.53409.8455.2041.3336.9343.41830740.05559.07374.00599.45281.35287.04235.40407.4252.9540.8034.8867.72891141.82420.99473.72745.64219.87277.99240.09329.0775.8752.5344.2393.82437735.73107.46243.92250.99204.9759.87239.1462.4668.6041.3737.7268.51332981.84OpenBenchmarking.org

Compile Bench

Test: Initial Create

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FSEXT4XFSBtrfs130260390520650SE +/- 21.57, N = 6SE +/- 12.78, N = 6SE +/- 19.14, N = 6SE +/- 8.01, N = 6SE +/- 16.55, N = 6SE +/- 16.91, N = 6SE +/- 24.88, N = 6SE +/- 7.12, N = 6606.94559.07420.99107.46560.86472.79358.00107.31

Dbench

Client Count: 6

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6XFSEXT4F2FSBtrfs100200300400500SE +/- 1.93, N = 3SE +/- 13.00, N = 6SE +/- 28.43, N = 6SE +/- 0.74, N = 3SE +/- 0.92, N = 3SE +/- 17.01, N = 6SE +/- 17.38, N = 6SE +/- 1.25, N = 3473.72374.00262.95243.92450.57360.67252.02236.521. (CC) gcc options: -lpopt -O2

Dbench

Client Count: 12

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12XFSEXT4F2FSBtrfs160320480640800SE +/- 1.10, N = 3SE +/- 11.37, N = 3SE +/- 5.93, N = 6SE +/- 4.17, N = 6SE +/- 4.20, N = 3SE +/- 8.25, N = 5SE +/- 8.01, N = 6SE +/- 4.78, N = 3745.64599.45296.21250.99704.84579.18286.84249.051. (CC) gcc options: -lpopt -O2

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs60120180240300SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 2.56, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 2.17, N = 3SE +/- 0.78, N = 3281.35219.87214.93204.97224.77212.66211.34196.221. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfs60120180240300SE +/- 0.89, N = 3SE +/- 3.69, N = 3SE +/- 6.04, N = 6SE +/- 0.65, N = 3SE +/- 0.69, N = 3SE +/- 2.87, N = 3SE +/- 2.31, N = 3SE +/- 1.10, N = 3287.04277.99277.9159.87286.91286.05284.2858.731. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSBtrfsEXT450100150200250SE +/- 0.09, N = 3SE +/- 0.83, N = 3SE +/- 7.26, N = 6SE +/- 0.45, N = 3SE +/- 1.10, N = 3SE +/- 0.34, N = 3SE +/- 0.51, N = 3SE +/- 2.38, N = 3240.53240.09239.14235.40239.48238.91235.86200.761. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfs90180270360450SE +/- 2.20, N = 3SE +/- 1.38, N = 3SE +/- 26.24, N = 6SE +/- 1.82, N = 6SE +/- 7.92, N = 6SE +/- 8.56, N = 6SE +/- 31.15, N = 6SE +/- 2.40, N = 6423.13419.00366.6961.59409.84407.42329.0762.461. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeXFSBtrfsF2FSEXT420406080100SE +/- 9.27, N = 6SE +/- 15.59, N = 6SE +/- 12.57, N = 6SE +/- 1.73, N = 6SE +/- 6.61, N = 6SE +/- 8.31, N = 6SE +/- 15.90, N = 6SE +/- 12.94, N = 677.3053.6552.3841.6275.8768.6055.2052.951. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsXFSBtrfsF2FSEXT41224364860SE +/- 0.13, N = 3SE +/- 0.33, N = 3SE +/- 0.13, N = 3SE +/- 0.40, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 1.56, N = 6SE +/- 0.64, N = 652.5341.3741.3340.8041.2740.1338.2737.931. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeXFSBtrfsF2FSEXT41020304050SE +/- 1.59, N = 6SE +/- 1.08, N = 6SE +/- 0.64, N = 4SE +/- 0.48, N = 6SE +/- 1.34, N = 6SE +/- 0.59, N = 4SE +/- 0.79, N = 6SE +/- 2.63, N = 644.2337.7236.9334.8836.9236.6835.8829.551. (CC) gcc options: -static

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceXFSBtrfsEXT4F2FS20406080100SE +/- 4.15, N = 6SE +/- 3.00, N = 6SE +/- 3.71, N = 6SE +/- 4.19, N = 6SE +/- 1.50, N = 6SE +/- 4.05, N = 6SE +/- 5.11, N = 6SE +/- 3.41, N = 693.8268.5167.7243.4172.3168.3668.1743.591. (CC) gcc options: -O3

BlogBench

Test: Write

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteEXT4F2FSXFSBtrfs2K4K6K8K10KSE +/- 132.68, N = 3SE +/- 22.02, N = 3SE +/- 82.15, N = 3SE +/- 48.22, N = 3SE +/- 138.28, N = 3SE +/- 177.76, N = 6SE +/- 67.30, N = 6SE +/- 20.60, N = 3891183074377332985457845351431921. (CC) gcc options: -O2 -pthread

SQLite

Test Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryXFSF2FSEXT4Btrfs20406080100SE +/- 0.17, N = 3SE +/- 0.39, N = 3SE +/- 2.53, N = 6SE +/- 1.43, N = 3SE +/- 0.46, N = 3SE +/- 0.39, N = 3SE +/- 1.47, N = 6SE +/- 1.04, N = 335.5840.5341.6984.4835.7340.0541.8281.841. (CC) gcc options: -O2 -lcurses -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs15K30K45K60K75KSE +/- 35.97, N = 3SE +/- 7.17, N = 3SE +/- 3.79, N = 3SE +/- 640.29, N = 3SE +/- 15.45, N = 3SE +/- 3.00, N = 3SE +/- 542.36, N = 3SE +/- 195.86, N = 370334549635373051239561885316252830490511. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfs15K30K45K60K75KSE +/- 221.56, N = 3SE +/- 922.02, N = 3SE +/- 1510.45, N = 6SE +/- 163.40, N = 3SE +/- 171.88, N = 3SE +/- 718.19, N = 3SE +/- 576.16, N = 3SE +/- 274.77, N = 371757694936947314962717237150971067146781. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSBtrfsEXT413K26K39K52K65KSE +/- 21.22, N = 3SE +/- 207.16, N = 3SE +/- 1814.31, N = 6SE +/- 111.88, N = 3SE +/- 274.09, N = 3SE +/- 84.64, N = 3SE +/- 127.04, N = 3SE +/- 595.00, N = 360130600185978258846598685972458962501871. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfs20K40K60K80K100KSE +/- 548.90, N = 3SE +/- 345.09, N = 3SE +/- 6559.07, N = 6SE +/- 454.19, N = 6SE +/- 1979.16, N = 6SE +/- 2141.00, N = 6SE +/- 7787.52, N = 6SE +/- 600.12, N = 6105780104746916681539310245710185082263156111. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.4