KPTI + Full Retpoline Underflow File-Systems

2 x Intel Xeon Gold 6138 testing with a TYAN S7106 (V1.00 BIOS) and ASPEED ASPEED Family on Ubuntu 17.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1801195-FO-KPTIFULLR53&sor&grs.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.00 BIOS)Intel Device 202012 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyVE228Intel I210 Gigabit ConnectionUbuntu 17.104.15.0-rc8-retpo-underflow (x86_64) 20180115GNOME Shell 3.26.1GCC 7.2.0ext41920x1080xfsbtrfsf2fsext4xfsbtrfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- KPTI + Full Retpo Underflow: EXT4: CFQ / data=ordered,relatime,rw- KPTI + Full Retpo Underflow: XFS: CFQ / attr2,inode64,noquota,relatime,rw- KPTI + Full Retpo Underflow: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- KPTI + Full Retpo Underflow: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: EXT4: CFQ / data=ordered,relatime,rw- No KPTI Or Retpo: XFS: CFQ / attr2,inode64,noquota,relatime,rw- No KPTI Or Retpo: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.14 + Python 3.6.3Security Details- KPTI + Full Retpo Underflow: EXT4, KPTI + Full Retpo Underflow: XFS, KPTI + Full Retpo Underflow: Btrfs, KPTI + Full Retpo Underflow: F2FS: KPTI + Full retpoline with underflow protection Protection

fio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directorydbench: 12blogbench: Writesqlite: Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directoryfs-mark: 5000 Files, 1MB Size, 4 Threadsfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directorycompilebench: Initial Createiozone: 4Kb - 8GB - Write Performancedbench: 6fs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Sizefio: Seq Write - Libaio - No - Yes - 4KB - Default Test DirectoryKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs286.91579.18854541.69211.3437.93235.86472.7968.17360.6729.5552.38419.00284.28704.84351435.58224.7738.27238.91358.0068.36450.5736.9277.30366.6958.73249.05319284.48196.2240.13200.76107.3172.31236.5235.8841.6261.59286.05286.84784540.53212.6641.27239.48560.8643.59252.0236.6853.65423.13277.91296.21830740.05214.9341.33240.53606.9443.41262.9536.9355.20409.84287.04599.45891141.82281.3540.80235.40559.0767.72374.0034.8852.95407.42277.99745.64437735.73219.8752.53240.09420.9993.82473.7244.2375.87329.0759.87250.99332981.84204.9741.37239.14107.4668.51243.9237.7268.6062.46OpenBenchmarking.org

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfs15K30K45K60K75KSE +/- 221.56, N = 3SE +/- 922.02, N = 3SE +/- 1510.45, N = 6SE +/- 163.40, N = 3SE +/- 171.88, N = 3SE +/- 718.19, N = 3SE +/- 576.16, N = 3SE +/- 274.77, N = 371757694936947314962717237150971067146781. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfs60120180240300SE +/- 0.89, N = 3SE +/- 3.69, N = 3SE +/- 6.04, N = 6SE +/- 0.65, N = 3SE +/- 0.69, N = 3SE +/- 2.87, N = 3SE +/- 2.31, N = 3SE +/- 1.10, N = 3287.04277.99277.9159.87286.91286.05284.2858.731. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Dbench

Client Count: 12

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12XFSEXT4F2FSBtrfs160320480640800SE +/- 1.10, N = 3SE +/- 11.37, N = 3SE +/- 5.93, N = 6SE +/- 4.17, N = 6SE +/- 4.20, N = 3SE +/- 8.25, N = 5SE +/- 8.01, N = 6SE +/- 4.78, N = 3745.64599.45296.21250.99704.84579.18286.84249.051. (CC) gcc options: -lpopt -O2

BlogBench

Test: Write

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteEXT4F2FSXFSBtrfs2K4K6K8K10KSE +/- 132.68, N = 3SE +/- 22.02, N = 3SE +/- 82.15, N = 3SE +/- 48.22, N = 3SE +/- 138.28, N = 3SE +/- 177.76, N = 6SE +/- 67.30, N = 6SE +/- 20.60, N = 3891183074377332985457845351431921. (CC) gcc options: -O2 -pthread

SQLite

Test Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryXFSF2FSEXT4Btrfs20406080100SE +/- 0.17, N = 3SE +/- 0.39, N = 3SE +/- 2.53, N = 6SE +/- 1.43, N = 3SE +/- 0.46, N = 3SE +/- 0.39, N = 3SE +/- 1.47, N = 6SE +/- 1.04, N = 335.5840.5341.6984.4835.7340.0541.8281.841. (CC) gcc options: -O2 -lcurses -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs15K30K45K60K75KSE +/- 35.97, N = 3SE +/- 7.17, N = 3SE +/- 3.79, N = 3SE +/- 640.29, N = 3SE +/- 15.45, N = 3SE +/- 3.00, N = 3SE +/- 542.36, N = 3SE +/- 195.86, N = 370334549635373051239561885316252830490511. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs60120180240300SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 2.56, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 2.17, N = 3SE +/- 0.78, N = 3281.35219.87214.93204.97224.77212.66211.34196.221. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsXFSBtrfsF2FSEXT41224364860SE +/- 0.13, N = 3SE +/- 0.33, N = 3SE +/- 0.13, N = 3SE +/- 0.40, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 1.56, N = 6SE +/- 0.64, N = 652.5341.3741.3340.8041.2740.1338.2737.931. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSBtrfsEXT413K26K39K52K65KSE +/- 21.22, N = 3SE +/- 207.16, N = 3SE +/- 1814.31, N = 6SE +/- 111.88, N = 3SE +/- 274.09, N = 3SE +/- 84.64, N = 3SE +/- 127.04, N = 3SE +/- 595.00, N = 360130600185978258846598685972458962501871. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSBtrfsEXT450100150200250SE +/- 0.09, N = 3SE +/- 0.83, N = 3SE +/- 7.26, N = 6SE +/- 0.45, N = 3SE +/- 1.10, N = 3SE +/- 0.34, N = 3SE +/- 0.51, N = 3SE +/- 2.38, N = 3240.53240.09239.14235.40239.48238.91235.86200.761. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Test: Initial Create

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FSEXT4XFSBtrfs130260390520650SE +/- 21.57, N = 6SE +/- 12.78, N = 6SE +/- 19.14, N = 6SE +/- 8.01, N = 6SE +/- 16.55, N = 6SE +/- 16.91, N = 6SE +/- 24.88, N = 6SE +/- 7.12, N = 6606.94559.07420.99107.46560.86472.79358.00107.31

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceXFSBtrfsEXT4F2FS20406080100SE +/- 4.15, N = 6SE +/- 3.00, N = 6SE +/- 3.71, N = 6SE +/- 4.19, N = 6SE +/- 1.50, N = 6SE +/- 4.05, N = 6SE +/- 5.11, N = 6SE +/- 3.41, N = 693.8268.5167.7243.4172.3168.3668.1743.591. (CC) gcc options: -O3

Dbench

Client Count: 6

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6XFSEXT4F2FSBtrfs100200300400500SE +/- 1.93, N = 3SE +/- 13.00, N = 6SE +/- 28.43, N = 6SE +/- 0.74, N = 3SE +/- 0.92, N = 3SE +/- 17.01, N = 6SE +/- 17.38, N = 6SE +/- 1.25, N = 3473.72374.00262.95243.92450.57360.67252.02236.521. (CC) gcc options: -lpopt -O2

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeXFSBtrfsF2FSEXT41020304050SE +/- 1.59, N = 6SE +/- 1.08, N = 6SE +/- 0.64, N = 4SE +/- 0.48, N = 6SE +/- 1.34, N = 6SE +/- 0.59, N = 4SE +/- 0.79, N = 6SE +/- 2.63, N = 644.2337.7236.9334.8836.9236.6835.8829.551. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeXFSBtrfsF2FSEXT420406080100SE +/- 9.27, N = 6SE +/- 15.59, N = 6SE +/- 12.57, N = 6SE +/- 1.73, N = 6SE +/- 6.61, N = 6SE +/- 8.31, N = 6SE +/- 15.90, N = 6SE +/- 12.94, N = 677.3053.6552.3841.6275.8768.6055.2052.951. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfs20K40K60K80K100KSE +/- 548.90, N = 3SE +/- 345.09, N = 3SE +/- 6559.07, N = 6SE +/- 454.19, N = 6SE +/- 1979.16, N = 6SE +/- 2141.00, N = 6SE +/- 7787.52, N = 6SE +/- 600.12, N = 6105780104746916681539310245710185082263156111. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfs90180270360450SE +/- 2.20, N = 3SE +/- 1.38, N = 3SE +/- 26.24, N = 6SE +/- 1.82, N = 6SE +/- 7.92, N = 6SE +/- 8.56, N = 6SE +/- 31.15, N = 6SE +/- 2.40, N = 6423.13419.00366.6961.59409.84407.42329.0762.461. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.4