KPTI + Full Retpoline Underflow File-Systems

2 x Intel Xeon Gold 6138 testing with a TYAN S7106 (V1.00 BIOS) and ASPEED ASPEED Family on Ubuntu 17.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1801195-FO-KPTIFULLR53&grr&sor.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.00 BIOS)Intel Device 202012 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyVE228Intel I210 Gigabit ConnectionUbuntu 17.104.15.0-rc8-retpo-underflow (x86_64) 20180115GNOME Shell 3.26.1GCC 7.2.0ext41920x1080xfsbtrfsf2fsext4xfsbtrfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- KPTI + Full Retpo Underflow: EXT4: CFQ / data=ordered,relatime,rw- KPTI + Full Retpo Underflow: XFS: CFQ / attr2,inode64,noquota,relatime,rw- KPTI + Full Retpo Underflow: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- KPTI + Full Retpo Underflow: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: EXT4: CFQ / data=ordered,relatime,rw- No KPTI Or Retpo: XFS: CFQ / attr2,inode64,noquota,relatime,rw- No KPTI Or Retpo: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.14 + Python 3.6.3Security Details- KPTI + Full Retpo Underflow: EXT4, KPTI + Full Retpo Underflow: XFS, KPTI + Full Retpo Underflow: Btrfs, KPTI + Full Retpo Underflow: F2FS: KPTI + Full retpoline with underflow protection Protection

compilebench: Initial Createiozone: 4Kb - 8GB - Write Performancedbench: 12dbench: 6blogbench: Writefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directorysqlite: Default Test DirectoryKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs472.7968.17579.18360.67854529.5537.9352.38419.00235.86286.91211.3441.69358.0068.36704.84450.57351436.9238.2777.30366.69238.91284.28224.7735.58107.3172.31249.05236.52319235.8840.1341.6261.59200.7658.73196.2284.48560.8643.59286.84252.02784536.6841.2753.65423.13239.48286.05212.6640.53606.9443.41296.21262.95830736.9341.3355.20409.84240.53277.91214.9340.05559.0767.72599.45374.00891134.8840.8052.95407.42235.40287.04281.3541.82420.9993.82745.64473.72437744.2352.5375.87329.07240.09277.99219.8735.73107.4668.51250.99243.92332937.7241.3768.6062.46239.1459.87204.9781.84OpenBenchmarking.org

Compile Bench

Test: Initial Create

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FSEXT4XFSBtrfs130260390520650SE +/- 21.57, N = 6SE +/- 12.78, N = 6SE +/- 19.14, N = 6SE +/- 8.01, N = 6SE +/- 16.55, N = 6SE +/- 16.91, N = 6SE +/- 24.88, N = 6SE +/- 7.12, N = 6606.94559.07420.99107.46560.86472.79358.00107.31

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceXFSBtrfsEXT4F2FS20406080100SE +/- 4.15, N = 6SE +/- 3.00, N = 6SE +/- 3.71, N = 6SE +/- 4.19, N = 6SE +/- 1.50, N = 6SE +/- 4.05, N = 6SE +/- 5.11, N = 6SE +/- 3.41, N = 693.8268.5167.7243.4172.3168.3668.1743.591. (CC) gcc options: -O3

Dbench

Client Count: 12

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12XFSEXT4F2FSBtrfs160320480640800SE +/- 1.10, N = 3SE +/- 11.37, N = 3SE +/- 5.93, N = 6SE +/- 4.17, N = 6SE +/- 4.20, N = 3SE +/- 8.25, N = 5SE +/- 8.01, N = 6SE +/- 4.78, N = 3745.64599.45296.21250.99704.84579.18286.84249.051. (CC) gcc options: -lpopt -O2

Dbench

Client Count: 6

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6XFSEXT4F2FSBtrfs100200300400500SE +/- 1.93, N = 3SE +/- 13.00, N = 6SE +/- 28.43, N = 6SE +/- 0.74, N = 3SE +/- 0.92, N = 3SE +/- 17.01, N = 6SE +/- 17.38, N = 6SE +/- 1.25, N = 3473.72374.00262.95243.92450.57360.67252.02236.521. (CC) gcc options: -lpopt -O2

BlogBench

Test: Write

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteEXT4F2FSXFSBtrfs2K4K6K8K10KSE +/- 132.68, N = 3SE +/- 22.02, N = 3SE +/- 82.15, N = 3SE +/- 48.22, N = 3SE +/- 138.28, N = 3SE +/- 177.76, N = 6SE +/- 67.30, N = 6SE +/- 20.60, N = 3891183074377332985457845351431921. (CC) gcc options: -O2 -pthread

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeXFSBtrfsF2FSEXT41020304050SE +/- 1.59, N = 6SE +/- 1.08, N = 6SE +/- 0.64, N = 4SE +/- 0.48, N = 6SE +/- 1.34, N = 6SE +/- 0.59, N = 4SE +/- 0.79, N = 6SE +/- 2.63, N = 644.2337.7236.9334.8836.9236.6835.8829.551. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsXFSBtrfsF2FSEXT41224364860SE +/- 0.13, N = 3SE +/- 0.33, N = 3SE +/- 0.13, N = 3SE +/- 0.40, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 1.56, N = 6SE +/- 0.64, N = 652.5341.3741.3340.8041.2740.1338.2737.931. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeXFSBtrfsF2FSEXT420406080100SE +/- 9.27, N = 6SE +/- 15.59, N = 6SE +/- 12.57, N = 6SE +/- 1.73, N = 6SE +/- 6.61, N = 6SE +/- 8.31, N = 6SE +/- 15.90, N = 6SE +/- 12.94, N = 677.3053.6552.3841.6275.8768.6055.2052.951. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfs20K40K60K80K100KSE +/- 548.90, N = 3SE +/- 345.09, N = 3SE +/- 6559.07, N = 6SE +/- 454.19, N = 6SE +/- 1979.16, N = 6SE +/- 2141.00, N = 6SE +/- 7787.52, N = 6SE +/- 600.12, N = 6105780104746916681539310245710185082263156111. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfs90180270360450SE +/- 2.20, N = 3SE +/- 1.38, N = 3SE +/- 26.24, N = 6SE +/- 1.82, N = 6SE +/- 7.92, N = 6SE +/- 8.56, N = 6SE +/- 31.15, N = 6SE +/- 2.40, N = 6423.13419.00366.6961.59409.84407.42329.0762.461. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSBtrfsEXT413K26K39K52K65KSE +/- 21.22, N = 3SE +/- 207.16, N = 3SE +/- 1814.31, N = 6SE +/- 111.88, N = 3SE +/- 274.09, N = 3SE +/- 84.64, N = 3SE +/- 127.04, N = 3SE +/- 595.00, N = 360130600185978258846598685972458962501871. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSBtrfsEXT450100150200250SE +/- 0.09, N = 3SE +/- 0.83, N = 3SE +/- 7.26, N = 6SE +/- 0.45, N = 3SE +/- 1.10, N = 3SE +/- 0.34, N = 3SE +/- 0.51, N = 3SE +/- 2.38, N = 3240.53240.09239.14235.40239.48238.91235.86200.761. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfs15K30K45K60K75KSE +/- 221.56, N = 3SE +/- 922.02, N = 3SE +/- 1510.45, N = 6SE +/- 163.40, N = 3SE +/- 171.88, N = 3SE +/- 718.19, N = 3SE +/- 576.16, N = 3SE +/- 274.77, N = 371757694936947314962717237150971067146781. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfs60120180240300SE +/- 0.89, N = 3SE +/- 3.69, N = 3SE +/- 6.04, N = 6SE +/- 0.65, N = 3SE +/- 0.69, N = 3SE +/- 2.87, N = 3SE +/- 2.31, N = 3SE +/- 1.10, N = 3287.04277.99277.9159.87286.91286.05284.2858.731. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs15K30K45K60K75KSE +/- 35.97, N = 3SE +/- 7.17, N = 3SE +/- 3.79, N = 3SE +/- 640.29, N = 3SE +/- 15.45, N = 3SE +/- 3.00, N = 3SE +/- 542.36, N = 3SE +/- 195.86, N = 370334549635373051239561885316252830490511. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

No KPTI Or RetpoKPTI + Full Retpo UnderflowOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSF2FSBtrfs60120180240300SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 2.56, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 2.17, N = 3SE +/- 0.78, N = 3281.35219.87214.93204.97224.77212.66211.34196.221. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

SQLite

Test Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryXFSF2FSEXT4Btrfs20406080100SE +/- 0.17, N = 3SE +/- 0.39, N = 3SE +/- 2.53, N = 6SE +/- 1.43, N = 3SE +/- 0.46, N = 3SE +/- 0.39, N = 3SE +/- 1.47, N = 6SE +/- 1.04, N = 335.5840.5341.6984.4835.7340.0541.8281.841. (CC) gcc options: -O2 -lcurses -ldl -lpthread

Phoronix Test Suite v10.8.4