KPTI + Full Retpoline Underflow File-Systems

2 x Intel Xeon Gold 6138 testing with a TYAN S7106 (V1.00 BIOS) and ASPEED ASPEED Family on Ubuntu 17.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1801195-FO-KPTIFULLR53&grs&sro.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.00 BIOS)Intel Device 202012 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyVE228Intel I210 Gigabit ConnectionUbuntu 17.104.15.0-rc8-retpo-underflow (x86_64) 20180115GNOME Shell 3.26.1GCC 7.2.0ext41920x1080xfsbtrfsf2fsext4xfsbtrfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- KPTI + Full Retpo Underflow: EXT4: CFQ / data=ordered,relatime,rw- KPTI + Full Retpo Underflow: XFS: CFQ / attr2,inode64,noquota,relatime,rw- KPTI + Full Retpo Underflow: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- KPTI + Full Retpo Underflow: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: EXT4: CFQ / data=ordered,relatime,rw- No KPTI Or Retpo: XFS: CFQ / attr2,inode64,noquota,relatime,rw- No KPTI Or Retpo: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.14 + Python 3.6.3Security Details- KPTI + Full Retpo Underflow: EXT4, KPTI + Full Retpo Underflow: XFS, KPTI + Full Retpo Underflow: Btrfs, KPTI + Full Retpo Underflow: F2FS: KPTI + Full retpoline with underflow protection Protection

fio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directorydbench: 12blogbench: Writesqlite: Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directoryfs-mark: 5000 Files, 1MB Size, 4 Threadsfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directorycompilebench: Initial Createiozone: 4Kb - 8GB - Write Performancedbench: 6fs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Sizefio: Seq Write - Libaio - No - Yes - 4KB - Default Test DirectoryKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs286.91579.18854541.69211.3437.93235.86472.7968.17360.6729.5552.38419.00284.28704.84351435.58224.7738.27238.91358.0068.36450.5736.9277.30366.6958.73249.05319284.48196.2240.13200.76107.3172.31236.5235.8841.6261.59286.05286.84784540.53212.6641.27239.48560.8643.59252.0236.6853.65423.13277.91296.21830740.05214.9341.33240.53606.9443.41262.9536.9355.20409.84287.04599.45891141.82281.3540.80235.40559.0767.72374.0034.8852.95407.42277.99745.64437735.73219.8752.53240.09420.9993.82473.7244.2375.87329.0759.87250.99332981.84204.9741.37239.14107.4668.51243.9237.7268.6062.46OpenBenchmarking.org

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS15K30K45K60K75KSE +/- 274.77, N = 3SE +/- 171.88, N = 3SE +/- 718.19, N = 3SE +/- 576.16, N = 3SE +/- 163.40, N = 3SE +/- 221.56, N = 3SE +/- 1510.45, N = 6SE +/- 922.02, N = 314678717237150971067149627175769473694931. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS60120180240300SE +/- 1.10, N = 3SE +/- 0.69, N = 3SE +/- 2.87, N = 3SE +/- 2.31, N = 3SE +/- 0.65, N = 3SE +/- 0.89, N = 3SE +/- 6.04, N = 6SE +/- 3.69, N = 358.73286.91286.05284.2859.87287.04277.91277.991. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Dbench

Client Count: 12

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12BtrfsEXT4F2FSXFS160320480640800SE +/- 4.78, N = 3SE +/- 8.25, N = 5SE +/- 8.01, N = 6SE +/- 4.20, N = 3SE +/- 4.17, N = 6SE +/- 11.37, N = 3SE +/- 5.93, N = 6SE +/- 1.10, N = 3249.05579.18286.84704.84250.99599.45296.21745.641. (CC) gcc options: -lpopt -O2

BlogBench

Test: Write

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteBtrfsEXT4F2FSXFS2K4K6K8K10KSE +/- 20.60, N = 3SE +/- 138.28, N = 3SE +/- 177.76, N = 6SE +/- 67.30, N = 6SE +/- 48.22, N = 3SE +/- 132.68, N = 3SE +/- 22.02, N = 3SE +/- 82.15, N = 3319285457845351433298911830743771. (CC) gcc options: -O2 -pthread

SQLite

Test Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryBtrfsEXT4F2FSXFS20406080100SE +/- 1.43, N = 3SE +/- 2.53, N = 6SE +/- 0.39, N = 3SE +/- 0.17, N = 3SE +/- 1.04, N = 3SE +/- 1.47, N = 6SE +/- 0.39, N = 3SE +/- 0.46, N = 384.4841.6940.5335.5881.8441.8240.0535.731. (CC) gcc options: -O2 -lcurses -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS15K30K45K60K75KSE +/- 195.86, N = 3SE +/- 542.36, N = 3SE +/- 3.00, N = 3SE +/- 15.45, N = 3SE +/- 640.29, N = 3SE +/- 35.97, N = 3SE +/- 3.79, N = 3SE +/- 7.17, N = 349051528305316256188512397033453730549631. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS60120180240300SE +/- 0.78, N = 3SE +/- 2.17, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 2.56, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3196.22211.34212.66224.77204.97281.35214.93219.871. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FSXFS1224364860SE +/- 0.09, N = 3SE +/- 0.64, N = 6SE +/- 0.07, N = 3SE +/- 1.56, N = 6SE +/- 0.33, N = 3SE +/- 0.40, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 340.1337.9341.2738.2741.3740.8041.3352.531. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS13K26K39K52K65KSE +/- 595.00, N = 3SE +/- 127.04, N = 3SE +/- 274.09, N = 3SE +/- 84.64, N = 3SE +/- 1814.31, N = 6SE +/- 111.88, N = 3SE +/- 21.22, N = 3SE +/- 207.16, N = 350187589625986859724597825884660130600181. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS50100150200250SE +/- 2.38, N = 3SE +/- 0.51, N = 3SE +/- 1.10, N = 3SE +/- 0.34, N = 3SE +/- 7.26, N = 6SE +/- 0.45, N = 3SE +/- 0.09, N = 3SE +/- 0.83, N = 3200.76235.86239.48238.91239.14235.40240.53240.091. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Test: Initial Create

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateBtrfsEXT4F2FSXFS130260390520650SE +/- 7.12, N = 6SE +/- 16.91, N = 6SE +/- 16.55, N = 6SE +/- 24.88, N = 6SE +/- 8.01, N = 6SE +/- 12.78, N = 6SE +/- 21.57, N = 6SE +/- 19.14, N = 6107.31472.79560.86358.00107.46559.07606.94420.99

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceBtrfsEXT4F2FSXFS20406080100SE +/- 1.50, N = 6SE +/- 5.11, N = 6SE +/- 3.41, N = 6SE +/- 4.05, N = 6SE +/- 3.00, N = 6SE +/- 3.71, N = 6SE +/- 4.19, N = 6SE +/- 4.15, N = 672.3168.1743.5968.3668.5167.7243.4193.821. (CC) gcc options: -O3

Dbench

Client Count: 6

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6BtrfsEXT4F2FSXFS100200300400500SE +/- 1.25, N = 3SE +/- 17.01, N = 6SE +/- 17.38, N = 6SE +/- 0.92, N = 3SE +/- 0.74, N = 3SE +/- 13.00, N = 6SE +/- 28.43, N = 6SE +/- 1.93, N = 3236.52360.67252.02450.57243.92374.00262.95473.721. (CC) gcc options: -lpopt -O2

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FSXFS1020304050SE +/- 0.79, N = 6SE +/- 2.63, N = 6SE +/- 0.59, N = 4SE +/- 1.34, N = 6SE +/- 1.08, N = 6SE +/- 0.48, N = 6SE +/- 0.64, N = 4SE +/- 1.59, N = 635.8829.5536.6836.9237.7234.8836.9344.231. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FSXFS20406080100SE +/- 1.73, N = 6SE +/- 12.57, N = 6SE +/- 15.59, N = 6SE +/- 9.27, N = 6SE +/- 8.31, N = 6SE +/- 12.94, N = 6SE +/- 15.90, N = 6SE +/- 6.61, N = 641.6252.3853.6577.3068.6052.9555.2075.871. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS20K40K60K80K100KSE +/- 454.19, N = 6SE +/- 345.09, N = 3SE +/- 548.90, N = 3SE +/- 6559.07, N = 6SE +/- 600.12, N = 6SE +/- 2141.00, N = 6SE +/- 1979.16, N = 6SE +/- 7787.52, N = 6153931047461057809166815611101850102457822631. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfsEXT4F2FSXFS90180270360450SE +/- 1.82, N = 6SE +/- 1.38, N = 3SE +/- 2.20, N = 3SE +/- 26.24, N = 6SE +/- 2.40, N = 6SE +/- 8.56, N = 6SE +/- 7.92, N = 6SE +/- 31.15, N = 661.59419.00423.13366.6962.46407.42409.84329.071. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.4