KPTI + Full Retpoline Underflow File-Systems

2 x Intel Xeon Gold 6138 testing with a TYAN S7106 (V1.00 BIOS) and ASPEED ASPEED Family on Ubuntu 17.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1801195-FO-KPTIFULLR53.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.00 BIOS)Intel Device 202012 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyVE228Intel I210 Gigabit ConnectionUbuntu 17.104.15.0-rc8-retpo-underflow (x86_64) 20180115GNOME Shell 3.26.1GCC 7.2.0ext41920x1080xfsbtrfsf2fsext4xfsbtrfsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- KPTI + Full Retpo Underflow: EXT4: CFQ / data=ordered,relatime,rw- KPTI + Full Retpo Underflow: XFS: CFQ / attr2,inode64,noquota,relatime,rw- KPTI + Full Retpo Underflow: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- KPTI + Full Retpo Underflow: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - No KPTI Or Retpo: EXT4: CFQ / data=ordered,relatime,rw- No KPTI Or Retpo: XFS: CFQ / attr2,inode64,noquota,relatime,rw- No KPTI Or Retpo: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.14 + Python 3.6.3Security Details- KPTI + Full Retpo Underflow: EXT4, KPTI + Full Retpo Underflow: XFS, KPTI + Full Retpo Underflow: Btrfs, KPTI + Full Retpo Underflow: F2FS: KPTI + Full retpoline with underflow protection Protection

sqlite: Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writedbench: 6dbench: 12iozone: 4Kb - 8GB - Write Performancecompilebench: Initial CreateKPTI + Full Retpo UnderflowNo KPTI Or Retpo EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs41.69211.34286.91235.86419.0052.3837.9329.558545360.67579.1868.17472.7935.58224.77284.28238.91366.6977.3038.2736.923514450.57704.8468.36358.0084.48196.2258.73200.7661.5941.6240.1335.883192236.52249.0572.31107.3140.53212.66286.05239.48423.1353.6541.2736.687845252.02286.8443.59560.8640.05214.93277.91240.53409.8455.2041.3336.938307262.95296.2143.41606.9441.82281.35287.04235.40407.4252.9540.8034.888911374.00599.4567.72559.0735.73219.87277.99240.09329.0775.8752.5344.234377473.72745.6493.82420.9981.84204.9759.87239.1462.4668.6041.3737.723329243.92250.9968.51107.46OpenBenchmarking.org

SQLite

Test Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryEXT4XFSBtrfsF2FS20406080100SE +/- 2.53, N = 6SE +/- 0.17, N = 3SE +/- 1.43, N = 3SE +/- 0.39, N = 3SE +/- 0.39, N = 3SE +/- 1.47, N = 6SE +/- 0.46, N = 3SE +/- 1.04, N = 341.6935.5884.4840.5340.0541.8235.7381.841. (CC) gcc options: -O2 -lcurses -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS60120180240300SE +/- 2.17, N = 3SE +/- 0.06, N = 3SE +/- 0.78, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 2.56, N = 3211.34224.77196.22212.66214.93281.35219.87204.971. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS15K30K45K60K75KSE +/- 542.36, N = 3SE +/- 15.45, N = 3SE +/- 195.86, N = 3SE +/- 3.00, N = 3SE +/- 3.79, N = 3SE +/- 35.97, N = 3SE +/- 7.17, N = 3SE +/- 640.29, N = 352830561884905153162537307033454963512391. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS60120180240300SE +/- 0.69, N = 3SE +/- 2.31, N = 3SE +/- 1.10, N = 3SE +/- 2.87, N = 3SE +/- 6.04, N = 6SE +/- 0.89, N = 3SE +/- 3.69, N = 3SE +/- 0.65, N = 3286.91284.2858.73286.05277.91287.04277.9959.871. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS15K30K45K60K75KSE +/- 171.88, N = 3SE +/- 576.16, N = 3SE +/- 274.77, N = 3SE +/- 718.19, N = 3SE +/- 1510.45, N = 6SE +/- 221.56, N = 3SE +/- 922.02, N = 3SE +/- 163.40, N = 371723710671467871509694737175769493149621. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS50100150200250SE +/- 0.51, N = 3SE +/- 0.34, N = 3SE +/- 2.38, N = 3SE +/- 1.10, N = 3SE +/- 0.09, N = 3SE +/- 0.45, N = 3SE +/- 0.83, N = 3SE +/- 7.26, N = 6235.86238.91200.76239.48240.53235.40240.09239.141. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS13K26K39K52K65KSE +/- 127.04, N = 3SE +/- 84.64, N = 3SE +/- 595.00, N = 3SE +/- 274.09, N = 3SE +/- 21.22, N = 3SE +/- 111.88, N = 3SE +/- 207.16, N = 3SE +/- 1814.31, N = 658962597245018759868601305884660018597821. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS90180270360450SE +/- 1.38, N = 3SE +/- 26.24, N = 6SE +/- 1.82, N = 6SE +/- 2.20, N = 3SE +/- 7.92, N = 6SE +/- 8.56, N = 6SE +/- 31.15, N = 6SE +/- 2.40, N = 6419.00366.6961.59423.13409.84407.42329.0762.461. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4XFSBtrfsF2FS20K40K60K80K100KSE +/- 345.09, N = 3SE +/- 6559.07, N = 6SE +/- 454.19, N = 6SE +/- 548.90, N = 3SE +/- 1979.16, N = 6SE +/- 2141.00, N = 6SE +/- 7787.52, N = 6SE +/- 600.12, N = 6104746916681539310578010245710185082263156111. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4XFSBtrfsF2FS20406080100SE +/- 12.57, N = 6SE +/- 9.27, N = 6SE +/- 1.73, N = 6SE +/- 15.59, N = 6SE +/- 15.90, N = 6SE +/- 12.94, N = 6SE +/- 6.61, N = 6SE +/- 8.31, N = 652.3877.3041.6253.6555.2052.9575.8768.601. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4XFSBtrfsF2FS1224364860SE +/- 0.64, N = 6SE +/- 1.56, N = 6SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.40, N = 3SE +/- 0.13, N = 3SE +/- 0.33, N = 337.9338.2740.1341.2741.3340.8052.5341.371. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4XFSBtrfsF2FS1020304050SE +/- 2.63, N = 6SE +/- 1.34, N = 6SE +/- 0.79, N = 6SE +/- 0.59, N = 4SE +/- 0.64, N = 4SE +/- 0.48, N = 6SE +/- 1.59, N = 6SE +/- 1.08, N = 629.5536.9235.8836.6836.9334.8844.2337.721. (CC) gcc options: -static

BlogBench

Test: Write

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteEXT4XFSBtrfsF2FS2K4K6K8K10KSE +/- 138.28, N = 3SE +/- 67.30, N = 6SE +/- 20.60, N = 3SE +/- 177.76, N = 6SE +/- 22.02, N = 3SE +/- 132.68, N = 3SE +/- 82.15, N = 3SE +/- 48.22, N = 3854535143192784583078911437733291. (CC) gcc options: -O2 -pthread

Dbench

Client Count: 6

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6EXT4XFSBtrfsF2FS100200300400500SE +/- 17.01, N = 6SE +/- 0.92, N = 3SE +/- 1.25, N = 3SE +/- 17.38, N = 6SE +/- 28.43, N = 6SE +/- 13.00, N = 6SE +/- 1.93, N = 3SE +/- 0.74, N = 3360.67450.57236.52252.02262.95374.00473.72243.921. (CC) gcc options: -lpopt -O2

Dbench

Client Count: 12

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12EXT4XFSBtrfsF2FS160320480640800SE +/- 8.25, N = 5SE +/- 4.20, N = 3SE +/- 4.78, N = 3SE +/- 8.01, N = 6SE +/- 5.93, N = 6SE +/- 11.37, N = 3SE +/- 1.10, N = 3SE +/- 4.17, N = 6579.18704.84249.05286.84296.21599.45745.64250.991. (CC) gcc options: -lpopt -O2

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceEXT4XFSBtrfsF2FS20406080100SE +/- 5.11, N = 6SE +/- 4.05, N = 6SE +/- 1.50, N = 6SE +/- 3.41, N = 6SE +/- 4.19, N = 6SE +/- 3.71, N = 6SE +/- 4.15, N = 6SE +/- 3.00, N = 668.1768.3672.3143.5943.4167.7293.8268.511. (CC) gcc options: -O3

Compile Bench

Test: Initial Create

KPTI + Full Retpo UnderflowNo KPTI Or RetpoOpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4XFSBtrfsF2FS130260390520650SE +/- 16.91, N = 6SE +/- 24.88, N = 6SE +/- 7.12, N = 6SE +/- 16.55, N = 6SE +/- 21.57, N = 6SE +/- 12.78, N = 6SE +/- 19.14, N = 6SE +/- 8.01, N = 6472.79358.00107.31560.86606.94559.07420.99107.46

Phoronix Test Suite v10.8.4