EXT4 Encryption Linux 4.18 Git

Tests for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1806152-AR-EXT4ENCRY33&rdt&gru.

EXT4 Encryption Linux 4.18 GitProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.00 BIOS)Intel Sky Lake-E DMI3 Registers12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyVE228Intel I210 Gigabit ConnectionUbuntu 18.044.17.0-999-generic (x86_64) 20180614GNOME Shell 3.28.1GCC 7.3.0ext41920x1080ext4 (ecryptfs)ext4OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- CFQ / relatime,rwProcessor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.15rc1 + Python 3.6.5Security Details- KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW Protection

EXT4 Encryption Linux 4.18 Gitfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizecompilebench: Initial Createfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4MB - Default Test Directorynginx: Static Web Page Servingpgbench: Buffer Test - Normal Load - Read Writesqlite: Timed SQLite Insertionsbuild-gcc: Time To Compileosbench: Create FilesEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt62.8747.7338.70355.0326.70428394.703301532444798.9333229783.062184.2546.071029.0123.8174.1050.9344.60505.6531.2350710847416950611647729708.932382.9940.90852.3515.6050.3348.1336.30201.4725722.021832.1842.71964.2439.5860.5049.3340.67509.8521.5331057.5726386.3031061.5030229831.022321.6245.50854.0315.82OpenBenchmarking.org

CPU Usage (Summary) Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgPercentCPU Usage (Summary) MonitorPhoronix Test Suite System MonitoringEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt20406080100Min: 0 / Avg: 8.72 / Max: 100Min: 0 / Avg: 6.21 / Max: 100Min: 0 / Avg: 7.16 / Max: 100Min: 0 / Avg: 6.17 / Max: 100

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt1632486480SE +/- 22.67, N = 3SE +/- 23.48, N = 3SE +/- 13.28, N = 3SE +/- 17.26, N = 362.8774.1050.3360.501. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt1122334455SE +/- 1.96, N = 3SE +/- 0.74, N = 3SE +/- 0.58, N = 3SE +/- 0.74, N = 347.7350.9348.1349.331. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt1020304050SE +/- 6.90, N = 3SE +/- 3.15, N = 3SE +/- 1.90, N = 3SE +/- 2.57, N = 338.7044.6036.3040.671. (CC) gcc options: -static

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt6K12K18K24K30KSE +/- 1270.17, N = 3SE +/- 450.92, N = 3SE +/- 484.19, N = 32430027700147331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt80K160K240K320K400KSE +/- 6557.44, N = 3SE +/- 288.68, N = 339200043400221001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt6K12K18K24K30KSE +/- 953.94, N = 3SE +/- 1091.38, N = 3SE +/- 218.58, N = 32540029667157671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt110220330440550SE +/- 7.52, N = 3SE +/- 6.00, N = 3SE +/- 0.53, N = 3SE +/- 5.44, N = 3355.03505.65201.47509.85

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt714212835SE +/- 0.00, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 326.7031.2321.531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt9001800270036004500SE +/- 52.26, N = 3SE +/- 0.33, N = 342835073101. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt20406080100SE +/- 4.82, N = 3SE +/- 2.00, N = 3SE +/- 1.82, N = 394.70108.0057.571. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt100200300400500SE +/- 8.17, N = 3SE +/- 3.18, N = 3SE +/- 20.07, N = 33304742631. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt30060090012001500SE +/- 25.70, N = 3SE +/- 0.88, N = 3SE +/- 0.10, N = 31532.00169.0086.301. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt10002000300040005000SE +/- 10.49, N = 344475063101. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt306090120150SE +/- 3.58, N = 3SE +/- 4.26, N = 3SE +/- 0.85, N = 398.93116.0061.501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4MB - Disk Target: Default Test DirectoryEXT4 fscryptNo EncryptionLUKS dm-crypt100200300400500SE +/- 4.51, N = 33324773021. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt6K12K18K24K30KSE +/- 78.30, N = 3SE +/- 111.01, N = 3SE +/- 137.57, N = 329783.0629708.9325722.0229831.021. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt5001000150020002500SE +/- 77.82, N = 3SE +/- 74.56, N = 3SE +/- 70.33, N = 3SE +/- 189.21, N = 32184.252382.991832.182321.621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.03.118.4No Encryption0.02.821.3eCryptfs0.02.420.4LUKS dm-crypt0.03.318.5OpenBenchmarking.orgPercent, Fewer Is BetterPostgreSQL pgbench 10.3CPU Usage (Summary) Monitor612182430

PostgreSQL pgbench

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.63.8OpenBenchmarking.orgPercent, Fewer Is BetterPostgreSQL pgbench 10.3CPU Usage (Summary) Monitor1.06032.12063.18094.24125.3015

SQLite

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.00.51.3No Encryption0.00.41.3eCryptfs0.00.51.3LUKS dm-crypt0.00.51.3OpenBenchmarking.orgPercent, Fewer Is BetterSQLite 3.22CPU Usage (Summary) Monitor0.69051.3812.07152.7623.4525

FS-Mark

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.00.81.3No Encryption0.00.81.3eCryptfs0.00.91.3LUKS dm-crypt0.00.91.3OpenBenchmarking.orgPercent, Fewer Is BetterFS-Mark 3.3CPU Usage (Summary) Monitor0.6991.3982.0972.7963.495

FS-Mark

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.45.0No Encryption0.01.32.4eCryptfs0.01.75.0LUKS dm-crypt0.01.55.0OpenBenchmarking.orgPercent, Fewer Is BetterFS-Mark 3.3CPU Usage (Summary) Monitor1.753.55.2578.75

FS-Mark

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.01.3No Encryption0.00.91.5eCryptfs0.01.01.3LUKS dm-crypt0.01.21.4OpenBenchmarking.orgPercent, Fewer Is BetterFS-Mark 3.3CPU Usage (Summary) Monitor0.75521.51042.26563.02083.776

Compile Bench

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.02.5No Encryption0.00.92.5eCryptfs0.01.02.5LUKS dm-crypt0.02.78.3OpenBenchmarking.orgPercent, Fewer Is BetterCompile Bench 0.6CPU Usage (Summary) Monitor3691215

Timed GCC Compilation

CPU Usage (Summary) Monitor

OpenBenchmarking.orgPercent, Fewer Is BetterTimed GCC Compilation 7.2CPU Usage (Summary) MonitorEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt20406080100Min: 0 / Avg: 19.38 / Max: 100Min: 0 / Avg: 13.33 / Max: 100Min: 0 / Avg: 14.79 / Max: 100Min: 0 / Avg: 13.05 / Max: 100

NGINX Benchmark

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.02.22.6No Encryption0.02.33.6eCryptfs0.02.22.6LUKS dm-crypt0.02.32.8OpenBenchmarking.orgPercent, Fewer Is BetterNGINX Benchmark 1.9.9CPU Usage (Summary) Monitor1.01812.03623.05434.07245.0905

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.00.56.3No Encryption0.00.56.7eCryptfs0.00.76.2LUKS dm-crypt0.01.46.1OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor3691215

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.01.5No Encryption0.00.10.5eCryptfs0.00.86.3LUKS dm-crypt0.01.41.9OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor3691215

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.02.5No Encryption0.00.71.4eCryptfs0.00.00.1LUKS dm-crypt0.00.92.4OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor1.3812.7624.1435.5246.905

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.16.4No Encryption0.00.71.5eCryptfs0.00.10.7LUKS dm-crypt0.01.05.7OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor3691215

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.62.4No Encryption0.00.81.4eCryptfs0.00.65.1LUKS dm-crypt0.01.11.5OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor1.773.545.317.088.85

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.26.0No Encryption0.00.10.4eCryptfs0.00.86.4LUKS dm-crypt0.01.65.8OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor3691215

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.05.0No Encryption0.00.71.4eCryptfs0.00.00.2LUKS dm-crypt0.00.84.0OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor1.743.485.226.968.7

Flexible IO Tester

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.06.1No Encryption0.00.96.3eCryptfs0.00.00.3LUKS dm-crypt0.00.91.2OpenBenchmarking.orgPercent, Fewer Is BetterFlexible IO Tester 3.1CPU Usage (Summary) Monitor3691215

OSBench

CPU Usage (Summary) Monitor

MinAvgMaxEXT4 fscrypt0.01.21.4No Encryption0.01.01.4eCryptfs0.11.01.4LUKS dm-crypt0.01.21.8OpenBenchmarking.orgPercent, Fewer Is BetterOSBenchCPU Usage (Summary) Monitor1.01192.02383.03574.04765.0595

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt1020304050SE +/- 5.24, N = 3SE +/- 1.86, N = 3SE +/- 1.86, N = 3SE +/- 1.92, N = 346.0740.9042.7145.501. (CC) gcc options: -O2 -lz -ldl -lpthread

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 7.2Time To CompileEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt2004006008001000SE +/- 1.49, N = 3SE +/- 3.59, N = 3SE +/- 1.72, N = 3SE +/- 1.86, N = 31029.01852.35964.24854.03

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesEXT4 fscryptNo EncryptioneCryptfsLUKS dm-crypt918273645SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 323.8115.6039.5815.82-lm-lm-lm1. (CC) gcc options:

Phoronix Test Suite v10.8.5