EXT4 Encryption HDD Enclosure Tests

USB external enclosure HDD 3.5 inch drive benchmarks with EXT4 encryption on Ubuntu Linux. Testd for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1806281-AR-ENCLOSURE42.

EXT4 Encryption HDD Enclosure TestsProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscryptIntel Core i7-8700K @ 4.70GHz (6 Cores / 12 Threads)ASUS PRIME Z370-A (0805 BIOS)Intel Device 3ec22 x 8192 MB DDR4-3000MT/s4001GB 004-2CV104 + 118GB INTEL SSDPEK1W120GAAMD Radeon RX Vega 8176MBRealtek ALC1220DELL P2415QIntel ConnectionUbuntu 18.044.15.0-23-generic (x86_64)GNOME Shell 3.28.1X Server 1.19.64.6.13529GCC 7.3.0ext43840x2160ext4 (ecryptfs)ext4OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- EXT4 Stock: CFQ / data=ordered,relatime,rw- EXT4 LUKS Encryption: NONE / data=ordered,nodev,nosuid,relatime,rw- EXT4 eCryptfs: NONE / ecryptfs_cipher=aes,ecryptfs_key_bytes=16,ecryptfs_sig=42e8f9b0496e22a5,ecryptfs_unlink_sigs,relatime,rw - EXT4 fscrypt: CFQ / data=ordered,relatime,rwProcessor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.15rc1 + Python 3.6.5Security Details- KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW Protection

EXT4 Encryption HDD Enclosure Testssqlite: Timed SQLite Insertionsfio: Rand Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizecompilebench: Initial Createbuild-linux-kernel: Time To Compilebuild-php: Time To Compilenginx: Static Web Page Servingapache: Static Web Page Servingosbench: Create FilesEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt1099.201050.5977.175.969.751.1316320.875.0011.205.20504.3277.9653.0943074.3235073.5511.332264.6170.930.5853.025.799.270.8911522.704.879.804.57459.5477.9153.0946685.3935766.8811.44965.229.7312.804.67130.0579.6154.0130600.5329.411003.0270990.5865.155.889.623.2914817.535.4711.734.77353.1078.0752.9643019.4235314.0818.14OpenBenchmarking.org

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt5001000150020002500SE +/- 174.18, N = 6SE +/- 303.73, N = 6SE +/- 53.06, N = 6SE +/- 164.72, N = 61099.202264.61965.221003.021. (CC) gcc options: -O2 -lz -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt15003000450060007500SE +/- 0.59, N = 3SE +/- 138.17, N = 6105.0070.937099.001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt0.13280.26560.39840.53120.664SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.590.580.581. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt20406080100SE +/- 1.43, N = 3SE +/- 2.36, N = 6SE +/- 1.13, N = 477.1753.0265.151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt1.3412.6824.0235.3646.705SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 35.965.795.881. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt3691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 39.759.279.621. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt0.74031.48062.22092.96123.7015SE +/- 0.02, N = 6SE +/- 0.00, N = 3SE +/- 0.02, N = 31.130.893.291. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt4080120160200SE +/- 2.66, N = 4SE +/- 1.78, N = 6SE +/- 2.58, N = 61631151481. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt510152025SE +/- 0.38, N = 3SE +/- 0.36, N = 3SE +/- 0.22, N = 320.8722.7017.531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt3691215SE +/- 0.81, N = 6SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 35.004.879.735.471. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt3691215SE +/- 0.18, N = 6SE +/- 0.23, N = 6SE +/- 2.87, N = 6SE +/- 0.13, N = 311.209.8012.8011.731. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt1.172.343.514.685.85SE +/- 0.14, N = 6SE +/- 0.09, N = 3SE +/- 0.46, N = 6SE +/- 0.22, N = 65.204.574.674.771. (CC) gcc options: -static

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt110220330440550SE +/- 4.18, N = 3SE +/- 4.68, N = 3SE +/- 4.82, N = 6SE +/- 4.85, N = 3504.32459.54130.05353.10

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To CompileEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt20406080100SE +/- 1.01, N = 3SE +/- 1.13, N = 6SE +/- 1.48, N = 3SE +/- 0.72, N = 377.9677.9179.6178.07

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 7.1.9Time To CompileEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt1224364860SE +/- 0.12, N = 3SE +/- 0.39, N = 3SE +/- 0.47, N = 3SE +/- 0.13, N = 353.0953.0954.0152.961. (CC) gcc options: -O2 -pedantic -ldl -lz -lm

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingEXT4 StockEXT4 LUKS EncryptionEXT4 fscrypt10K20K30K40K50KSE +/- 83.61, N = 3SE +/- 726.98, N = 6SE +/- 159.74, N = 343074.3246685.3943019.421. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt8K16K24K32K40KSE +/- 154.69, N = 3SE +/- 32.55, N = 3SE +/- 1046.45, N = 6SE +/- 166.46, N = 335073.5535766.8830600.5335314.081. (CC) gcc options: -shared -fPIC -O2 -pthread

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt714212835SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.21, N = 311.3311.4429.4118.14-lm1. (CC) gcc options:

Phoronix Test Suite v10.8.4