EXT4 Encryption HDD Enclosure Tests

USB external enclosure HDD 3.5 inch drive benchmarks with EXT4 encryption on Ubuntu Linux. Testd for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1806281-AR-ENCLOSURE42&sor&gru.

EXT4 Encryption HDD Enclosure TestsProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscryptIntel Core i7-8700K @ 4.70GHz (6 Cores / 12 Threads)ASUS PRIME Z370-A (0805 BIOS)Intel Device 3ec22 x 8192 MB DDR4-3000MT/s4001GB 004-2CV104 + 118GB INTEL SSDPEK1W120GAAMD Radeon RX Vega 8176MBRealtek ALC1220DELL P2415QIntel ConnectionUbuntu 18.044.15.0-23-generic (x86_64)GNOME Shell 3.28.1X Server 1.19.64.6.13529GCC 7.3.0ext43840x2160ext4 (ecryptfs)ext4OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- EXT4 Stock: CFQ / data=ordered,relatime,rw- EXT4 LUKS Encryption: NONE / data=ordered,nodev,nosuid,relatime,rw- EXT4 eCryptfs: NONE / ecryptfs_cipher=aes,ecryptfs_key_bytes=16,ecryptfs_sig=42e8f9b0496e22a5,ecryptfs_unlink_sigs,relatime,rw - EXT4 fscrypt: CFQ / data=ordered,relatime,rwProcessor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.15rc1 + Python 3.6.5Security Details- KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW Protection

EXT4 Encryption HDD Enclosure Testsfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefio: Rand Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directorycompilebench: Initial Createnginx: Static Web Page Servingapache: Static Web Page Servingsqlite: Timed SQLite Insertionsbuild-linux-kernel: Time To Compilebuild-php: Time To Compileosbench: Create FilesEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfsEXT4 fscrypt5.0011.205.201050.5977.175.969.751.1316320.87504.3243074.3235073.551099.2077.9653.0911.334.879.804.5770.930.5853.025.799.270.8911522.70459.5446685.3935766.882264.6177.9153.0911.449.7312.804.67130.0530600.53965.2279.6154.0129.415.4711.734.7770990.5865.155.889.623.2914817.53353.1043019.4235314.081003.0278.0752.9618.14OpenBenchmarking.org

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4 eCryptfsEXT4 fscryptEXT4 StockEXT4 LUKS Encryption3691215SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.81, N = 6SE +/- 0.03, N = 39.735.475.004.871. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4 eCryptfsEXT4 fscryptEXT4 StockEXT4 LUKS Encryption3691215SE +/- 2.87, N = 6SE +/- 0.13, N = 3SE +/- 0.18, N = 6SE +/- 0.23, N = 612.8011.7311.209.801. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4 StockEXT4 fscryptEXT4 eCryptfsEXT4 LUKS Encryption1.172.343.514.685.85SE +/- 0.14, N = 6SE +/- 0.22, N = 6SE +/- 0.46, N = 6SE +/- 0.09, N = 35.204.774.674.571. (CC) gcc options: -static

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 fscryptEXT4 StockEXT4 LUKS Encryption15003000450060007500SE +/- 138.17, N = 6SE +/- 0.59, N = 37099.00105.0070.931. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 StockEXT4 fscryptEXT4 LUKS Encryption0.13280.26560.39840.53120.664SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.590.580.581. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 StockEXT4 fscryptEXT4 LUKS Encryption20406080100SE +/- 1.43, N = 3SE +/- 1.13, N = 4SE +/- 2.36, N = 677.1765.1553.021. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 StockEXT4 fscryptEXT4 LUKS Encryption1.3412.6824.0235.3646.705SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 35.965.885.791. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 StockEXT4 fscryptEXT4 LUKS Encryption3691215SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 39.759.629.271. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 fscryptEXT4 StockEXT4 LUKS Encryption0.74031.48062.22092.96123.7015SE +/- 0.02, N = 3SE +/- 0.02, N = 6SE +/- 0.00, N = 33.291.130.891. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryEXT4 StockEXT4 fscryptEXT4 LUKS Encryption4080120160200SE +/- 2.66, N = 4SE +/- 2.58, N = 6SE +/- 1.78, N = 61631481151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryEXT4 LUKS EncryptionEXT4 StockEXT4 fscrypt510152025SE +/- 0.36, N = 3SE +/- 0.38, N = 3SE +/- 0.22, N = 322.7020.8717.531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4 StockEXT4 LUKS EncryptionEXT4 fscryptEXT4 eCryptfs110220330440550SE +/- 4.18, N = 3SE +/- 4.68, N = 3SE +/- 4.85, N = 3SE +/- 4.82, N = 6504.32459.54353.10130.05

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingEXT4 LUKS EncryptionEXT4 StockEXT4 fscrypt10K20K30K40K50KSE +/- 726.98, N = 6SE +/- 83.61, N = 3SE +/- 159.74, N = 346685.3943074.3243019.421. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingEXT4 LUKS EncryptionEXT4 fscryptEXT4 StockEXT4 eCryptfs8K16K24K32K40KSE +/- 32.55, N = 3SE +/- 166.46, N = 3SE +/- 154.69, N = 3SE +/- 1046.45, N = 635766.8835314.0835073.5530600.531. (CC) gcc options: -shared -fPIC -O2 -pthread

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsEXT4 eCryptfsEXT4 fscryptEXT4 StockEXT4 LUKS Encryption5001000150020002500SE +/- 53.06, N = 6SE +/- 164.72, N = 6SE +/- 174.18, N = 6SE +/- 303.73, N = 6965.221003.021099.202264.611. (CC) gcc options: -O2 -lz -ldl -lpthread

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To CompileEXT4 LUKS EncryptionEXT4 StockEXT4 fscryptEXT4 eCryptfs20406080100SE +/- 1.13, N = 6SE +/- 1.01, N = 3SE +/- 0.72, N = 3SE +/- 1.48, N = 377.9177.9678.0779.61

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 7.1.9Time To CompileEXT4 fscryptEXT4 StockEXT4 LUKS EncryptionEXT4 eCryptfs1224364860SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.39, N = 3SE +/- 0.47, N = 352.9653.0953.0954.011. (CC) gcc options: -O2 -pedantic -ldl -lz -lm

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesEXT4 StockEXT4 LUKS EncryptionEXT4 fscryptEXT4 eCryptfs714212835SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.07, N = 311.3311.4418.1429.41-lm1. (CC) gcc options:

Phoronix Test Suite v10.8.4