ssd

Bionic LXD container in Xenial host, ZFS on 2x(4x6TB HDD RAIDZ)

HTML result view exported from: https://openbenchmarking.org/result/1804164-FO-1804141FO99&grt.

ssdProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelCompilerFile-SystemSystem LayerScreen ResolutionCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMedrbd-nvmeIntel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB256GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioIntel ConnectionUbuntu 18.044.15.0-13-generic (x86_64)GCC 7.3.0ext4lxcIntel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfbUbuntu 16.044.4.0-93-generic (x86_64)GCC 5.4.0 201606091024x768Intel Xeon E3-1240 v3 @ 3.80GHz (4 Cores / 8 Threads)Supermicro X10SLL-F v1.02 (2.2 BIOS)Intel Xeon E3-1200 v3 DRAM32768MB8 x 6001GB Western Digital WD60EFRX-68M + 2 x 120GB INTEL SSDSC2BB12ASPEED ASPEED FamilyIntel Connection I217-LMUbuntu 18.044.4.0-116-generic (x86_64)GCC 7.3.0zfsIntel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB512GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioHP w20Intel Connection4.15.0-13-generic (x86_64)ext41680x1050Intel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfb4.4.0-93-generic (x86_64)ext21024x768lxcUbuntu 16.04GCC 5.4.0 20160609ext4OpenBenchmarking.orgCompiler Details- Ceph/SSD, 1Gb/s: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - DRBD/NVMe: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu Bionic, LXD/ZFS/HDD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu Bionic, ext4/LVM/SSD Samsung 850: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu Bionic, ext4/LXC/NVMe: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - drbd-nvme: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Ceph/SSD, 1Gb/s: CFQ / data=ordered,discard,relatime,rw,stripe=1024- DRBD/NVMe: none / data=ordered,relatime,rw,stripe=64- Ubuntu Bionic, ext4/LVM/SSD Samsung 850: CFQ / data=ordered,errors=remount-ro,relatime,rw- Ubuntu Bionic, ext4/LXC/NVMe: none / acl,barrier,block_validity,relatime,rw,stripe=64,user_xattr- drbd-nvme: none / data=ordered,relatime,rw,stripe=64Processor Details- Scaling Governor: intel_pstate performancePython Details- Ceph/SSD, 1Gb/s: Python 2.7.14+ + Python 3.6.5- DRBD/NVMe: Python 2.7.12 + Python 3.5.2- Ubuntu Bionic, LXD/ZFS/HDD: Python 2.7.14+ + Python 3.6.5- Ubuntu Bionic, ext4/LVM/SSD Samsung 850: Python 2.7.14+ + Python 3.6.5- Ubuntu Bionic, ext4/LXC/NVMe: Python 2.7.14+ + Python 3.6.5- drbd-nvme: Python 2.7.12 + Python 3.5.2Security Details- Ceph/SSD, 1Gb/s: KPTI + __user pointer sanitization + Full generic retpoline Protection- Ubuntu Bionic, LXD/ZFS/HDD: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection- Ubuntu Bionic, ext4/LVM/SSD Samsung 850: KPTI + __user pointer sanitization + Full generic retpoline ProtectionDisk Scheduler Details- Ubuntu Bionic, LXD/ZFS/HDD: NOOP

ssdaio-stress: Rand Writeapache: Static Web Page Servingcompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treedbench: 12 Clientsdbench: 48 Clientsdbench: 128 Clientsdbench: 1 Clientsfs-mark: 1000 Files, 1MB Sizecompress-gzip: Linux Source Tree Archiving To .tar.gzpostmark: Disk Transaction Performancesqlite: Timed SQLite Insertionstiobench: 64MB Rand Read - 32 Threadstiobench: 64MB Rand Write - 32 Threadsunpack-linux: linux-4.15.tar.xzCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMedrbd-nvme2219.4414605.66436.69187.371060.1186.08189.28286.6917.8917.3752.774261323.2547240.6862.349.193573.9530202.252471.56520.652685.943142.733239.232739.20923.36433.0334.0872822.54270736.236206.575.641382.4917967.171167.99192.40708.39139.65174.95240.4533.3852.6738.563157269.1414446.6642.947.732292.9411945.86862.26350.972042.16210.28570.621010.7742.7657.9050.164807135.4573033.0593.978.261918.1130230.491732.33206.232304.864050.654928.964649.74808.69421.7036.0657082.73237556.395618.2210.853582.94OpenBenchmarking.org

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random WriteCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMedrbd-nvme8001600240032004000SE +/- 21.90, N = 3SE +/- 15.07, N = 3SE +/- 4.29, N = 3SE +/- 12.50, N = 3SE +/- 5.34, N = 3SE +/- 32.62, N = 32219.443573.951382.492292.941918.113582.941. (CC) gcc options: -pthread -laio

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe6K12K18K24K30KSE +/- 129.19, N = 3SE +/- 131.83, N = 3SE +/- 77.42, N = 3SE +/- 34.80, N = 3SE +/- 204.79, N = 314605.6630202.2517967.1711945.8630230.491. (CC) gcc options: -shared -fPIC -O2 -pthread

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe5001000150020002500SE +/- 6.74, N = 3SE +/- 25.50, N = 3SE +/- 138.89, N = 6SE +/- 14.95, N = 6SE +/- 51.78, N = 6436.692471.561167.99862.261732.33

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe110220330440550SE +/- 1.90, N = 3SE +/- 3.27, N = 3SE +/- 2.78, N = 3SE +/- 2.96, N = 3SE +/- 88.35, N = 3187.37520.65192.40350.97206.23

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe6001200180024003000SE +/- 38.95, N = 3SE +/- 14.60, N = 3SE +/- 38.14, N = 3SE +/- 5.07, N = 3SE +/- 15.65, N = 31060.112685.94708.392042.162304.86

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe9001800270036004500SE +/- 1.06, N = 3SE +/- 7.95, N = 3SE +/- 2.45, N = 3SE +/- 0.68, N = 3SE +/- 15.93, N = 386.083142.73139.65210.284050.651. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 ClientsCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe11002200330044005500SE +/- 2.83, N = 5SE +/- 1.98, N = 3SE +/- 2.87, N = 3SE +/- 2.32, N = 3SE +/- 17.53, N = 3189.283239.23174.95570.624928.961. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 ClientsCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe10002000300040005000SE +/- 2.18, N = 3SE +/- 2.66, N = 3SE +/- 23.70, N = 6SE +/- 8.77, N = 3SE +/- 7.68, N = 3286.692739.20240.451010.774649.741. (CC) gcc options: -lpopt -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe2004006008001000SE +/- 0.03, N = 3SE +/- 1.83, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 3.12, N = 317.89923.3633.3842.76808.691. (CC) gcc options: -lpopt -O2

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB SizeCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe90180270360450SE +/- 0.07, N = 3SE +/- 2.77, N = 3SE +/- 0.72, N = 3SE +/- 0.06, N = 3SE +/- 0.75, N = 317.37433.0352.6757.90421.701. (CC) gcc options: -static

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe1224364860SE +/- 1.19, N = 6SE +/- 0.43, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.20, N = 352.7734.0838.5650.1636.06

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe16003200480064008000SE +/- 24.33, N = 3SE +/- 70.00, N = 3SE +/- 58.07, N = 6SE +/- 81.72, N = 6426172823157480757081. (CC) gcc options: -O3

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe70140210280350SE +/- 2.09, N = 3SE +/- 0.03, N = 5SE +/- 6.35, N = 6SE +/- 2.12, N = 6SE +/- 0.00, N = 3323.252.54269.14135.452.731. (CC) gcc options: -O2 -ldl -lpthread

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 ThreadsCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe60K120K180K240K300KSE +/- 7433.56, N = 6SE +/- 8289.11, N = 6SE +/- 859.43, N = 6SE +/- 2458.89, N = 6SE +/- 9654.48, N = 647240.68270736.2314446.6673033.05237556.391. (CC) gcc options: -O2

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 ThreadsCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe13002600390052006500SE +/- 0.19, N = 3SE +/- 44.34, N = 3SE +/- 0.67, N = 6SE +/- 1.58, N = 4SE +/- 121.39, N = 662.346206.5742.9493.975618.221. (CC) gcc options: -O2

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMe3691215SE +/- 0.07, N = 4SE +/- 0.01, N = 4SE +/- 0.11, N = 8SE +/- 0.03, N = 4SE +/- 0.61, N = 89.195.647.738.2610.85


Phoronix Test Suite v10.8.4