ssd

Bionic LXD container in Xenial host, ZFS on 2x(4x6TB HDD RAIDZ)

HTML result view exported from: https://openbenchmarking.org/result/1804164-FO-1804141FO99&sor.

ssdProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelCompilerFile-SystemSystem LayerScreen ResolutionCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMedrbd-nvmeIntel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB256GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioIntel ConnectionUbuntu 18.044.15.0-13-generic (x86_64)GCC 7.3.0ext4lxcIntel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfbUbuntu 16.044.4.0-93-generic (x86_64)GCC 5.4.0 201606091024x768Intel Xeon E3-1240 v3 @ 3.80GHz (4 Cores / 8 Threads)Supermicro X10SLL-F v1.02 (2.2 BIOS)Intel Xeon E3-1200 v3 DRAM32768MB8 x 6001GB Western Digital WD60EFRX-68M + 2 x 120GB INTEL SSDSC2BB12ASPEED ASPEED FamilyIntel Connection I217-LMUbuntu 18.044.4.0-116-generic (x86_64)GCC 7.3.0zfsIntel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB512GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioHP w20Intel Connection4.15.0-13-generic (x86_64)ext41680x1050Intel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfb4.4.0-93-generic (x86_64)ext21024x768lxcUbuntu 16.04GCC 5.4.0 20160609ext4OpenBenchmarking.orgCompiler Details- Ceph/SSD, 1Gb/s: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - DRBD/NVMe: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu Bionic, LXD/ZFS/HDD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu Bionic, ext4/LVM/SSD Samsung 850: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu Bionic, ext4/LXC/NVMe: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - drbd-nvme: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Ceph/SSD, 1Gb/s: CFQ / data=ordered,discard,relatime,rw,stripe=1024- DRBD/NVMe: none / data=ordered,relatime,rw,stripe=64- Ubuntu Bionic, ext4/LVM/SSD Samsung 850: CFQ / data=ordered,errors=remount-ro,relatime,rw- Ubuntu Bionic, ext4/LXC/NVMe: none / acl,barrier,block_validity,relatime,rw,stripe=64,user_xattr- drbd-nvme: none / data=ordered,relatime,rw,stripe=64Processor Details- Scaling Governor: intel_pstate performancePython Details- Ceph/SSD, 1Gb/s: Python 2.7.14+ + Python 3.6.5- DRBD/NVMe: Python 2.7.12 + Python 3.5.2- Ubuntu Bionic, LXD/ZFS/HDD: Python 2.7.14+ + Python 3.6.5- Ubuntu Bionic, ext4/LVM/SSD Samsung 850: Python 2.7.14+ + Python 3.6.5- Ubuntu Bionic, ext4/LXC/NVMe: Python 2.7.14+ + Python 3.6.5- drbd-nvme: Python 2.7.12 + Python 3.5.2Security Details- Ceph/SSD, 1Gb/s: KPTI + __user pointer sanitization + Full generic retpoline Protection- Ubuntu Bionic, LXD/ZFS/HDD: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection- Ubuntu Bionic, ext4/LVM/SSD Samsung 850: KPTI + __user pointer sanitization + Full generic retpoline ProtectionDisk Scheduler Details- Ubuntu Bionic, LXD/ZFS/HDD: NOOP

ssdaio-stress: Rand Writesqlite: Timed SQLite Insertionsfs-mark: 1000 Files, 1MB Sizedbench: 12 Clientsdbench: 48 Clientsdbench: 128 Clientsdbench: 1 Clientstiobench: 64MB Rand Read - 32 Threadstiobench: 64MB Rand Write - 32 Threadscompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treeunpack-linux: linux-4.15.tar.xzpostmark: Disk Transaction Performancecompress-gzip: Linux Source Tree Archiving To .tar.gzapache: Static Web Page ServingCeph/SSD, 1Gb/sDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMedrbd-nvme2219.44323.2517.3786.08189.28286.6917.8947240.6862.34436.69187.371060.119.19426152.7714605.663573.952.54433.033142.733239.232739.20923.36270736.236206.572471.56520.652685.945.64728234.0830202.251382.49269.1452.67139.65174.95240.4533.3814446.6642.941167.99192.40708.397.73315738.5617967.172292.94135.4557.90210.28570.621010.7742.7673033.0593.97862.26350.972042.168.26480750.1611945.861918.112.73421.704050.654928.964649.74808.69237556.395618.221732.33206.232304.8610.85570836.0630230.493582.94OpenBenchmarking.org

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writedrbd-nvmeDRBD/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, LXD/ZFS/HDD8001600240032004000SE +/- 32.62, N = 3SE +/- 15.07, N = 3SE +/- 12.50, N = 3SE +/- 21.90, N = 3SE +/- 5.34, N = 3SE +/- 4.29, N = 33582.943573.952292.942219.441918.111382.491. (CC) gcc options: -pthread -laio

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, LXD/ZFS/HDDCeph/SSD, 1Gb/s70140210280350SE +/- 0.03, N = 5SE +/- 0.00, N = 3SE +/- 2.12, N = 6SE +/- 6.35, N = 6SE +/- 2.09, N = 32.542.73135.45269.14323.251. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB SizeDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, LXD/ZFS/HDDCeph/SSD, 1Gb/s90180270360450SE +/- 2.77, N = 3SE +/- 0.75, N = 3SE +/- 0.06, N = 3SE +/- 0.72, N = 3SE +/- 0.07, N = 3433.03421.7057.9052.6717.371. (CC) gcc options: -static

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsUbuntu Bionic, ext4/LXC/NVMeDRBD/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, LXD/ZFS/HDDCeph/SSD, 1Gb/s9001800270036004500SE +/- 15.93, N = 3SE +/- 7.95, N = 3SE +/- 0.68, N = 3SE +/- 2.45, N = 3SE +/- 1.06, N = 34050.653142.73210.28139.6586.081. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 ClientsUbuntu Bionic, ext4/LXC/NVMeDRBD/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, LXD/ZFS/HDD11002200330044005500SE +/- 17.53, N = 3SE +/- 1.98, N = 3SE +/- 2.32, N = 3SE +/- 2.83, N = 5SE +/- 2.87, N = 34928.963239.23570.62189.28174.951. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 ClientsUbuntu Bionic, ext4/LXC/NVMeDRBD/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, LXD/ZFS/HDD10002000300040005000SE +/- 7.68, N = 3SE +/- 2.66, N = 3SE +/- 8.77, N = 3SE +/- 2.18, N = 3SE +/- 23.70, N = 64649.742739.201010.77286.69240.451. (CC) gcc options: -lpopt -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, LXD/ZFS/HDDCeph/SSD, 1Gb/s2004006008001000SE +/- 1.83, N = 3SE +/- 3.12, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3923.36808.6942.7633.3817.891. (CC) gcc options: -lpopt -O2

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 ThreadsDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, LXD/ZFS/HDD60K120K180K240K300KSE +/- 8289.11, N = 6SE +/- 9654.48, N = 6SE +/- 2458.89, N = 6SE +/- 7433.56, N = 6SE +/- 859.43, N = 6270736.23237556.3973033.0547240.6814446.661. (CC) gcc options: -O2

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 ThreadsDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, LXD/ZFS/HDD13002600390052006500SE +/- 44.34, N = 3SE +/- 121.39, N = 6SE +/- 1.58, N = 4SE +/- 0.19, N = 3SE +/- 0.67, N = 66206.575618.2293.9762.3442.941. (CC) gcc options: -O2

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/s5001000150020002500SE +/- 25.50, N = 3SE +/- 51.78, N = 6SE +/- 138.89, N = 6SE +/- 14.95, N = 6SE +/- 6.74, N = 32471.561732.331167.99862.26436.69

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateDRBD/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ubuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, LXD/ZFS/HDDCeph/SSD, 1Gb/s110220330440550SE +/- 3.27, N = 3SE +/- 2.96, N = 3SE +/- 88.35, N = 3SE +/- 2.78, N = 3SE +/- 1.90, N = 3520.65350.97206.23192.40187.37

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, LXD/ZFS/HDD6001200180024003000SE +/- 14.60, N = 3SE +/- 15.65, N = 3SE +/- 5.07, N = 3SE +/- 38.95, N = 3SE +/- 38.14, N = 32685.942304.862042.161060.11708.39

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, ext4/LXC/NVMe3691215SE +/- 0.01, N = 4SE +/- 0.11, N = 8SE +/- 0.03, N = 4SE +/- 0.07, N = 4SE +/- 0.61, N = 85.647.738.269.1910.85

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/sUbuntu Bionic, LXD/ZFS/HDD16003200480064008000SE +/- 70.00, N = 3SE +/- 81.72, N = 6SE +/- 24.33, N = 3SE +/- 58.07, N = 6728257084807426131571. (CC) gcc options: -O3

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzDRBD/NVMeUbuntu Bionic, ext4/LXC/NVMeUbuntu Bionic, LXD/ZFS/HDDUbuntu Bionic, ext4/LVM/SSD Samsung 850Ceph/SSD, 1Gb/s1224364860SE +/- 0.43, N = 3SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 1.19, N = 634.0836.0638.5650.1652.77

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingUbuntu Bionic, ext4/LXC/NVMeDRBD/NVMeUbuntu Bionic, LXD/ZFS/HDDCeph/SSD, 1Gb/sUbuntu Bionic, ext4/LVM/SSD Samsung 8506K12K18K24K30KSE +/- 204.79, N = 3SE +/- 131.83, N = 3SE +/- 77.42, N = 3SE +/- 129.19, N = 3SE +/- 34.80, N = 330230.4930202.2517967.1714605.6611945.861. (CC) gcc options: -shared -fPIC -O2 -pthread


Phoronix Test Suite v10.8.4