ssd

Bionic LXD container in Xenial host, ZFS on 2x(4x6TB HDD RAIDZ)

HTML result view exported from: https://openbenchmarking.org/result/1804168-FO-1804141FO82.

ssdProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelCompilerFile-SystemSystem LayerScreen ResolutionCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSDIntel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB256GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioIntel ConnectionUbuntu 18.044.15.0-13-generic (x86_64)GCC 7.3.0ext4lxcIntel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfbUbuntu 16.044.4.0-93-generic (x86_64)GCC 5.4.0 201606091024x768Intel Xeon E3-1240 v3 @ 3.80GHz (4 Cores / 8 Threads)Supermicro X10SLL-F v1.02 (2.2 BIOS)Intel Xeon E3-1200 v3 DRAM32768MB8 x 6001GB Western Digital WD60EFRX-68M + 2 x 120GB INTEL SSDSC2BB12ASPEED ASPEED FamilyIntel Connection I217-LMUbuntu 18.044.4.0-116-generic (x86_64)GCC 7.3.0zfsIntel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfb4.4.0-93-generic (x86_64)ext2Intel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB512GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioHP w20Intel Connection4.15.0-13-generic (x86_64)ext41680x1050OpenBenchmarking.orgCompiler Details- Ceph 4 SSD, 1Gb eth: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - DRBD/RAID1/NVMe, 1Gb eth: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - LXD/ZFS/HD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - NVMe: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - SSD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- Ceph 4 SSD, 1Gb eth: CFQ / data=ordered,discard,relatime,rw,stripe=1024- DRBD/RAID1/NVMe, 1Gb eth: none / data=ordered,relatime,rw,stripe=64- NVMe: none / acl,barrier,block_validity,relatime,rw,stripe=64,user_xattr- SSD: CFQ / data=ordered,errors=remount-ro,relatime,rwProcessor Details- Scaling Governor: intel_pstate performancePython Details- Ceph 4 SSD, 1Gb eth: Python 2.7.14+ + Python 3.6.5- DRBD/RAID1/NVMe, 1Gb eth: Python 2.7.12 + Python 3.5.2- LXD/ZFS/HD: Python 2.7.14+ + Python 3.6.5- NVMe: Python 2.7.14+ + Python 3.6.5- SSD: Python 2.7.14+ + Python 3.6.5Security Details- Ceph 4 SSD, 1Gb eth: KPTI + __user pointer sanitization + Full generic retpoline Protection- LXD/ZFS/HD: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection- SSD: KPTI + __user pointer sanitization + Full generic retpoline ProtectionDisk Scheduler Details- LXD/ZFS/HD: NOOP

ssdaio-stress: Rand Writesqlite: Timed SQLite Insertionsfs-mark: 1000 Files, 1MB Sizedbench: 12 Clientsdbench: 48 Clientsdbench: 128 Clientsdbench: 1 Clientstiobench: 64MB Rand Read - 32 Threadstiobench: 64MB Rand Write - 32 Threadscompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treeunpack-linux: linux-4.15.tar.xzpostmark: Disk Transaction Performancecompress-gzip: Linux Source Tree Archiving To .tar.gzapache: Static Web Page ServingCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD2219.44323.2517.3786.08189.28286.6917.8947240.6862.34436.69187.371060.119.19426152.7714605.663573.952.54433.033142.733239.232739.20923.36270736.236206.572471.56520.652685.945.64728234.0830202.251382.49269.1452.67139.65174.95240.4533.3814446.6642.941167.99192.40708.397.73315738.5617967.171918.112.73421.704050.654928.964649.74808.69237556.395618.221732.33206.232304.8610.85570836.0630230.492292.94135.4557.90210.28570.621010.7742.7673033.0593.97862.26350.972042.168.26480750.1611945.86OpenBenchmarking.org

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random WriteCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD8001600240032004000SE +/- 21.90, N = 3SE +/- 15.07, N = 3SE +/- 4.29, N = 3SE +/- 5.34, N = 3SE +/- 12.50, N = 32219.443573.951382.491918.112292.941. (CC) gcc options: -pthread -laio

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD70140210280350SE +/- 2.09, N = 3SE +/- 0.03, N = 5SE +/- 6.35, N = 6SE +/- 0.00, N = 3SE +/- 2.12, N = 6323.252.54269.142.73135.451. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB SizeCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD90180270360450SE +/- 0.07, N = 3SE +/- 2.77, N = 3SE +/- 0.72, N = 3SE +/- 0.75, N = 3SE +/- 0.06, N = 317.37433.0352.67421.7057.901. (CC) gcc options: -static

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD9001800270036004500SE +/- 1.06, N = 3SE +/- 7.95, N = 3SE +/- 2.45, N = 3SE +/- 15.93, N = 3SE +/- 0.68, N = 386.083142.73139.654050.65210.281. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 ClientsCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD11002200330044005500SE +/- 2.83, N = 5SE +/- 1.98, N = 3SE +/- 2.87, N = 3SE +/- 17.53, N = 3SE +/- 2.32, N = 3189.283239.23174.954928.96570.621. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 ClientsCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD10002000300040005000SE +/- 2.18, N = 3SE +/- 2.66, N = 3SE +/- 23.70, N = 6SE +/- 7.68, N = 3SE +/- 8.77, N = 3286.692739.20240.454649.741010.771. (CC) gcc options: -lpopt -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD2004006008001000SE +/- 0.03, N = 3SE +/- 1.83, N = 3SE +/- 0.14, N = 3SE +/- 3.12, N = 3SE +/- 0.16, N = 317.89923.3633.38808.6942.761. (CC) gcc options: -lpopt -O2

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 ThreadsCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD60K120K180K240K300KSE +/- 7433.56, N = 6SE +/- 8289.11, N = 6SE +/- 859.43, N = 6SE +/- 9654.48, N = 6SE +/- 2458.89, N = 647240.68270736.2314446.66237556.3973033.051. (CC) gcc options: -O2

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 ThreadsCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD13002600390052006500SE +/- 0.19, N = 3SE +/- 44.34, N = 3SE +/- 0.67, N = 6SE +/- 121.39, N = 6SE +/- 1.58, N = 462.346206.5742.945618.2293.971. (CC) gcc options: -O2

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD5001000150020002500SE +/- 6.74, N = 3SE +/- 25.50, N = 3SE +/- 138.89, N = 6SE +/- 51.78, N = 6SE +/- 14.95, N = 6436.692471.561167.991732.33862.26

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD110220330440550SE +/- 1.90, N = 3SE +/- 3.27, N = 3SE +/- 2.78, N = 3SE +/- 88.35, N = 3SE +/- 2.96, N = 3187.37520.65192.40206.23350.97

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD6001200180024003000SE +/- 38.95, N = 3SE +/- 14.60, N = 3SE +/- 38.14, N = 3SE +/- 15.65, N = 3SE +/- 5.07, N = 31060.112685.94708.392304.862042.16

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD3691215SE +/- 0.07, N = 4SE +/- 0.01, N = 4SE +/- 0.11, N = 8SE +/- 0.61, N = 8SE +/- 0.03, N = 49.195.647.7310.858.26

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD16003200480064008000SE +/- 24.33, N = 3SE +/- 70.00, N = 3SE +/- 58.07, N = 6SE +/- 81.72, N = 6426172823157570848071. (CC) gcc options: -O3

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD1224364860SE +/- 1.19, N = 6SE +/- 0.43, N = 3SE +/- 0.12, N = 3SE +/- 0.20, N = 3SE +/- 0.27, N = 352.7734.0838.5636.0650.16

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD6K12K18K24K30KSE +/- 129.19, N = 3SE +/- 131.83, N = 3SE +/- 77.42, N = 3SE +/- 204.79, N = 3SE +/- 34.80, N = 314605.6630202.2517967.1730230.4911945.861. (CC) gcc options: -shared -fPIC -O2 -pthread

Phoronix Test Suite v10.8.4