ssd

Bionic LXD container in Xenial host, ZFS on 2x(4x6TB HDD RAIDZ)

HTML result view exported from: https://openbenchmarking.org/result/1804168-FO-1804141FO82&grr&sor.

ssdProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelCompilerFile-SystemSystem LayerScreen ResolutionCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSDIntel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB256GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioIntel ConnectionUbuntu 18.044.15.0-13-generic (x86_64)GCC 7.3.0ext4lxcIntel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfbUbuntu 16.044.4.0-93-generic (x86_64)GCC 5.4.0 201606091024x768Intel Xeon E3-1240 v3 @ 3.80GHz (4 Cores / 8 Threads)Supermicro X10SLL-F v1.02 (2.2 BIOS)Intel Xeon E3-1200 v3 DRAM32768MB8 x 6001GB Western Digital WD60EFRX-68M + 2 x 120GB INTEL SSDSC2BB12ASPEED ASPEED FamilyIntel Connection I217-LMUbuntu 18.044.4.0-116-generic (x86_64)GCC 7.3.0zfsIntel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfb4.4.0-93-generic (x86_64)ext2Intel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB512GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioHP w20Intel Connection4.15.0-13-generic (x86_64)ext41680x1050OpenBenchmarking.orgCompiler Details- Ceph 4 SSD, 1Gb eth: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - DRBD/RAID1/NVMe, 1Gb eth: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - LXD/ZFS/HD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - NVMe: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - SSD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- Ceph 4 SSD, 1Gb eth: CFQ / data=ordered,discard,relatime,rw,stripe=1024- DRBD/RAID1/NVMe, 1Gb eth: none / data=ordered,relatime,rw,stripe=64- NVMe: none / acl,barrier,block_validity,relatime,rw,stripe=64,user_xattr- SSD: CFQ / data=ordered,errors=remount-ro,relatime,rwProcessor Details- Scaling Governor: intel_pstate performancePython Details- Ceph 4 SSD, 1Gb eth: Python 2.7.14+ + Python 3.6.5- DRBD/RAID1/NVMe, 1Gb eth: Python 2.7.12 + Python 3.5.2- LXD/ZFS/HD: Python 2.7.14+ + Python 3.6.5- NVMe: Python 2.7.14+ + Python 3.6.5- SSD: Python 2.7.14+ + Python 3.6.5Security Details- Ceph 4 SSD, 1Gb eth: KPTI + __user pointer sanitization + Full generic retpoline Protection- LXD/ZFS/HD: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection- SSD: KPTI + __user pointer sanitization + Full generic retpoline ProtectionDisk Scheduler Details- LXD/ZFS/HD: NOOP

ssdapache: Static Web Page Servingcompress-gzip: Linux Source Tree Archiving To .tar.gzpostmark: Disk Transaction Performanceunpack-linux: linux-4.15.tar.xzcompilebench: Read Compiled Treecompilebench: Initial Createcompilebench: Compiletiobench: 64MB Rand Write - 32 Threadstiobench: 64MB Rand Read - 32 Threadsdbench: 1 Clientsdbench: 128 Clientsdbench: 48 Clientsdbench: 12 Clientsfs-mark: 1000 Files, 1MB Sizesqlite: Timed SQLite Insertionsaio-stress: Rand WriteCeph 4 SSD, 1Gb ethDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDNVMeSSD14605.6652.7742619.191060.11187.37436.6962.3447240.6817.89286.69189.2886.0817.37323.252219.4430202.2534.0872825.642685.94520.652471.566206.57270736.23923.362739.203239.233142.73433.032.543573.9517967.1738.5631577.73708.39192.401167.9942.9414446.6633.38240.45174.95139.6552.67269.141382.4930230.4936.06570810.852304.86206.231732.335618.22237556.39808.694649.744928.964050.65421.702.731918.1111945.8650.1648078.262042.16350.97862.2693.9773033.0542.761010.77570.62210.2857.90135.452292.94OpenBenchmarking.org

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingNVMeDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDCeph 4 SSD, 1Gb ethSSD6K12K18K24K30KSE +/- 204.79, N = 3SE +/- 131.83, N = 3SE +/- 77.42, N = 3SE +/- 129.19, N = 3SE +/- 34.80, N = 330230.4930202.2517967.1714605.6611945.861. (CC) gcc options: -shared -fPIC -O2 -pthread

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzDRBD/RAID1/NVMe, 1Gb ethNVMeLXD/ZFS/HDSSDCeph 4 SSD, 1Gb eth1224364860SE +/- 0.43, N = 3SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 1.19, N = 634.0836.0638.5650.1652.77

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceDRBD/RAID1/NVMe, 1Gb ethNVMeSSDCeph 4 SSD, 1Gb ethLXD/ZFS/HD16003200480064008000SE +/- 70.00, N = 3SE +/- 81.72, N = 6SE +/- 24.33, N = 3SE +/- 58.07, N = 6728257084807426131571. (CC) gcc options: -O3

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDSSDCeph 4 SSD, 1Gb ethNVMe3691215SE +/- 0.01, N = 4SE +/- 0.11, N = 8SE +/- 0.03, N = 4SE +/- 0.07, N = 4SE +/- 0.61, N = 85.647.738.269.1910.85

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeDRBD/RAID1/NVMe, 1Gb ethNVMeSSDCeph 4 SSD, 1Gb ethLXD/ZFS/HD6001200180024003000SE +/- 14.60, N = 3SE +/- 15.65, N = 3SE +/- 5.07, N = 3SE +/- 38.95, N = 3SE +/- 38.14, N = 32685.942304.862042.161060.11708.39

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateDRBD/RAID1/NVMe, 1Gb ethSSDNVMeLXD/ZFS/HDCeph 4 SSD, 1Gb eth110220330440550SE +/- 3.27, N = 3SE +/- 2.96, N = 3SE +/- 88.35, N = 3SE +/- 2.78, N = 3SE +/- 1.90, N = 3520.65350.97206.23192.40187.37

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileDRBD/RAID1/NVMe, 1Gb ethNVMeLXD/ZFS/HDSSDCeph 4 SSD, 1Gb eth5001000150020002500SE +/- 25.50, N = 3SE +/- 51.78, N = 6SE +/- 138.89, N = 6SE +/- 14.95, N = 6SE +/- 6.74, N = 32471.561732.331167.99862.26436.69

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 ThreadsDRBD/RAID1/NVMe, 1Gb ethNVMeSSDCeph 4 SSD, 1Gb ethLXD/ZFS/HD13002600390052006500SE +/- 44.34, N = 3SE +/- 121.39, N = 6SE +/- 1.58, N = 4SE +/- 0.19, N = 3SE +/- 0.67, N = 66206.575618.2293.9762.3442.941. (CC) gcc options: -O2

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 ThreadsDRBD/RAID1/NVMe, 1Gb ethNVMeSSDCeph 4 SSD, 1Gb ethLXD/ZFS/HD60K120K180K240K300KSE +/- 8289.11, N = 6SE +/- 9654.48, N = 6SE +/- 2458.89, N = 6SE +/- 7433.56, N = 6SE +/- 859.43, N = 6270736.23237556.3973033.0547240.6814446.661. (CC) gcc options: -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsDRBD/RAID1/NVMe, 1Gb ethNVMeSSDLXD/ZFS/HDCeph 4 SSD, 1Gb eth2004006008001000SE +/- 1.83, N = 3SE +/- 3.12, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3923.36808.6942.7633.3817.891. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 ClientsNVMeDRBD/RAID1/NVMe, 1Gb ethSSDCeph 4 SSD, 1Gb ethLXD/ZFS/HD10002000300040005000SE +/- 7.68, N = 3SE +/- 2.66, N = 3SE +/- 8.77, N = 3SE +/- 2.18, N = 3SE +/- 23.70, N = 64649.742739.201010.77286.69240.451. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 ClientsNVMeDRBD/RAID1/NVMe, 1Gb ethSSDCeph 4 SSD, 1Gb ethLXD/ZFS/HD11002200330044005500SE +/- 17.53, N = 3SE +/- 1.98, N = 3SE +/- 2.32, N = 3SE +/- 2.83, N = 5SE +/- 2.87, N = 34928.963239.23570.62189.28174.951. (CC) gcc options: -lpopt -O2

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsNVMeDRBD/RAID1/NVMe, 1Gb ethSSDLXD/ZFS/HDCeph 4 SSD, 1Gb eth9001800270036004500SE +/- 15.93, N = 3SE +/- 7.95, N = 3SE +/- 0.68, N = 3SE +/- 2.45, N = 3SE +/- 1.06, N = 34050.653142.73210.28139.6586.081. (CC) gcc options: -lpopt -O2

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB SizeDRBD/RAID1/NVMe, 1Gb ethNVMeSSDLXD/ZFS/HDCeph 4 SSD, 1Gb eth90180270360450SE +/- 2.77, N = 3SE +/- 0.75, N = 3SE +/- 0.06, N = 3SE +/- 0.72, N = 3SE +/- 0.07, N = 3433.03421.7057.9052.6717.371. (CC) gcc options: -static

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsDRBD/RAID1/NVMe, 1Gb ethNVMeSSDLXD/ZFS/HDCeph 4 SSD, 1Gb eth70140210280350SE +/- 0.03, N = 5SE +/- 0.00, N = 3SE +/- 2.12, N = 6SE +/- 6.35, N = 6SE +/- 2.09, N = 32.542.73135.45269.14323.251. (CC) gcc options: -O2 -ldl -lpthread

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random WriteDRBD/RAID1/NVMe, 1Gb ethSSDCeph 4 SSD, 1Gb ethNVMeLXD/ZFS/HD8001600240032004000SE +/- 15.07, N = 3SE +/- 12.50, N = 3SE +/- 21.90, N = 3SE +/- 5.34, N = 3SE +/- 4.29, N = 33573.952292.942219.441918.111382.491. (CC) gcc options: -pthread -laio

Phoronix Test Suite v10.8.4