ssd

Bionic LXD container in Xenial host, ZFS on 2x(4x6TB HDD RAIDZ)

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1804168-FO-1804141FO82
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 2 Tests
Disk Test Suite 5 Tests
Common Kernel Benchmarks 2 Tests
Server 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Ceph 4 SSD, 1Gb eth
April 14 2018
 
DRBD/RAID1/NVMe, 1Gb eth
April 14 2018
 
LXD/ZFS/HD
April 16 2018
 
NVMe
April 14 2018
 
SSD
April 13 2018
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

SSD

Processor: Intel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads), Motherboard: Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS), Chipset: Intel Broadwell-U-OPI, Memory: 16384MB, Disk: 512GB Samsung SSD 850, Graphics: Intel HD 5500 (900MHz), Audio: Intel Broadwell-U Audio, Monitor: HP w20, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.15.0-13-generic (x86_64), Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1680x1050

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: CFQ / data=ordered,errors=remount-ro,relatime,rw
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.14+ + Python 3.6.5
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline Protection

Ceph 4 SSD, 1Gb eth

Processor: Intel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads), Motherboard: Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS), Chipset: Intel Broadwell-U-OPI, Memory: 16384MB, Disk: 256GB Samsung SSD 850, Graphics: Intel HD 5500 (900MHz), Audio: Intel Broadwell-U Audio, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.15.0-13-generic (x86_64), Compiler: GCC 7.3.0, File-System: ext4, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: CFQ / data=ordered,discard,relatime,rw,stripe=1024
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.14+ + Python 3.6.5
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline Protection

NVMe

Processor: Intel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads), Motherboard: Supermicro X11SSL-F v1.01 (2.0a BIOS), Memory: 64512MB, Disk: 2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4, Graphics: astdrmfb

OS: Ubuntu 18.04, Kernel: 4.4.0-93-generic (x86_64), Compiler: GCC 7.3.0, File-System: ext2, Screen Resolution: 1024x768, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: none / acl,barrier,block_validity,relatime,rw,stripe=64,user_xattr
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.14+ + Python 3.6.5

DRBD/RAID1/NVMe, 1Gb eth

OS: Ubuntu 16.04, Kernel: 4.4.0-93-generic (x86_64), Compiler: GCC 5.4.0 20160609, File-System: ext4, Screen Resolution: 1024x768, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: none / data=ordered,relatime,rw,stripe=64
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.12 + Python 3.5.2

LXD/ZFS/HD

Processor: Intel Xeon E3-1240 v3 @ 3.80GHz (4 Cores / 8 Threads), Motherboard: Supermicro X10SLL-F v1.02 (2.2 BIOS), Chipset: Intel Xeon E3-1200 v3 DRAM, Memory: 32768MB, Disk: 8 x 6001GB Western Digital WD60EFRX-68M + 2 x 120GB INTEL SSDSC2BB12, Graphics: ASPEED ASPEED Family, Network: Intel Connection I217-LM

OS: Ubuntu 18.04, Kernel: 4.4.0-116-generic (x86_64), Compiler: GCC 7.3.0, File-System: zfs, Screen Resolution: 1024x768, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance
Disk Scheduler Notes: NOOP
Python Notes: Python 2.7.14+ + Python 3.6.5
Security Notes: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection

ssdProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerSSDCeph 4 SSD, 1Gb ethNVMeDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDIntel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads)Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS)Intel Broadwell-U-OPI16384MB512GB Samsung SSD 850Intel HD 5500 (900MHz)Intel Broadwell-U AudioHP w20Intel ConnectionUbuntu 18.044.15.0-13-generic (x86_64)GCC 7.3.0ext41680x1050256GB Samsung SSD 850lxcIntel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads)Supermicro X11SSL-F v1.01 (2.0a BIOS)64512MB2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4astdrmfb4.4.0-93-generic (x86_64)ext21024x768Ubuntu 16.04GCC 5.4.0 20160609ext4Intel Xeon E3-1240 v3 @ 3.80GHz (4 Cores / 8 Threads)Supermicro X10SLL-F v1.02 (2.2 BIOS)Intel Xeon E3-1200 v3 DRAM32768MB8 x 6001GB Western Digital WD60EFRX-68M + 2 x 120GB INTEL SSDSC2BB12ASPEED ASPEED FamilyIntel Connection I217-LMUbuntu 18.044.4.0-116-generic (x86_64)GCC 7.3.0zfsOpenBenchmarking.orgCompiler Details- SSD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ceph 4 SSD, 1Gb eth: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - NVMe: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - DRBD/RAID1/NVMe, 1Gb eth: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - LXD/ZFS/HD: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- SSD: CFQ / data=ordered,errors=remount-ro,relatime,rw- Ceph 4 SSD, 1Gb eth: CFQ / data=ordered,discard,relatime,rw,stripe=1024- NVMe: none / acl,barrier,block_validity,relatime,rw,stripe=64,user_xattr- DRBD/RAID1/NVMe, 1Gb eth: none / data=ordered,relatime,rw,stripe=64Processor Details- Scaling Governor: intel_pstate performancePython Details- SSD: Python 2.7.14+ + Python 3.6.5- Ceph 4 SSD, 1Gb eth: Python 2.7.14+ + Python 3.6.5- NVMe: Python 2.7.14+ + Python 3.6.5- DRBD/RAID1/NVMe, 1Gb eth: Python 2.7.12 + Python 3.5.2- LXD/ZFS/HD: Python 2.7.14+ + Python 3.6.5Security Details- SSD: KPTI + __user pointer sanitization + Full generic retpoline Protection- Ceph 4 SSD, 1Gb eth: KPTI + __user pointer sanitization + Full generic retpoline Protection- LXD/ZFS/HD: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline ProtectionDisk Scheduler Details- LXD/ZFS/HD: NOOP

SSDCeph 4 SSD, 1Gb ethNVMeDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HDLogarithmic Result OverviewPhoronix Test SuiteThreaded I/O TesterDbenchCompile BenchFS-MarkAIO-StressApache BenchmarkPostMarkSQLiteUnpacking The Linux KernelGzip Compression

ssdaio-stress: Rand Writesqlite: Timed SQLite Insertionsfs-mark: 1000 Files, 1MB Sizedbench: 12 Clientsdbench: 48 Clientsdbench: 128 Clientsdbench: 1 Clientstiobench: 64MB Rand Read - 32 Threadstiobench: 64MB Rand Write - 32 Threadscompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treeunpack-linux: linux-4.15.tar.xzpostmark: Disk Transaction Performancecompress-gzip: Linux Source Tree Archiving To .tar.gzapache: Static Web Page ServingSSDCeph 4 SSD, 1Gb ethNVMeDRBD/RAID1/NVMe, 1Gb ethLXD/ZFS/HD2292.94135.4557.90210.28570.621010.7742.7673033.0593.97862.26350.972042.168.26480750.1611945.862219.44323.2517.3786.08189.28286.6917.8947240.6862.34436.69187.371060.119.19426152.7714605.661918.112.73421.704050.654928.964649.74808.69237556.395618.221732.33206.232304.8610.85570836.0630230.493573.952.54433.033142.733239.232739.20923.36270736.236206.572471.56520.652685.945.64728234.0830202.251382.49269.1452.67139.65174.95240.4533.3814446.6642.941167.99192.40708.397.73315738.5617967.17OpenBenchmarking.org

AIO-Stress

AIO-Stress is an a-synchronous I/O benchmark created by SuSE. Current this profile uses a 2048MB test file and a 64KB record size. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random WriteLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD8001600240032004000SE +/- 4.29, N = 3SE +/- 15.07, N = 3SE +/- 5.34, N = 3SE +/- 21.90, N = 3SE +/- 12.50, N = 31382.493573.951918.112219.442292.941. (CC) gcc options: -pthread -laio
OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random WriteLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD6001200180024003000Min: 1373.93 / Avg: 1382.49 / Max: 1387.37Min: 3543.87 / Avg: 3573.95 / Max: 3590.73Min: 1907.53 / Avg: 1918.11 / Max: 1924.7Min: 2178.55 / Avg: 2219.44 / Max: 2253.47Min: 2269.51 / Avg: 2292.94 / Max: 2312.21. (CC) gcc options: -pthread -laio

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD70140210280350SE +/- 6.35, N = 6SE +/- 0.03, N = 5SE +/- 0.00, N = 3SE +/- 2.09, N = 3SE +/- 2.12, N = 6269.142.542.73323.25135.451. (CC) gcc options: -O2 -ldl -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD60120180240300Min: 255.47 / Avg: 269.14 / Max: 292.66Min: 2.41 / Avg: 2.54 / Max: 2.61Min: 2.72 / Avg: 2.73 / Max: 2.74Min: 319.27 / Avg: 323.25 / Max: 326.33Min: 129.44 / Avg: 135.45 / Max: 143.071. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB SizeLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD90180270360450SE +/- 0.72, N = 3SE +/- 2.77, N = 3SE +/- 0.75, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 352.67433.03421.7017.3757.901. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB SizeLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD80160240320400Min: 51.9 / Avg: 52.67 / Max: 54.1Min: 427.7 / Avg: 433.03 / Max: 437Min: 420.2 / Avg: 421.7 / Max: 422.6Min: 17.3 / Avg: 17.37 / Max: 17.5Min: 57.8 / Avg: 57.9 / Max: 581. (CC) gcc options: -static

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD9001800270036004500SE +/- 2.45, N = 3SE +/- 7.95, N = 3SE +/- 15.93, N = 3SE +/- 1.06, N = 3SE +/- 0.68, N = 3139.653142.734050.6586.08210.281. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD7001400210028003500Min: 136.29 / Avg: 139.65 / Max: 144.41Min: 3131.56 / Avg: 3142.73 / Max: 3158.12Min: 4022.58 / Avg: 4050.65 / Max: 4077.72Min: 84.8 / Avg: 86.08 / Max: 88.18Min: 209.48 / Avg: 210.28 / Max: 211.641. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD11002200330044005500SE +/- 2.87, N = 3SE +/- 1.98, N = 3SE +/- 17.53, N = 3SE +/- 2.83, N = 5SE +/- 2.32, N = 3174.953239.234928.96189.28570.621. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD9001800270036004500Min: 169.67 / Avg: 174.95 / Max: 179.55Min: 3235.94 / Avg: 3239.23 / Max: 3242.77Min: 4894.6 / Avg: 4928.96 / Max: 4952.19Min: 185.7 / Avg: 189.28 / Max: 200.55Min: 567.82 / Avg: 570.62 / Max: 575.221. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD10002000300040005000SE +/- 23.70, N = 6SE +/- 2.66, N = 3SE +/- 7.68, N = 3SE +/- 2.18, N = 3SE +/- 8.77, N = 3240.452739.204649.74286.691010.771. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD8001600240032004000Min: 186.88 / Avg: 240.45 / Max: 340.82Min: 2736.42 / Avg: 2739.2 / Max: 2744.53Min: 4640.12 / Avg: 4649.74 / Max: 4664.92Min: 282.37 / Avg: 286.69 / Max: 289.33Min: 1000.02 / Avg: 1010.77 / Max: 1028.141. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD2004006008001000SE +/- 0.14, N = 3SE +/- 1.83, N = 3SE +/- 3.12, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 333.38923.36808.6917.8942.761. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD160320480640800Min: 33.18 / Avg: 33.38 / Max: 33.64Min: 919.72 / Avg: 923.36 / Max: 925.6Min: 804.22 / Avg: 808.69 / Max: 814.7Min: 17.84 / Avg: 17.89 / Max: 17.94Min: 42.5 / Avg: 42.76 / Max: 43.071. (CC) gcc options: -lpopt -O2

Threaded I/O Tester

Tiotester (Threaded I/O Tester) benchmarks the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 ThreadsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD60K120K180K240K300KSE +/- 859.43, N = 6SE +/- 8289.11, N = 6SE +/- 9654.48, N = 6SE +/- 7433.56, N = 6SE +/- 2458.89, N = 614446.66270736.23237556.3947240.6873033.051. (CC) gcc options: -O2
OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 ThreadsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD50K100K150K200K250KMin: 11497.54 / Avg: 14446.66 / Max: 17653.35Min: 236653.57 / Avg: 270736.23 / Max: 294506.76Min: 206680.8 / Avg: 237556.39 / Max: 265010.35Min: 31973.52 / Avg: 47240.68 / Max: 72329.15Min: 61383.53 / Avg: 73033.05 / Max: 78666.361. (CC) gcc options: -O2

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 ThreadsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD13002600390052006500SE +/- 0.67, N = 6SE +/- 44.34, N = 3SE +/- 121.39, N = 6SE +/- 0.19, N = 3SE +/- 1.58, N = 442.946206.575618.2262.3493.971. (CC) gcc options: -O2
OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 ThreadsLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD11002200330044005500Min: 40.04 / Avg: 42.94 / Max: 44.98Min: 6141.59 / Avg: 6206.57 / Max: 6291.32Min: 5284.59 / Avg: 5618.22 / Max: 5968.55Min: 61.96 / Avg: 62.34 / Max: 62.55Min: 90.17 / Avg: 93.97 / Max: 97.891. (CC) gcc options: -O2

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD5001000150020002500SE +/- 138.89, N = 6SE +/- 25.50, N = 3SE +/- 51.78, N = 6SE +/- 6.74, N = 3SE +/- 14.95, N = 61167.992471.561732.33436.69862.26
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD400800120016002000Min: 612.26 / Avg: 1167.99 / Max: 1510.01Min: 2421.64 / Avg: 2471.56 / Max: 2505.56Min: 1504.2 / Avg: 1732.33 / Max: 1817.24Min: 426.85 / Avg: 436.69 / Max: 449.59Min: 818.15 / Avg: 862.26 / Max: 906.6

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD110220330440550SE +/- 2.78, N = 3SE +/- 3.27, N = 3SE +/- 88.35, N = 3SE +/- 1.90, N = 3SE +/- 2.96, N = 3192.40520.65206.23187.37350.97
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD90180270360450Min: 186.85 / Avg: 192.4 / Max: 195.26Min: 515.56 / Avg: 520.65 / Max: 526.74Min: 113.37 / Avg: 206.23 / Max: 382.85Min: 184.97 / Avg: 187.37 / Max: 191.12Min: 347.03 / Avg: 350.97 / Max: 356.77

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD6001200180024003000SE +/- 38.14, N = 3SE +/- 14.60, N = 3SE +/- 15.65, N = 3SE +/- 38.95, N = 3SE +/- 5.07, N = 3708.392685.942304.861060.112042.16
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD5001000150020002500Min: 661.4 / Avg: 708.39 / Max: 783.91Min: 2660.65 / Avg: 2685.94 / Max: 2711.24Min: 2282.18 / Avg: 2304.86 / Max: 2334.89Min: 1006.75 / Avg: 1060.11 / Max: 1135.93Min: 2037.09 / Avg: 2042.16 / Max: 2052.29

Unpacking The Linux Kernel

This test measures how long it takes to extract the .tar.xz Linux kernel package. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD3691215SE +/- 0.11, N = 8SE +/- 0.01, N = 4SE +/- 0.61, N = 8SE +/- 0.07, N = 4SE +/- 0.03, N = 47.735.6410.859.198.26
OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD3691215Min: 7.24 / Avg: 7.73 / Max: 8.09Min: 5.6 / Avg: 5.64 / Max: 5.66Min: 7.35 / Avg: 10.85 / Max: 12.46Min: 9.02 / Avg: 9.19 / Max: 9.32Min: 8.2 / Avg: 8.26 / Max: 8.32

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD16003200480064008000SE +/- 58.07, N = 6SE +/- 70.00, N = 3SE +/- 81.72, N = 6SE +/- 24.33, N = 3315772825708426148071. (CC) gcc options: -O3
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD13002600390052006500Min: 2873 / Avg: 3156.5 / Max: 3246Min: 7142 / Avg: 7282 / Max: 7352Min: 5555 / Avg: 5708.33 / Max: 6097Min: 4237 / Avg: 4261.33 / Max: 43101. (CC) gcc options: -O3

Gzip Compression

This test measures the time needed to archive/compress two copies of the Linux 4.13 kernel source tree using Gzip compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD1224364860SE +/- 0.12, N = 3SE +/- 0.43, N = 3SE +/- 0.20, N = 3SE +/- 1.19, N = 6SE +/- 0.27, N = 338.5634.0836.0652.7750.16
OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD1122334455Min: 38.37 / Avg: 38.56 / Max: 38.78Min: 33.41 / Avg: 34.08 / Max: 34.88Min: 35.7 / Avg: 36.06 / Max: 36.39Min: 50.87 / Avg: 52.77 / Max: 58.57Min: 49.73 / Avg: 50.16 / Max: 50.67

Apache Benchmark

This is a test of ab, which is the Apache benchmark program. This test profile measures how many requests per second a given system can sustain when carrying out 1,000,000 requests with 100 requests being carried out concurrently. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD6K12K18K24K30KSE +/- 77.42, N = 3SE +/- 131.83, N = 3SE +/- 204.79, N = 3SE +/- 129.19, N = 3SE +/- 34.80, N = 317967.1730202.2530230.4914605.6611945.861. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingLXD/ZFS/HDDRBD/RAID1/NVMe, 1Gb ethNVMeCeph 4 SSD, 1Gb ethSSD5K10K15K20K25KMin: 17812.37 / Avg: 17967.17 / Max: 18048.07Min: 29960.65 / Avg: 30202.25 / Max: 30414.48Min: 29823.21 / Avg: 30230.49 / Max: 30471.67Min: 14348.14 / Avg: 14605.66 / Max: 14752.69Min: 11889.62 / Avg: 11945.86 / Max: 12009.481. (CC) gcc options: -shared -fPIC -O2 -pthread

SSD

Processor: Intel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads), Motherboard: Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS), Chipset: Intel Broadwell-U-OPI, Memory: 16384MB, Disk: 512GB Samsung SSD 850, Graphics: Intel HD 5500 (900MHz), Audio: Intel Broadwell-U Audio, Monitor: HP w20, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.15.0-13-generic (x86_64), Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1680x1050

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: CFQ / data=ordered,errors=remount-ro,relatime,rw
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.14+ + Python 3.6.5
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline Protection

Testing initiated at 13 April 2018 23:29 by user sysop.

Ceph 4 SSD, 1Gb eth

Processor: Intel Core i5-5300U @ 2.90GHz (2 Cores / 4 Threads), Motherboard: Intel NUC5i5MYBE (MYBDWi5v.86A.0026.2015.0820.1501 BIOS), Chipset: Intel Broadwell-U-OPI, Memory: 16384MB, Disk: 256GB Samsung SSD 850, Graphics: Intel HD 5500 (900MHz), Audio: Intel Broadwell-U Audio, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.15.0-13-generic (x86_64), Compiler: GCC 7.3.0, File-System: ext4, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: CFQ / data=ordered,discard,relatime,rw,stripe=1024
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.14+ + Python 3.6.5
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline Protection

Testing initiated at 14 April 2018 09:21 by user ubuntu.

NVMe

Processor: Intel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads), Motherboard: Supermicro X11SSL-F v1.01 (2.0a BIOS), Memory: 64512MB, Disk: 2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4, Graphics: astdrmfb

OS: Ubuntu 18.04, Kernel: 4.4.0-93-generic (x86_64), Compiler: GCC 7.3.0, File-System: ext2, Screen Resolution: 1024x768, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: none / acl,barrier,block_validity,relatime,rw,stripe=64,user_xattr
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.14+ + Python 3.6.5

Testing initiated at 14 April 2018 14:44 by user ubuntu.

DRBD/RAID1/NVMe, 1Gb eth

Processor: Intel Xeon E3-1280 v6 @ 4.20GHz (4 Cores / 8 Threads), Motherboard: Supermicro X11SSL-F v1.01 (2.0a BIOS), Memory: 64512MB, Disk: 2 x 800GB INTEL SSDSC2BB80 + 2 x 400GB INTEL SSDPEDME400G4, Graphics: astdrmfb

OS: Ubuntu 16.04, Kernel: 4.4.0-93-generic (x86_64), Compiler: GCC 5.4.0 20160609, File-System: ext4, Screen Resolution: 1024x768, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: none / data=ordered,relatime,rw,stripe=64
Processor Notes: Scaling Governor: intel_pstate performance
Python Notes: Python 2.7.12 + Python 3.5.2

Testing initiated at 14 April 2018 19:59 by user phoronix.

LXD/ZFS/HD

Processor: Intel Xeon E3-1240 v3 @ 3.80GHz (4 Cores / 8 Threads), Motherboard: Supermicro X10SLL-F v1.02 (2.2 BIOS), Chipset: Intel Xeon E3-1200 v3 DRAM, Memory: 32768MB, Disk: 8 x 6001GB Western Digital WD60EFRX-68M + 2 x 120GB INTEL SSDSC2BB12, Graphics: ASPEED ASPEED Family, Network: Intel Connection I217-LM

OS: Ubuntu 18.04, Kernel: 4.4.0-116-generic (x86_64), Compiler: GCC 7.3.0, File-System: zfs, Screen Resolution: 1024x768, System Layer: lxc

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance
Disk Scheduler Notes: NOOP
Python Notes: Python 2.7.14+ + Python 3.6.5
Security Notes: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection

Testing initiated at 16 April 2018 08:14 by user ubuntu.