ocdcephbenchmarks

CEPH Jewel with 3 SSDs, each it's own OSD, no external journal, replica 3, Micron 5100 MAX 1.92TB

HTML result view exported from: https://openbenchmarking.org/result/1805292-FO-OCDCEPHBE93&grs&sor.

ocdcephbenchmarksProcessorMotherboardMemoryDiskGraphicsOSKernelCompilerFile-SystemScreen ResolutionSystem Layerlocal filesystemCEPH Jewel 3 OSDsDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 38 x QEMU Virtual 2.5+ @ 2.19GHz (8 Cores)Red Hat KVM (1.11.0-2.el7 BIOS)2 x 16384 MB RAM28GBcirrusdrmfbCentOS Linux 73.10.0-862.3.2.el7.x86_64 (x86_64)GCC 4.8.5 20150623xfs1024x768KVM QEMU1024GB1788GB28GBOpenBenchmarking.orgCompiler Details- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Mount Options Details- attr2,inode64,noquota,relatime,rw,seclabelPython Details- Python 2.7.5Security Details- SELinux + KPTI + Load fences + Retpoline without IBPB Protection

ocdcephbenchmarkssqlite: Timed SQLite Insertionstiobench: 64MB Rand Write - 32 Threadsdbench: 1 Clientsdbench: 12 Clientsfs-mark: 1000 Files, 1MB Sizedbench: 128 Clientsdbench: 48 Clientsapache: Static Web Page Servingpostmark: Disk Transaction Performancecompilebench: Compileunpack-linux: linux-4.15.tar.xzcompilebench: Initial Createcompilebench: Read Compiled Treepgbench: On-Disk - Normal Load - Read Writecompress-gzip: Linux Source Tree Archiving To .tar.gztiobench: 64MB Rand Read - 32 Threadsaio-stress: Rand Writelocal filesystemCEPH Jewel 3 OSDsDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 320.61958.96179.021285.75152.13959.00812.437307.72240914.4571.3360691.531478.3852.75337.0082.85683.4987.98965.17968.607336.67214915.4173.37107041.831721.8217.29555.54197.93800.77159.031336.951220.017272.34229914.713642.9169.39115753.711802.6645.10300.23101.27773.2095.501055.641055.657162.8722061028.8814.77135.49260.321824.7067.57100449.371822.8746.21299.6098.67691.8783.53970.31938.328550.1124431148.8814.53144.53260.0871.74102558.871340.5598.30214.0156.05417.5161.93779.86712.227961.1922731112.4315.68136.01250.9670.3784936.341818.64OpenBenchmarking.org

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsDirect SSD io=native cache=nonelocal filesystemCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH Jewel 3 OSDsCEPH jewel 3 OSDs replica 320406080100SE +/- 0.28, N = 6SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.10, N = 3SE +/- 0.77, N = 4SE +/- 0.38, N = 317.2920.6145.1046.2152.7598.301. (CC) gcc options: -O2 -ldl -lpthread

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 Threadslocal filesystemDirect SSD io=native cache=noneCEPH Jewel 3 OSDsCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 32004006008001000SE +/- 27.51, N = 6SE +/- 10.53, N = 3SE +/- 5.79, N = 3SE +/- 1.00, N = 3SE +/- 5.80, N = 6SE +/- 2.37, N = 3958.96555.54337.00300.23299.60214.011. (CC) gcc options: -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsDirect SSD io=native cache=nonelocal filesystemCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH Jewel 3 OSDsCEPH jewel 3 OSDs replica 34080120160200SE +/- 1.04, N = 3SE +/- 2.91, N = 3SE +/- 1.69, N = 3SE +/- 1.69, N = 4SE +/- 0.76, N = 3SE +/- 2.01, N = 6197.93179.02101.2798.6782.8556.051. (CC) gcc options: -lpopt -O2

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientslocal filesystemDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH Jewel 3 OSDsCEPH jewel 3 OSDs replica 330060090012001500SE +/- 4.49, N = 3SE +/- 7.08, N = 3SE +/- 2.72, N = 3SE +/- 2.75, N = 3SE +/- 1.93, N = 3SE +/- 0.66, N = 31285.75800.77773.20691.87683.49417.511. (CC) gcc options: -lpopt -O2

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB SizeDirect SSD io=native cache=nonelocal filesystemCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 3 OSDsCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 34080120160200SE +/- 1.29, N = 3SE +/- 4.84, N = 6SE +/- 1.35, N = 6SE +/- 1.36, N = 5SE +/- 0.80, N = 3SE +/- 0.29, N = 3159.03152.1395.5087.9883.5361.931. (CC) gcc options: -static

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 ClientsDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH Jewel 3 OSDslocal filesystemCEPH jewel 3 OSDs replica 330060090012001500SE +/- 6.02, N = 3SE +/- 11.99, N = 3SE +/- 2.85, N = 3SE +/- 11.71, N = 3SE +/- 10.43, N = 3SE +/- 5.18, N = 31336.951055.64970.31965.17959.00779.861. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 ClientsDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 3 OSDsCEPH Jewel 1 OSDlocal filesystemCEPH jewel 3 OSDs replica 330060090012001500SE +/- 2.82, N = 3SE +/- 2.21, N = 3SE +/- 7.36, N = 3SE +/- 8.61, N = 3SE +/- 98.18, N = 6SE +/- 1.19, N = 31220.011055.65968.60938.32812.43712.221. (CC) gcc options: -lpopt -O2

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 3CEPH Jewel 3 OSDslocal filesystemDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external Journal2K4K6K8K10KSE +/- 49.14, N = 3SE +/- 128.93, N = 6SE +/- 99.52, N = 6SE +/- 37.64, N = 3SE +/- 125.92, N = 4SE +/- 197.05, N = 68550.117961.197336.677307.727272.347162.871. (CC) gcc options: -shared -fPIC -O2 -pthread

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceCEPH Jewel 1 OSDlocal filesystemDirect SSD io=native cache=noneCEPH jewel 3 OSDs replica 3CEPH Jewel 1 OSD w/ external JournalCEPH Jewel 3 OSDs5001000150020002500SE +/- 21.11, N = 3SE +/- 53.62, N = 6SE +/- 35.31, N = 5SE +/- 31.10, N = 3SE +/- 34.53, N = 3SE +/- 16.19, N = 32443240922992273220621491. (CC) gcc options: -O3

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 3CEPH Jewel 1 OSD w/ external Journal2004006008001000SE +/- 15.77, N = 3SE +/- 4.80, N = 3SE +/- 22.78, N = 61148.881112.431028.88

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzlocal filesystemCEPH Jewel 1 OSDDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 3 OSDsCEPH jewel 3 OSDs replica 348121620SE +/- 0.07, N = 4SE +/- 0.14, N = 4SE +/- 0.19, N = 7SE +/- 0.42, N = 8SE +/- 0.19, N = 8SE +/- 0.24, N = 514.4514.5314.7114.7715.4115.68

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 3CEPH Jewel 1 OSD w/ external Journal306090120150SE +/- 2.37, N = 3SE +/- 1.49, N = 3SE +/- 4.01, N = 3144.53136.01135.49

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeCEPH Jewel 1 OSD w/ external JournalCEPH Jewel 1 OSDCEPH jewel 3 OSDs replica 360120180240300SE +/- 2.94, N = 3SE +/- 0.73, N = 3SE +/- 5.76, N = 3260.32260.08250.96

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteDirect SSD io=native cache=noneCEPH Jewel 1 OSD w/ external Journal8001600240032004000SE +/- 14.08, N = 3SE +/- 63.93, N = 33642.911824.701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzCEPH Jewel 1 OSD w/ external JournalDirect SSD io=native cache=noneCEPH jewel 3 OSDs replica 3local filesystemCEPH Jewel 1 OSDCEPH Jewel 3 OSDs1632486480SE +/- 1.35, N = 3SE +/- 2.46, N = 6SE +/- 2.62, N = 6SE +/- 2.64, N = 6SE +/- 2.16, N = 6SE +/- 1.77, N = 667.5769.3970.3771.3371.7473.37

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 ThreadsDirect SSD io=native cache=noneCEPH Jewel 3 OSDsCEPH Jewel 1 OSDCEPH Jewel 1 OSD w/ external JournalCEPH jewel 3 OSDs replica 3local filesystem20K40K60K80K100KSE +/- 1990.78, N = 6SE +/- 1303.43, N = 3SE +/- 2213.07, N = 6SE +/- 2822.07, N = 6SE +/- 9550.32, N = 6SE +/- 3323.01, N = 6115753.71107041.83102558.87100449.3784936.3460691.531. (CC) gcc options: -O2

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random WriteCEPH Jewel 1 OSD w/ external JournalCEPH jewel 3 OSDs replica 3Direct SSD io=native cache=noneCEPH Jewel 3 OSDslocal filesystemCEPH Jewel 1 OSD400800120016002000SE +/- 109.84, N = 6SE +/- 24.90, N = 3SE +/- 55.02, N = 6SE +/- 25.85, N = 3SE +/- 73.02, N = 6SE +/- 13.54, N = 31822.871818.641802.661721.821478.381340.551. (CC) gcc options: -pthread -laio

Phoronix Test Suite v10.8.4