io-benchmarks

2 x Intel Xeon Platinum 8168 testing with a Dell 06G98X and mgadrmfb on CentOS Linux 7 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1801228-TY-IOBENCHMA97&grw&sro.

io-benchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkMonitorOSKernelCompilerFile-SystemScreen Resolutionlinux-dell-ssd-lvm-xfslinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zillinux-dell-ssd-zfs-lz4linux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-nvdimm-lvm-xfslinux-dell-ssd-zfs-lz4-nvdimm-zil2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores)Dell 06G98XIntel Device 202023.59375 x 32768 MB DDR4-2666MHz2 x 240GB SSDSCKJB240G7R + 2 x 119GB PERC H740P Adp + 18 x 960GB PERC H740P Adp + 4 x 3201GB Dell Flash PM1725a 3.2TB SFFmgadrmfbIntel 10G X550TCentOS Linux 73.10.0-693.el7.x86_64 (x86_64)GCC 4.8.5 20150623xfs1024x7683.10.0-693.11.1.el7.x86_64 (x86_64)zfsxfs32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHzAcer V206HQL1600x900zfsOpenBenchmarking.orgCompiler Details- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=genericDisk Details- none / data=ordered,discard,noatime,rw / raid1 sdb1[1] sda1[0]System Details- Python 2.7.5.

io-benchmarksunpack-linux: linux-2.6.32.tar.bz2compilebench: Initial Createcompilebench: Read Compiled Treetiobench: 64MB Rand Write - 32 Threadscompilebench: Compiledbench: 12 Clientstiobench: 64MB Rand Read - 32 Threadsdbench: 48 Clientsdbench: 128 Clientsdbench: 1 Clientsfs-mark: 1000 Files, 1MB Sizepostmark: Disk Transaction Performanceapache: Static Web Page Servingsqlite: Timed SQLite Insertionscompress-gzip: 2GB File Compressionaio-stress: Rand Writelinux-dell-ssd-lvm-xfslinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zillinux-dell-ssd-zfs-lz4linux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-nvdimm-lvm-xfslinux-dell-ssd-zfs-lz4-nvdimm-zil9.58300.66653.952003.231495.255944.49169458.1512164.1011575.83754.70652.90407633542.6314.142166.6110.28178.31747.424785.56890.921988.2611794.782623.542597.00499.31659.5738739290.5811.79817.249.85177.91704.015083.09877.612008.6011761.562833.782885.98491.37638.7738438935.4811.79820.7010.26176.32746.833333.12867.291818.8911764.132594.972769.85470.15440.7334439453.883.2911.79822.219.23353.82764.681802.721660.275915.99225302.269228.4911296.10773.77650.88480738442.443.0012.012411.919.05355.70789.422564.721689.279595.54235164.2116777.8313157.431140.20766.52483838319.4511.862380.189.08338.26794.5119861.391648.45325.32241012.58460.91909.80168.27118.47471738740.1950.2911.792320.178.75328.691402.0722032.501635.059177.12236829.9410880.403749.511282.661002.30465837659.7511.802332.899.84178.56739.415060.50873.912022.8111726.142667.962666.77506.66654.7337039200.9011.80823.40OpenBenchmarking.org

Unpacking The Linux Kernel

linux-2.6.32.tar.bz2

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-2.6.32.tar.bz2linux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil3691215SE +/- 0.01, N = 4SE +/- 0.16, N = 8SE +/- 0.13, N = 8SE +/- 0.13, N = 8SE +/- 0.28, N = 8SE +/- 0.03, N = 4SE +/- 0.12, N = 4SE +/- 0.11, N = 4SE +/- 0.13, N = 48.759.089.589.059.2310.269.8410.289.85

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createlinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil80160240320400SE +/- 4.11, N = 3SE +/- 1.07, N = 3SE +/- 0.60, N = 3SE +/- 1.51, N = 3SE +/- 2.45, N = 3SE +/- 0.42, N = 3SE +/- 1.18, N = 3SE +/- 0.46, N = 3SE +/- 0.29, N = 3328.69338.26300.66355.70353.82176.32178.56178.31177.91

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treelinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil30060090012001500SE +/- 5.28, N = 3SE +/- 6.43, N = 3SE +/- 4.18, N = 3SE +/- 5.28, N = 3SE +/- 0.26, N = 3SE +/- 23.49, N = 3SE +/- 25.59, N = 3SE +/- 16.95, N = 3SE +/- 12.71, N = 31402.07794.51653.95789.42764.68746.83739.41747.42704.01

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 Threadslinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil5K10K15K20K25KSE +/- 122.32, N = 3SE +/- 300.03, N = 5SE +/- 16.82, N = 3SE +/- 35.96, N = 5SE +/- 74.86, N = 6SE +/- 55.57, N = 6SE +/- 86.10, N = 4SE +/- 42.49, N = 3SE +/- 102.34, N = 322032.5019861.392003.232564.721802.723333.125060.504785.565083.091. (CC) gcc options: -O2

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compilelinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil400800120016002000SE +/- 28.14, N = 3SE +/- 10.69, N = 3SE +/- 26.11, N = 6SE +/- 2.52, N = 3SE +/- 24.68, N = 3SE +/- 3.19, N = 3SE +/- 1.98, N = 3SE +/- 4.43, N = 3SE +/- 2.72, N = 31635.051648.451495.251689.271660.27867.29873.91890.92877.61

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientslinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil2K4K6K8K10KSE +/- 4.49, N = 3SE +/- 7.21, N = 6SE +/- 5.85, N = 3SE +/- 41.86, N = 3SE +/- 33.03, N = 3SE +/- 6.76, N = 3SE +/- 0.84, N = 3SE +/- 6.47, N = 3SE +/- 2.41, N = 39177.12325.325944.499595.545915.991818.892022.811988.262008.601. (CC) gcc options: -lpopt -O2

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 Threadslinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil50K100K150K200K250KSE +/- 2174.12, N = 3SE +/- 795.21, N = 3SE +/- 2942.45, N = 3SE +/- 779.38, N = 3SE +/- 946.54, N = 3SE +/- 7.18, N = 3SE +/- 13.11, N = 3SE +/- 14.01, N = 3SE +/- 26.70, N = 3236829.94241012.58169458.15235164.21225302.2611764.1311726.1411794.7811761.561. (CC) gcc options: -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 Clientslinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil4K8K12K16K20KSE +/- 5.86, N = 3SE +/- 9.53, N = 6SE +/- 14.78, N = 3SE +/- 65.46, N = 3SE +/- 22.23, N = 3SE +/- 2.97, N = 3SE +/- 3.44, N = 3SE +/- 2.87, N = 3SE +/- 3.38, N = 310880.40460.9112164.1016777.839228.492594.972667.962623.542833.781. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 Clientslinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil3K6K9K12K15KSE +/- 2.92, N = 3SE +/- 10.78, N = 3SE +/- 16.67, N = 3SE +/- 10.59, N = 3SE +/- 9.78, N = 3SE +/- 1.14, N = 3SE +/- 1.18, N = 3SE +/- 5.57, N = 3SE +/- 2.36, N = 33749.51909.8011575.8313157.4311296.102769.852666.772597.002885.981. (CC) gcc options: -lpopt -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientslinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil30060090012001500SE +/- 3.92, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 2.25, N = 3SE +/- 1.84, N = 3SE +/- 0.68, N = 3SE +/- 0.58, N = 3SE +/- 1.98, N = 3SE +/- 4.30, N = 31282.66168.27754.701140.20773.77470.15506.66499.31491.371. (CC) gcc options: -lpopt -O2

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB Sizelinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil2004006008001000SE +/- 13.22, N = 3SE +/- 0.94, N = 3SE +/- 12.10, N = 3SE +/- 10.55, N = 6SE +/- 32.53, N = 6SE +/- 4.25, N = 3SE +/- 11.62, N = 3SE +/- 4.07, N = 3SE +/- 3.74, N = 31002.30118.47652.90766.52650.88440.73654.73659.57638.771. (CC) gcc options: -static

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performancelinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil10002000300040005000SE +/- 29.00, N = 3SE +/- 51.39, N = 3SE +/- 22.00, N = 3SE +/- 31.33, N = 3SE +/- 7.12, N = 6SE +/- 9.77, N = 6SE +/- 6.14, N = 6SE +/- 8.03, N = 6465847174076483848073443703873841. (CC) gcc options: -O3

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page Servinglinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil8K16K24K32K40KSE +/- 747.07, N = 3SE +/- 774.16, N = 3SE +/- 320.98, N = 3SE +/- 213.45, N = 3SE +/- 218.33, N = 3SE +/- 87.69, N = 3SE +/- 770.83, N = 3SE +/- 785.56, N = 3SE +/- 573.27, N = 537659.7538740.1933542.6338319.4538442.4439453.8839200.9039290.5838935.481. (CC) gcc options: -shared -fPIC -O2 -pthread

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Timed SQLite Insertionslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz41122334455SE +/- 0.11, N = 3SE +/- 0.01, N = 350.293.003.291. (CC) gcc options: -O2 -ldl -lpthread

Gzip Compression

2GB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip Compression2GB File Compressionlinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil48121620SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 311.8011.7914.1411.8612.0111.7911.8011.7911.79

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writelinux-dell-nvdimm-lvm-xfslinux-dell-nvme-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfslinux-dell-ssd-lvm-xfs-nvdimm-xloglinux-dell-ssd-lvm-xfs-nvme-xloglinux-dell-ssd-zfs-lz4linux-dell-ssd-zfs-lz4-nvdimm-zillinux-dell-ssd-zfs-lz4-nvme-zillinux-dell-ssd-zfs-nocompress-nvme-zil5001000150020002500SE +/- 1.22, N = 3SE +/- 33.55, N = 3SE +/- 6.77, N = 3SE +/- 0.61, N = 3SE +/- 2.17, N = 3SE +/- 18.67, N = 6SE +/- 4.80, N = 3SE +/- 15.72, N = 3SE +/- 12.60, N = 32332.892320.172166.612380.182411.91822.21823.40817.24820.701. (CC) gcc options: -pthread -laio


Phoronix Test Suite v10.8.4