disk-benchmarks 2 x Intel Xeon Platinum 8168 testing with a Dell 008R9M and mgadrmfb on CentOS Linux 7 via the Phoronix Test Suite. dell-optane-lvm-xfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 dell-optane-zfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 dell-nvme-zfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 dell-nvme-lvm-xfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 dell-nvdimm-zfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 dell-nvdimm-lvm-xfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 AIO-Stress 0.21 Random Write MB/s > Higher Is Better dell-optane-lvm-xfs . 2420.18 |================================================ dell-optane-zfs ..... 870.38 |================= dell-nvme-zfs ....... 850.36 |================= dell-nvme-lvm-xfs ... 2371.00 |=============================================== dell-nvdimm-zfs ..... 884.78 |================== dell-nvdimm-lvm-xfs . 2395.57 |================================================ FS-Mark 3.3 1000 Files, 1MB Size Files/s > Higher Is Better dell-optane-lvm-xfs . 794.23 |================================================= dell-optane-zfs ..... 628.70 |======================================= dell-nvme-zfs ....... 603.87 |===================================== dell-nvme-lvm-xfs ... 91.00 |====== dell-nvdimm-zfs ..... 668.00 |========================================= dell-nvdimm-lvm-xfs . 761.17 |=============================================== Dbench 4.0 12 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 8100.29 |=========================================== dell-optane-zfs ..... 1979.84 |=========== dell-nvme-zfs ....... 1819.98 |========== dell-nvme-lvm-xfs ... 364.46 |== dell-nvdimm-zfs ..... 2039.82 |=========== dell-nvdimm-lvm-xfs . 9049.39 |================================================ Dbench 4.0 48 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 12385.43 |=============================================== dell-optane-zfs ..... 2442.61 |========= dell-nvme-zfs ....... 2424.08 |========= dell-nvme-lvm-xfs ... 432.04 |== dell-nvdimm-zfs ..... 2547.35 |========== dell-nvdimm-lvm-xfs . 11076.00 |========================================== Dbench 4.0 128 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 11737.73 |=============================================== dell-optane-zfs ..... 2390.56 |========== dell-nvme-zfs ....... 2616.03 |========== dell-nvme-lvm-xfs ... 820.09 |=== dell-nvdimm-zfs ..... 2527.31 |========== dell-nvdimm-lvm-xfs . 3541.24 |============== Dbench 4.0 1 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 1082.91 |=========================================== dell-optane-zfs ..... 541.06 |====================== dell-nvme-zfs ....... 512.35 |===================== dell-nvme-lvm-xfs ... 144.62 |====== dell-nvdimm-zfs ..... 553.34 |====================== dell-nvdimm-lvm-xfs . 1194.98 |================================================ Threaded I/O Tester 20170503 64MB Random Read - 32 Threads MB/s > Higher Is Better dell-optane-lvm-xfs . 242232.56 |============================================ dell-optane-zfs ..... 11862.43 |== dell-nvme-zfs ....... 11896.04 |== dell-nvme-lvm-xfs ... 236968.49 |=========================================== dell-nvdimm-zfs ..... 11908.18 |== dell-nvdimm-lvm-xfs . 253998.06 |============================================== Threaded I/O Tester 20170503 64MB Random Write - 32 Threads MB/s > Higher Is Better dell-optane-lvm-xfs . 8694.38 |================================================ dell-optane-zfs ..... 4634.40 |========================== dell-nvme-zfs ....... 4074.75 |====================== dell-nvme-lvm-xfs ... 4640.11 |========================== dell-nvdimm-zfs ..... 5008.32 |============================ dell-nvdimm-lvm-xfs . 7204.95 |======================================== Compile Bench 0.6 Test: Compile MB/s > Higher Is Better dell-optane-lvm-xfs . 1657.90 |================================================ dell-optane-zfs ..... 906.18 |========================== dell-nvme-zfs ....... 897.88 |========================== dell-nvme-lvm-xfs ... 1668.83 |================================================ dell-nvdimm-zfs ..... 906.50 |========================== dell-nvdimm-lvm-xfs . 1653.14 |================================================ Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better dell-optane-lvm-xfs . 342.55 |================================================= dell-optane-zfs ..... 181.50 |========================== dell-nvme-zfs ....... 179.77 |========================== dell-nvme-lvm-xfs ... 344.21 |================================================= dell-nvdimm-zfs ..... 182.29 |========================== dell-nvdimm-lvm-xfs . 335.46 |================================================ Compile Bench 0.6 Test: Read Compiled Tree MB/s > Higher Is Better dell-optane-lvm-xfs . 964.35 |============================== dell-optane-zfs ..... 720.89 |======================= dell-nvme-zfs ....... 768.61 |======================== dell-nvme-lvm-xfs ... 828.06 |========================== dell-nvdimm-zfs ..... 728.07 |======================= dell-nvdimm-lvm-xfs . 1520.16 |================================================ Unpacking The Linux Kernel linux-4.15.tar.xz Seconds < Lower Is Better dell-optane-lvm-xfs . 6.98 |================================== dell-optane-zfs ..... 9.26 |============================================= dell-nvme-zfs ....... 10.37 |================================================== dell-nvme-lvm-xfs ... 7.14 |================================== dell-nvdimm-zfs ..... 8.99 |=========================================== dell-nvdimm-lvm-xfs . 6.95 |================================== PostMark 1.51 Disk Transaction Performance TPS > Higher Is Better dell-optane-lvm-xfs . 4870 |=================================================== dell-optane-zfs ..... 785 |======== dell-nvme-zfs ....... 315 |=== dell-nvme-lvm-xfs ... 4838 |=================================================== dell-nvdimm-zfs ..... 951 |========== dell-nvdimm-lvm-xfs . 4777 |================================================== Gzip Compression Linux Source Tree Archiving To .tar.gz Seconds < Lower Is Better dell-optane-lvm-xfs . 44.23 |============================================== dell-optane-zfs ..... 44.83 |=============================================== dell-nvme-zfs ....... 47.95 |================================================== dell-nvme-lvm-xfs ... 44.06 |============================================== dell-nvdimm-zfs ..... 44.75 |=============================================== dell-nvdimm-lvm-xfs . 44.09 |============================================== SQLite 3.22 Timed SQLite Insertions Seconds < Lower Is Better dell-optane-zfs ... 3.02 |=== dell-nvme-lvm-xfs . 56.39 |====================================================