disk-benchmarks 2 x Intel Xeon Platinum 8168 testing with a Dell 008R9M and mgadrmfb on CentOS Linux 7 via the Phoronix Test Suite. dell-optane-lvm-xfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 dell-optane-zfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 dell-nvme-zfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 dell-nvme-lvm-xfs: Processor: 2 x Intel Xeon Platinum 8168 @ 2.70GHz (96 Cores), Motherboard: Dell 008R9M, Chipset: Intel Device 2020, Memory: 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 32 GB + 16384 MB + 16384 MB + 16384 MB DDR4-2666MHz, Disk: 119GB PERC H740P Mini + 4 x 3201GB Dell Flash PM1725a 3.2TB SFF + 2 x 750GB INTEL SSDPE21K750GA, Graphics: mgadrmfb, Network: Broadcom Limited NetXtreme BCM5720 Gigabit PCIe OS: CentOS Linux 7, Kernel: 3.10.0-693.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1024x768 AIO-Stress 0.21 Random Write MB/s > Higher Is Better dell-optane-lvm-xfs . 2420.18 |================================================ dell-optane-zfs ..... 870.38 |================= dell-nvme-zfs ....... 850.36 |================= dell-nvme-lvm-xfs ... 2371.00 |=============================================== FS-Mark 3.3 1000 Files, 1MB Size Files/s > Higher Is Better dell-optane-lvm-xfs . 794.23 |================================================= dell-optane-zfs ..... 628.70 |======================================= dell-nvme-zfs ....... 603.87 |===================================== dell-nvme-lvm-xfs ... 91.00 |====== Dbench 4.0 12 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 8100.29 |================================================ dell-optane-zfs ..... 1979.84 |============ dell-nvme-zfs ....... 1819.98 |=========== dell-nvme-lvm-xfs ... 364.46 |== Dbench 4.0 48 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 12385.43 |=============================================== dell-optane-zfs ..... 2442.61 |========= dell-nvme-zfs ....... 2424.08 |========= dell-nvme-lvm-xfs ... 432.04 |== Dbench 4.0 128 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 11737.73 |=============================================== dell-optane-zfs ..... 2390.56 |========== dell-nvme-zfs ....... 2616.03 |========== dell-nvme-lvm-xfs ... 820.09 |=== Dbench 4.0 1 Clients MB/s > Higher Is Better dell-optane-lvm-xfs . 1082.91 |================================================ dell-optane-zfs ..... 541.06 |======================== dell-nvme-zfs ....... 512.35 |======================= dell-nvme-lvm-xfs ... 144.62 |====== Threaded I/O Tester 20170503 64MB Random Read - 32 Threads MB/s > Higher Is Better dell-optane-lvm-xfs . 242232.56 |============================================== dell-optane-zfs ..... 11862.43 |== dell-nvme-zfs ....... 11896.04 |== dell-nvme-lvm-xfs ... 236968.49 |============================================= Threaded I/O Tester 20170503 64MB Random Write - 32 Threads MB/s > Higher Is Better dell-optane-lvm-xfs . 8694.38 |================================================ dell-optane-zfs ..... 4634.40 |========================== dell-nvme-zfs ....... 4074.75 |====================== dell-nvme-lvm-xfs ... 4640.11 |========================== Compile Bench 0.6 Test: Compile MB/s > Higher Is Better dell-optane-lvm-xfs . 1657.90 |================================================ dell-optane-zfs ..... 906.18 |========================== dell-nvme-zfs ....... 897.88 |========================== dell-nvme-lvm-xfs ... 1668.83 |================================================ Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better dell-optane-lvm-xfs . 342.55 |================================================= dell-optane-zfs ..... 181.50 |========================== dell-nvme-zfs ....... 179.77 |========================== dell-nvme-lvm-xfs ... 344.21 |================================================= Compile Bench 0.6 Test: Read Compiled Tree MB/s > Higher Is Better dell-optane-lvm-xfs . 964.35 |================================================= dell-optane-zfs ..... 720.89 |===================================== dell-nvme-zfs ....... 768.61 |======================================= dell-nvme-lvm-xfs ... 828.06 |========================================== Unpacking The Linux Kernel linux-4.15.tar.xz Seconds < Lower Is Better dell-optane-lvm-xfs . 6.98 |================================== dell-optane-zfs ..... 9.26 |============================================= dell-nvme-zfs ....... 10.37 |================================================== dell-nvme-lvm-xfs ... 7.14 |================================== PostMark 1.51 Disk Transaction Performance TPS > Higher Is Better dell-optane-lvm-xfs . 4870 |=================================================== dell-optane-zfs ..... 785 |======== dell-nvme-zfs ....... 315 |=== dell-nvme-lvm-xfs ... 4838 |=================================================== Gzip Compression Linux Source Tree Archiving To .tar.gz Seconds < Lower Is Better dell-optane-lvm-xfs . 44.23 |============================================== dell-optane-zfs ..... 44.83 |=============================================== dell-nvme-zfs ....... 47.95 |================================================== dell-nvme-lvm-xfs ... 44.06 |============================================== SQLite 3.22 Timed SQLite Insertions Seconds < Lower Is Better dell-optane-zfs ... 3.02 |=== dell-nvme-lvm-xfs . 56.39 |====================================================